Aug 04 18:25:59.093975 ip-10-0-137-145 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 18:25:59.093984 ip-10-0-137-145 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 18:25:59.093991 ip-10-0-137-145 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 18:25:59.094208 ip-10-0-137-145 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 18:26:09.304026 ip-10-0-137-145 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 18:26:09.304043 ip-10-0-137-145 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c8684cc7a3a2476e9ba97693c4e6ddcd --
Aug 04 18:28:07.356006 ip-10-0-137-145 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 18:28:09.319079 ip-10-0-137-145 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:28:09.319079 ip-10-0-137-145 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 18:28:09.319079 ip-10-0-137-145 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:28:09.319079 ip-10-0-137-145 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 18:28:09.319079 ip-10-0-137-145 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:28:09.321249 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.321118    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 18:28:09.326421 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326405    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:28:09.326421 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326420    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326427    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326432    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326435    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326438    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326442    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326445    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326448    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326451    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326454    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326457    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326460    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326463    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326470    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326473    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326476    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326479    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326482    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326484    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:28:09.326494 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326487    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326489    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326492    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326495    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326498    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326501    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326504    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326506    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326509    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326512    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326514    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326517    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326520    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326522    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326525    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326528    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326531    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326534    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326537    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326540    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:28:09.326960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326543    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326545    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326548    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326550    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326553    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326555    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326558    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326561    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326563    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326566    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326568    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326571    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326573    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326576    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326579    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326582    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326585    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326588    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326591    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326595    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:28:09.327437 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326598    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326601    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326604    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326607    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326610    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326612    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326615    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326618    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326621    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326623    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326626    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326629    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326631    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326636    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326639    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326643    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326646    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326649    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326653    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:28:09.327960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326656    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326658    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326661    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326664    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326667    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326669    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326672    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326676    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326679    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326681    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326684    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326687    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326689    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326692    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326695    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326698    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326700    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326703    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326705    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.326708    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:28:09.328410 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327422    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327429    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327432    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327435    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327438    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327441    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327444    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327447    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327450    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327453    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327456    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327458    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327461    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327464    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327467    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327470    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327472    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327475    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327478    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327481    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:28:09.328936 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327484    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327487    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327490    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327493    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327496    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327498    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327501    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327503    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327506    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327508    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327511    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327519    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327521    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327524    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327527    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327529    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327533    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327537    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327540    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:28:09.329439 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327543    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327546    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327549    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327551    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327553    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327557    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327561    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327564    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327567    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327570    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327573    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327576    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327578    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327581    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327584    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327586    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327589    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327592    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327594    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:28:09.329954 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327597    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327599    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327602    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327604    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327607    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327610    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327612    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327615    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327617    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327620    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327622    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327625    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327628    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327631    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327633    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327636    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327638    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327641    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327643    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327646    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327648    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:28:09.330411 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327651    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327654    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327657    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327663    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327666    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327668    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327671    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327673    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327676    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327679    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327682    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327684    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327688    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327691    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327694    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327697    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327700    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327703    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327706    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:28:09.330947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.327708    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328080    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328087    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328091    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328094    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328098    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328101    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328104    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328106    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328109    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328111    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328114    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328117    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328120    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328122    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328125    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328130    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328133    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328135    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:28:09.331456 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328138    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328140    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328143    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328145    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328148    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328150    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328153    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328156    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328158    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328161    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328164    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328166    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328169    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328172    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328174    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328177    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328180    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328182    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328185    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328188    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:28:09.331947 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328190    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328194    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328196    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328199    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328201    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328204    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328206    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328209    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328212    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328216    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328218    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328221    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328224    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328227    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328229    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328232    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328234    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328237    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328240    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328242    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:28:09.332448 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328245    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328247    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328250    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328253    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328255    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328258    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328260    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328263    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328265    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328268    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328270    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328273    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328276    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328278    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328281    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328283    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328286    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328289    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328291    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328294    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:28:09.332953 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328296    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328301    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328304    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328306    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328309    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328311    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328314    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328318    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328322    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328324    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328328    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328331    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328334    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328337    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328340    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328342    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328345    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328348    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328351    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:28:09.333454 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328354    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.328357    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328425    2565 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328436    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328442    2565 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328447    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328451    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328455    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328459    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328463    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328466    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328469    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328472    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328475    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328480    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328483    2565 flags.go:64] FLAG: --cgroup-root=""
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328486    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328489    2565 flags.go:64] FLAG: --client-ca-file=""
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328492    2565 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328495    2565 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328499    2565 flags.go:64] FLAG: --cluster-domain=""
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328502    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328505    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328509    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 18:28:09.333923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328512    2565 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328516    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328519    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328521    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328526    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328529    2565 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328532    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328535    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328538    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328541    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328545    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328548    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328551    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328553    2565 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328557    2565 flags.go:64] FLAG: --enable-server="true"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328560    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328565    2565 flags.go:64] FLAG: --event-burst="100"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328568    2565 flags.go:64] FLAG: --event-qps="50"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328571    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328574    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328577    2565 flags.go:64] FLAG: --eviction-hard=""
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328580    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328586    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328589    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328592    2565 flags.go:64] FLAG: --eviction-soft=""
Aug 04 18:28:09.334500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328595    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328598    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328601    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328604    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328607    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328610    2565 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328613    2565 flags.go:64] FLAG: --feature-gates=""
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328617    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328620    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328623    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328626    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328629    2565 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328632    2565 flags.go:64] FLAG: --help="false"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328635    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328638    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328641    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328644    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328647    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328650    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328653    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328656    2565 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328659    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328662    2565 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 18:28:09.335138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328665    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328669    2565 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328671    2565 flags.go:64] FLAG: --kube-reserved=""
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328674    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328677    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328680    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328686    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328689    2565 flags.go:64] FLAG: --lock-file=""
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328692    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328695    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328698    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328703    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328706    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328709    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328712    2565 flags.go:64] FLAG: --logging-format="text"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328714    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328718    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328720    2565 flags.go:64] FLAG: --manifest-url=""
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328723    2565 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328727    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328730    2565 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328734    2565 flags.go:64] FLAG: --max-pods="110"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328737    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328740    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328743    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 18:28:09.335714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328746    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328749    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328751    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328754    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328761    2565 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328764    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328767    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328769    2565 flags.go:64] FLAG: --pod-cidr=""
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328785    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328791    2565 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328794    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328797    2565 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328800    2565 flags.go:64] FLAG: --port="10250"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328804    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328809    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c2990fe0d8c8908"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328812    2565 flags.go:64] FLAG: --qos-reserved=""
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328815    2565 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328818    2565 flags.go:64] FLAG: --register-node="true"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328821    2565 flags.go:64] FLAG: --register-with-taints=""
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328825    2565 flags.go:64] FLAG: --registry-burst="10"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328828    2565 flags.go:64] FLAG: --registry-qps="5"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328830    2565 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328833    2565 flags.go:64] FLAG: --reserved-memory=""
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328837    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328840    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 18:28:09.336349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328843    2565 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328846    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328849    2565 flags.go:64] FLAG: --runonce="false"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328851    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328854    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328857    2565 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328860    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328863    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328866    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328869    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328872    2565 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328875    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328878    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328881    2565 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328883    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328887    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328890    2565 flags.go:64] FLAG: --system-cgroups=""
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328894    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328899    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328902    2565 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328906    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328911    2565 flags.go:64] FLAG: --tls-min-version=""
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328914    2565 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328917    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328920    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 18:28:09.337015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328923    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328926    2565 flags.go:64] FLAG: --v="2"
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328929    2565 flags.go:64] FLAG: --version="false"
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328933    2565 flags.go:64] FLAG: --vmodule=""
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328937    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.328941    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329052    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329056    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329059    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329062    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329064    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329067    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329071    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329074    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329077    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329080    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329083    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329086    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329088    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329091    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:28:09.337624 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329093    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329096    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329099    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329101    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329104    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329107    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329109    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329113    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329117    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329120    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329122    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329125    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329127    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329130    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329132    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329135    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329138    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329140    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329143    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329145    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:28:09.338136 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329148    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329150    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329153    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329155    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329158    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329162    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329165    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329167    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329170    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329173    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329175    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329178    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329180    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329183    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329185    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329188    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329190    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329193    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329196    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:28:09.338622 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329200    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329203    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329206    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329208    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329211    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329213    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329216    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329218    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329221    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329223    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329226    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329228    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329231    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329233    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329236    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329238    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329241    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329243    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329246    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329248    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:28:09.339155 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329251    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329253    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329256    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329260    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329263    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329266    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329269    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329272    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329275    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329278    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329280    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329284    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329288    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329291    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329294    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329296    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329299    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329302    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329305    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329307    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:28:09.339960 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329310    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329313    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329315    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329318    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329321    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.329323    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.329868    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.336416    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.336431    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.337189    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.337197    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337256    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337261    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337265    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337268    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:28:09.340615 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337271    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337274    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337277    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337280    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337282    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337285    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337287    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337290    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337294    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337297    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337300    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337302    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337306    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337310    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337314    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337317    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337319    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337322    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337325    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337328    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:28:09.341026 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337330    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337333    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337336    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337338    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337341    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337344    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337347    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337350    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337352    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337355    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337359    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337363    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337366    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337369    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337371    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337374    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337376    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337379    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337382    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337384    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:28:09.341507 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337387    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337390    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337400    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337403    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337405    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337408    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337411    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337414    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337417    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337420    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337422    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337425    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337428    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337431    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337433    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337436    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337438    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337442    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337445    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337448    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:28:09.342016 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337451    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337454    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337457    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337460    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337462    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337465    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337467    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337470    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337473    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337475    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337478    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337480    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337483    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337485    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337489    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337491    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337494    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337496    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337499    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337501    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:28:09.342528 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337504    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337506    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337509    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337511    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337514    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337517    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337519    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337522    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337525    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337530    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337533    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337536    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337539    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337542    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:28:09.343147 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337545    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.337550    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337659    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337663    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337667    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337672    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337675    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337677    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337680    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337683    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337685    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337688    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337691    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337695    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337698    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:28:09.343504 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337701    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337704    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337707    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337710    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337712    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337715    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337717    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337720    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337722    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337725    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337728    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337730    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337733    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337736    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337739    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337741    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337745    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337747    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337750    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:28:09.343886 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337753    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337755    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337758    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337760    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337763    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337766    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337768    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337771    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337790    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337795    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337798    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337801    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337805    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337807    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337810    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337812    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337815    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337818    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337820    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337823    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:28:09.344346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337825    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337828    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337831    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337833    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337836    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337839    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337842    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337845    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337847    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337850    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337852    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337855    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337858    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337860    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337863    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337865    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337868    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337870    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337872    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337875    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:28:09.344845 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337878    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337880    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337883    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337885    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337888    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337892    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337894    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337897    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337900    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337902    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337905    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337907    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337910    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337912    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337915    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337918    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337920    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337923    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337927    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:28:09.345338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337930    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337933    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337936    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337939    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337941    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337944    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337947    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:09.337949    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.337954    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.338055    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.341531    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.343047    2565 server.go:1019] "Starting client certificate rotation"
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.343152    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 18:28:09.345840 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.343186    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 18:28:09.346155 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.345650    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 18:28:09.346817 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.346759    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 18:28:09.354938 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.354922    2565 log.go:25] "Validated CRI v1 runtime API"
Aug 04 18:28:09.356882 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.356869    2565 log.go:25] "Validated CRI v1 image API"
Aug 04 18:28:09.359942 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.359924    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 18:28:09.363496 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.363474    2565 fs.go:135] Filesystem UUIDs: map[47ca7916-3076-4bb8-8571-0387b679d04c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dac447d6-9db0-4ab7-9a04-00a41baeb7d8:/dev/nvme0n1p4]
Aug 04 18:28:09.363559 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.363495    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 18:28:09.369205 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.369101    2565 manager.go:216] Machine: {Timestamp:2026-08-04 18:28:09.367738845 +0000 UTC m=+0.335629382 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097800 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f07d5fdcacbcb892bdff60dd49a3a SystemUUID:ec2f07d5-fdca-cbcb-892b-dff60dd49a3a BootID:c8684cc7-a3a2-476e-9ba9-7693c4e6ddcd Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:31:a9:81:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:31:a9:81:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:54:bf:3a:47:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 18:28:09.369205 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.369200    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 18:28:09.369304 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.369281    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 18:28:09.372262 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.372235    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 18:28:09.373470 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.372261    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 18:28:09.374216 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.374195    2565 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 18:28:09.374296 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.374219    2565 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 18:28:09.374296 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.374239    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 18:28:09.374933 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.374906    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 18:28:09.375712 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.375695    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 18:28:09.375933 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.375920    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 18:28:09.379408 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379396    2565 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 18:28:09.379521 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379511    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 18:28:09.379553 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379540    2565 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 18:28:09.379553 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379550    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 18:28:09.379604 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379560    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 18:28:09.379604 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379569    2565 kubelet.go:398] "Adding apiserver pod source"
Aug 04 18:28:09.379604 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379578    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 18:28:09.379946 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379934    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 18:28:09.380003 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.379958    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 18:28:09.382452 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.382436    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 18:28:09.383949 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.383936    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 18:28:09.383984 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.383965    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 18:28:09.385118 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385108    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 18:28:09.385158 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385125    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 18:28:09.385158 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385134    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 18:28:09.385158 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385141    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 18:28:09.385158 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385155    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 18:28:09.385260 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385165    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 18:28:09.385260 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385178    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 18:28:09.385260 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385185    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 18:28:09.385260 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385195    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 18:28:09.385260 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385202    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 18:28:09.385260 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385213    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 18:28:09.385260 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.385218    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 18:28:09.386114 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.386101    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 18:28:09.386114 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.386114    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 18:28:09.389292 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.389279    2565 server.go:1268] "Started kubelet"
Aug 04 18:28:09.389496 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.389465    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 18:28:09.389551 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.389525    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 18:28:09.389597 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.389564    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 18:28:09.390168 ip-10-0-137-145 systemd[1]: Started Kubernetes Kubelet.
Aug 04 18:28:09.390800 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.390680    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 18:28:09.391897 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.391886    2565 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 18:28:09.395426 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.395404    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 18:28:09.396347 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.396327    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 18:28:09.396347 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.396345    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 18:28:09.396482 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.396401    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:09.396911 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.396890    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 18:28:09.397114 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.396899    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 18:28:09.397229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.397219    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 18:28:09.397499 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.397476    2565 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 18:28:09.397499 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.397491    2565 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 18:28:09.397646 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.397586    2565 factory.go:55] Registering systemd factory
Aug 04 18:28:09.397646 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.397604    2565 factory.go:223] Registration of the systemd container factory successfully
Aug 04 18:28:09.397746 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.397697    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 18:28:09.397746 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.397691    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 18:28:09.397947 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.397926    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 18:28:09.398293 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.397198    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-145.ec2.internal.18c8ad90bbc0706f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-145.ec2.internal,UID:ip-10-0-137-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-145.ec2.internal,},FirstTimestamp:2026-08-04 18:28:09.389248623 +0000 UTC m=+0.357139160,LastTimestamp:2026-08-04 18:28:09.389248623 +0000 UTC m=+0.357139160,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-145.ec2.internal,}"
Aug 04 18:28:09.398588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.398564    2565 factory.go:153] Registering CRI-O factory
Aug 04 18:28:09.398588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.398586    2565 factory.go:223] Registration of the crio container factory successfully
Aug 04 18:28:09.399028 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.398633    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 18:28:09.399028 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.398925    2565 factory.go:103] Registering Raw factory
Aug 04 18:28:09.399028 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.398944    2565 manager.go:1196] Started watching for new ooms in manager
Aug 04 18:28:09.399508 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.399487    2565 manager.go:349] Starting recovery of all containers
Aug 04 18:28:09.407602 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.407569    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 18:28:09.407697 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.407628    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 18:28:09.412636 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.412621    2565 manager.go:354] Recovery completed
Aug 04 18:28:09.414456 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.414437    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rfs25"
Aug 04 18:28:09.416920 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.416908    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:09.418802 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.418767    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:09.418863 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.418816    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:09.418863 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.418830    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:09.419372 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.419351    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 18:28:09.419372 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.419371    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 18:28:09.419372 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.419361    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:09.419517 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.419389    2565 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 18:28:09.420045 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.420029    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:09.420140 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.420059    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:09.420140 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.420075    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:09.420596 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.420582    2565 policy_none.go:49] "None policy: Start"
Aug 04 18:28:09.420647 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.420600    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 18:28:09.420647 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.420610    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 18:28:09.421838 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.421825    2565 policy_none.go:47] "Start"
Aug 04 18:28:09.430259 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.430093    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-145.ec2.internal.18c8ad90bd835e51  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-145.ec2.internal,UID:ip-10-0-137-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-145.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-145.ec2.internal,},FirstTimestamp:2026-08-04 18:28:09.418800721 +0000 UTC m=+0.386691257,LastTimestamp:2026-08-04 18:28:09.418800721 +0000 UTC m=+0.386691257,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-145.ec2.internal,}"
Aug 04 18:28:09.435673 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.435626    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rfs25"
Aug 04 18:28:09.443516 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.443424    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-145.ec2.internal.18c8ad90bd83b943  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-145.ec2.internal,UID:ip-10-0-137-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-145.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-145.ec2.internal,},FirstTimestamp:2026-08-04 18:28:09.418824003 +0000 UTC m=+0.386714539,LastTimestamp:2026-08-04 18:28:09.418824003 +0000 UTC m=+0.386714539,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-145.ec2.internal,}"
Aug 04 18:28:09.460318 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.460303    2565 manager.go:337] "Starting Device Plugin manager"
Aug 04 18:28:09.460395 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.460354    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 18:28:09.460395 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.460368    2565 server.go:87] "Starting device plugin registration server"
Aug 04 18:28:09.460631 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.460619    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 18:28:09.460703 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.460633    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 18:28:09.460754 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.460724    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 18:28:09.460881 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.460821    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 18:28:09.460881 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.460831    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 18:28:09.461312 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.461296    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 18:28:09.461363 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.461340    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:09.560766 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.560738    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:09.561889 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.561697    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:09.561889 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.561724    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:09.561889 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.561734    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:09.561889 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.561766    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.562416 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.562378    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 18:28:09.563681 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.563666    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 18:28:09.563738 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.563702    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 18:28:09.563738 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.563722    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 18:28:09.563820 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.563754    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 18:28:09.565618 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.565599    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:09.567285 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.567269    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.567365 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.567290    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-145.ec2.internal\": node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:09.630562 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.630538    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:09.664882 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.664845    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"]
Aug 04 18:28:09.664967 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.664944    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:09.666399 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.666377    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:09.666490 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.666413    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:09.666490 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.666423    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:09.667664 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.667652    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:09.667850 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.667834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.667902 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.667894    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:09.668343 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.668323    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:09.668343 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.668345    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:09.668487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.668355    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:09.668487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.668354    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:09.668487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.668376    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:09.668487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.668389    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:09.669437 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.669423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.669501 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.669448    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:09.670116 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.670100    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:09.670185 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.670131    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:09.670185 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.670144    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:09.699369 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.699300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01753f04e1d7f592531bb95e3750c1c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"01753f04e1d7f592531bb95e3750c1c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.699369 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.699348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01753f04e1d7f592531bb95e3750c1c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"01753f04e1d7f592531bb95e3750c1c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.699523 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.699427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0cde0a1474f8dd5c5f71e57322005ab-config\") pod \"kube-apiserver-proxy-ip-10-0-137-145.ec2.internal\" (UID: \"e0cde0a1474f8dd5c5f71e57322005ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.706634 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.706617    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-145.ec2.internal\" not found" node="ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.711231 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.711216    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-145.ec2.internal\" not found" node="ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.731031 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.731013    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:09.800321 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.800291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01753f04e1d7f592531bb95e3750c1c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"01753f04e1d7f592531bb95e3750c1c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.800321 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.800323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01753f04e1d7f592531bb95e3750c1c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"01753f04e1d7f592531bb95e3750c1c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.800487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.800339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0cde0a1474f8dd5c5f71e57322005ab-config\") pod \"kube-apiserver-proxy-ip-10-0-137-145.ec2.internal\" (UID: \"e0cde0a1474f8dd5c5f71e57322005ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.800487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.800385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01753f04e1d7f592531bb95e3750c1c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"01753f04e1d7f592531bb95e3750c1c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.800487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.800388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01753f04e1d7f592531bb95e3750c1c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"01753f04e1d7f592531bb95e3750c1c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.800487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:09.800428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0cde0a1474f8dd5c5f71e57322005ab-config\") pod \"kube-apiserver-proxy-ip-10-0-137-145.ec2.internal\" (UID: \"e0cde0a1474f8dd5c5f71e57322005ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:09.831412 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.831384    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:09.932244 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:09.932218    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.009697 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.009664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:10.014349 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.014119    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:10.032755 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:10.032733    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.133330 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:10.133294    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.233772 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:10.233743    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.266214 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.266152    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:10.334297 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:10.334266    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.343440 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.343419    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 18:28:10.343583 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.343564    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 18:28:10.343630 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.343586    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 18:28:10.434848 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:10.434807    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.440968 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.440938    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 18:23:09 +0000 UTC" deadline="2028-01-24 02:31:33.921352034 +0000 UTC"
Aug 04 18:28:10.440968 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.440962    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12896h3m23.48039332s"
Aug 04 18:28:10.510567 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.510542    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:10.512094 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.512076    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:10.512177 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.512108    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:10.512177 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.512121    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:10.535076 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:10.535016    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.556340 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:10.556307    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01753f04e1d7f592531bb95e3750c1c0.slice/crio-d9f3f75accfabaf1ce44b73935203c1b6f5ffc70ae6c953033d361bf42d89296 WatchSource:0}: Error finding container d9f3f75accfabaf1ce44b73935203c1b6f5ffc70ae6c953033d361bf42d89296: Status 404 returned error can't find the container with id d9f3f75accfabaf1ce44b73935203c1b6f5ffc70ae6c953033d361bf42d89296
Aug 04 18:28:10.561053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.561038    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:28:10.566817 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.566769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal" event={"ID":"01753f04e1d7f592531bb95e3750c1c0","Type":"ContainerStarted","Data":"d9f3f75accfabaf1ce44b73935203c1b6f5ffc70ae6c953033d361bf42d89296"}
Aug 04 18:28:10.635393 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:10.635357    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.667365 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:10.667339    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0cde0a1474f8dd5c5f71e57322005ab.slice/crio-e49ae4ce411dfb205e65d12524a1a57abc0ad18d6da9193649231d9d172f6604 WatchSource:0}: Error finding container e49ae4ce411dfb205e65d12524a1a57abc0ad18d6da9193649231d9d172f6604: Status 404 returned error can't find the container with id e49ae4ce411dfb205e65d12524a1a57abc0ad18d6da9193649231d9d172f6604
Aug 04 18:28:10.735584 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:10.735551    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Aug 04 18:28:10.797718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.797661    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:10.798815 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.798803    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:10.896840 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.896816    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:10.911098 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.911074    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 18:28:10.912053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.912038    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Aug 04 18:28:10.918049 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:10.918035    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 18:28:11.214854 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.214753    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:11.381352 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.381323    2565 apiserver.go:52] "Watching apiserver"
Aug 04 18:28:11.387836 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.387817    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 18:28:11.388209 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.388189    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-q7qlw","openshift-ovn-kubernetes/ovnkube-node-cg9p5","kube-system/global-pull-secret-syncer-xsqt4","kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4qhwg","openshift-image-registry/node-ca-v54tj","openshift-multus/multus-additional-cni-plugins-xjgr2","openshift-multus/multus-t5sv2","openshift-multus/network-metrics-daemon-gz4tk","openshift-network-diagnostics/network-check-target-m27lg","kube-system/konnectivity-agent-xhbv8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb","openshift-dns/node-resolver-c5fdp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"]
Aug 04 18:28:11.389645 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.389627    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:11.389719 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.389701    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:11.391017 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.390996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.392140 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.392123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.392209 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.392179    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:11.393245 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.393229    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 18:28:11.393317 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.393248    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-825pn\""
Aug 04 18:28:11.394572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.393850    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 18:28:11.394572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.393861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.396468 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.396419    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 18:28:11.396468 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.396446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.396619 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.396502    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 18:28:11.396619 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.396541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7scg9\""
Aug 04 18:28:11.397061 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.396877    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 18:28:11.397061 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.396948    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 18:28:11.397061 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.396998    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 18:28:11.398025 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.398007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.398992 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.398972    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:28:11.399090 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.399004    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 18:28:11.399090 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.399053    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nrw74\""
Aug 04 18:28:11.399225 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.399210    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:11.399295 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.399276    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:11.399991 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.399975    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 18:28:11.400663 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.400467    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 18:28:11.400663 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.400541    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.400975 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.400872    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 18:28:11.401163 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.401143    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sgxzk\""
Aug 04 18:28:11.402189 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.402138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.402902 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.402879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-46922\""
Aug 04 18:28:11.402902 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.402884    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 18:28:11.403233 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.403215    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 18:28:11.403867 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.403599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.404354 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.404338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 18:28:11.404450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.404337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 18:28:11.404831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.404638    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 18:28:11.404831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.404668    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 18:28:11.404831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.404677    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 18:28:11.405028 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.404977    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52qd8\""
Aug 04 18:28:11.405154 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.405135    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 18:28:11.405566 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.405549    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:28:11.405974 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.405839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:11.406259 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.406234    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 18:28:11.406363 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.406275    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 18:28:11.406363 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.406291    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pwq6c\""
Aug 04 18:28:11.407412 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.407270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.407906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-system-cni-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.407941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-daemon-config\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.407968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-etc-kubernetes\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.407991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tzdx\" (UniqueName: \"kubernetes.io/projected/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-kube-api-access-7tzdx\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-kubernetes\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysctl-d\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-host\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-tuned\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb2243ff-fa74-46ad-970e-87af0461c9f0-hosts-file\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-os-release\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-var-lib-kubelet\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-socket-dir-parent\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-multus-certs\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-kubelet-config\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-dbus\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysconfig\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-cni-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408417    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-cni-bin\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408454    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hjl6l\""
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-conf-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-sys\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25xww\" (UniqueName: \"kubernetes.io/projected/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-kube-api-access-25xww\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-cnibin\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408567    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb2243ff-fa74-46ad-970e-87af0461c9f0-tmp-dir\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-k8s-cni-cncf-io\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.408797 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-hostroot\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-modprobe-d\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-systemd\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-run\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3a50a40-9b27-4214-bb8a-8868393b5945-host\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysctl-conf\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3a50a40-9b27-4214-bb8a-8868393b5945-serviceca\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-cni-multus\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmfj6\" (UniqueName: \"kubernetes.io/projected/eb2243ff-fa74-46ad-970e-87af0461c9f0-kube-api-access-qmfj6\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-cni-binary-copy\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.408985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-lib-modules\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.409006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-tmp\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.409030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xvg2\" (UniqueName: \"kubernetes.io/projected/b3a50a40-9b27-4214-bb8a-8868393b5945-kube-api-access-9xvg2\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.409054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-netns\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.409072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-kubelet\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.409726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.409287    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 18:28:11.410563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.409924    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 18:28:11.410563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.409972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-662c4\""
Aug 04 18:28:11.410563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.409926    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 18:28:11.412627 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.412610    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 18:28:11.433091 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.433071    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xkgcm"
Aug 04 18:28:11.443115 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.443091    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xkgcm"
Aug 04 18:28:11.498005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.497943    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 18:28:11.509566 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-etc-kubernetes\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.509708 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tzdx\" (UniqueName: \"kubernetes.io/projected/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-kube-api-access-7tzdx\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.509708 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-host\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.509708 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509619    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-etc-kubernetes\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.509896 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-host\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.509896 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-tuned\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.509896 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:11.509896 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-run-netns\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.509896 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-log-socket\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-var-lib-kubelet\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.509989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-var-lib-kubelet\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-socket-dir-parent\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-multus-certs\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-socket-dir-parent\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-kubelet-config\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-sys\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-multus-certs\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.510133 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-kubelet\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510133    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-kubelet-config\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovnkube-config\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-sys\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510210    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-cni-bin\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-device-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-cnibin\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-cni-bin\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-cnibin\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-modprobe-d\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-systemd\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-run\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-ovn\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-slash\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-run\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-systemd\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.510609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-modprobe-d\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-cni-multus\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfj6\" (UniqueName: \"kubernetes.io/projected/eb2243ff-fa74-46ad-970e-87af0461c9f0-kube-api-access-qmfj6\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-cni-multus\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-cni-binary-copy\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c616a19-ab9e-4dc7-8e12-da5e77bbfde6-agent-certs\") pod \"konnectivity-agent-xhbv8\" (UID: \"8c616a19-ab9e-4dc7-8e12-da5e77bbfde6\") " pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-var-lib-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-netns\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.510724    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zppg7\" (UniqueName: \"kubernetes.io/projected/50554e1a-b518-4975-ad4f-b4c49ce303c5-kube-api-access-zppg7\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-os-release\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.510817    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret podName:19b4a443-3471-4aea-8e62-dd47eaf3dbbd nodeName:}" failed. No retries permitted until 2026-08-04 18:28:12.010794931 +0000 UTC m=+2.978685471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret") pod "global-pull-secret-syncer-xsqt4" (UID: "19b4a443-3471-4aea-8e62-dd47eaf3dbbd") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovn-node-metrics-cert\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfjrj\" (UniqueName: \"kubernetes.io/projected/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-kube-api-access-zfjrj\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.510988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-system-cni-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-daemon-config\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.511528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-netns\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-kubernetes\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysctl-d\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-node-log\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-system-cni-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb2243ff-fa74-46ad-970e-87af0461c9f0-hosts-file\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-os-release\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511213    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-kubernetes\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50554e1a-b518-4975-ad4f-b4c49ce303c5-iptables-alerter-script\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysctl-d\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-cni-binary-copy\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-sys-fs\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxmmr\" (UniqueName: \"kubernetes.io/projected/11d53110-886d-4481-a506-17a46b5de32c-kube-api-access-cxmmr\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-os-release\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.512351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb2243ff-fa74-46ad-970e-87af0461c9f0-hosts-file\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-dbus\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysconfig\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-daemon-config\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-registration-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysconfig\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-dbus\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdp4t\" (UniqueName: \"kubernetes.io/projected/b411dba4-f74f-4819-819a-90e50a4ddaa5-kube-api-access-rdp4t\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-cni-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-conf-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25xww\" (UniqueName: \"kubernetes.io/projected/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-kube-api-access-25xww\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-systemd-units\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-conf-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-cni-bin\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb2243ff-fa74-46ad-970e-87af0461c9f0-tmp-dir\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.513161 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-k8s-cni-cncf-io\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-multus-cni-dir\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.511990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-hostroot\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3a50a40-9b27-4214-bb8a-8868393b5945-host\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-socket-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-cnibin\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-hostroot\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-run-k8s-cni-cncf-io\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysctl-conf\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3a50a40-9b27-4214-bb8a-8868393b5945-serviceca\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3a50a40-9b27-4214-bb8a-8868393b5945-host\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50554e1a-b518-4975-ad4f-b4c49ce303c5-host-slash\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb2243ff-fa74-46ad-970e-87af0461c9f0-tmp-dir\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-system-cni-dir\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.513994 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-sysctl-conf\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-etc-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-env-overrides\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovnkube-script-lib\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c616a19-ab9e-4dc7-8e12-da5e77bbfde6-konnectivity-ca\") pod \"konnectivity-agent-xhbv8\" (UID: \"8c616a19-ab9e-4dc7-8e12-da5e77bbfde6\") " pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-lib-modules\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-tmp\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xvg2\" (UniqueName: \"kubernetes.io/projected/b3a50a40-9b27-4214-bb8a-8868393b5945-kube-api-access-9xvg2\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-kubelet\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zlcd\" (UniqueName: \"kubernetes.io/projected/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-kube-api-access-5zlcd\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-systemd\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-cni-netd\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3a50a40-9b27-4214-bb8a-8868393b5945-serviceca\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-host-var-lib-kubelet\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.512939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-lib-modules\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.514913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.513933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-etc-tuned\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.515579 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.515292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-tmp\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.518911 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.518884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmfj6\" (UniqueName: \"kubernetes.io/projected/eb2243ff-fa74-46ad-970e-87af0461c9f0-kube-api-access-qmfj6\") pod \"node-resolver-c5fdp\" (UID: \"eb2243ff-fa74-46ad-970e-87af0461c9f0\") " pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.519653 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.519601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tzdx\" (UniqueName: \"kubernetes.io/projected/da6fafb2-b4b6-49a0-855c-a2e85fa42c32-kube-api-access-7tzdx\") pod \"multus-t5sv2\" (UID: \"da6fafb2-b4b6-49a0-855c-a2e85fa42c32\") " pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.520405 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.520387    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:11.520491 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.520416    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:11.520491 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.520430    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nd2q5 for pod openshift-network-diagnostics/network-check-target-m27lg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:11.520599 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.520494    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5 podName:7635de3b-ce81-42c0-afca-e0b89c0bb2ee nodeName:}" failed. No retries permitted until 2026-08-04 18:28:12.020476572 +0000 UTC m=+2.988367097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nd2q5" (UniqueName: "kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5") pod "network-check-target-m27lg" (UID: "7635de3b-ce81-42c0-afca-e0b89c0bb2ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:11.523554 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.523535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25xww\" (UniqueName: \"kubernetes.io/projected/0eec25a0-5d2f-47e4-80c0-eabf920db1eb-kube-api-access-25xww\") pod \"tuned-4qhwg\" (UID: \"0eec25a0-5d2f-47e4-80c0-eabf920db1eb\") " pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.526432 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.526412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xvg2\" (UniqueName: \"kubernetes.io/projected/b3a50a40-9b27-4214-bb8a-8868393b5945-kube-api-access-9xvg2\") pod \"node-ca-v54tj\" (UID: \"b3a50a40-9b27-4214-bb8a-8868393b5945\") " pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.569362 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.569265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal" event={"ID":"e0cde0a1474f8dd5c5f71e57322005ab","Type":"ContainerStarted","Data":"e49ae4ce411dfb205e65d12524a1a57abc0ad18d6da9193649231d9d172f6604"}
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-run-netns\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-log-socket\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-kubelet\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovnkube-config\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-device-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-ovn\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-slash\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c616a19-ab9e-4dc7-8e12-da5e77bbfde6-agent-certs\") pod \"konnectivity-agent-xhbv8\" (UID: \"8c616a19-ab9e-4dc7-8e12-da5e77bbfde6\") " pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-var-lib-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zppg7\" (UniqueName: \"kubernetes.io/projected/50554e1a-b518-4975-ad4f-b4c49ce303c5-kube-api-access-zppg7\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.613988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-os-release\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovn-node-metrics-cert\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfjrj\" (UniqueName: \"kubernetes.io/projected/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-kube-api-access-zfjrj\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.614831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-node-log\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50554e1a-b518-4975-ad4f-b4c49ce303c5-iptables-alerter-script\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-sys-fs\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxmmr\" (UniqueName: \"kubernetes.io/projected/11d53110-886d-4481-a506-17a46b5de32c-kube-api-access-cxmmr\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-registration-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdp4t\" (UniqueName: \"kubernetes.io/projected/b411dba4-f74f-4819-819a-90e50a4ddaa5-kube-api-access-rdp4t\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-var-lib-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-sys-fs\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-device-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-ovn\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614911    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-slash\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.614952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.615925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovnkube-config\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-os-release\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-systemd-units\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-cni-bin\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-socket-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-cnibin\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.615339    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615398    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-node-log\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:11.615406    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs podName:7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:12.115387714 +0000 UTC m=+3.083278240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs") pod "network-metrics-daemon-gz4tk" (UID: "7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-cni-bin\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-socket-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-run-netns\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-cnibin\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.616718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-log-socket\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-systemd-units\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11d53110-886d-4481-a506-17a46b5de32c-registration-dir\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-kubelet\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50554e1a-b518-4975-ad4f-b4c49ce303c5-host-slash\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-system-cni-dir\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-etc-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-env-overrides\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovnkube-script-lib\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-system-cni-dir\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c616a19-ab9e-4dc7-8e12-da5e77bbfde6-konnectivity-ca\") pod \"konnectivity-agent-xhbv8\" (UID: \"8c616a19-ab9e-4dc7-8e12-da5e77bbfde6\") " pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zlcd\" (UniqueName: \"kubernetes.io/projected/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-kube-api-access-5zlcd\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.615997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-systemd\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-cni-netd\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.617483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b411dba4-f74f-4819-819a-90e50a4ddaa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-host-cni-netd\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-env-overrides\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-run-systemd\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b411dba4-f74f-4819-819a-90e50a4ddaa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50554e1a-b518-4975-ad4f-b4c49ce303c5-iptables-alerter-script\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50554e1a-b518-4975-ad4f-b4c49ce303c5-host-slash\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovnkube-script-lib\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.616676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-etc-openvswitch\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.618169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.617023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c616a19-ab9e-4dc7-8e12-da5e77bbfde6-konnectivity-ca\") pod \"konnectivity-agent-xhbv8\" (UID: \"8c616a19-ab9e-4dc7-8e12-da5e77bbfde6\") " pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:11.619270 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.619246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-ovn-node-metrics-cert\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.620414 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.620391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c616a19-ab9e-4dc7-8e12-da5e77bbfde6-agent-certs\") pod \"konnectivity-agent-xhbv8\" (UID: \"8c616a19-ab9e-4dc7-8e12-da5e77bbfde6\") " pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:11.625236 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.625193    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxmmr\" (UniqueName: \"kubernetes.io/projected/11d53110-886d-4481-a506-17a46b5de32c-kube-api-access-cxmmr\") pod \"aws-ebs-csi-driver-node-4ngrb\" (UID: \"11d53110-886d-4481-a506-17a46b5de32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.626163 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.625972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zppg7\" (UniqueName: \"kubernetes.io/projected/50554e1a-b518-4975-ad4f-b4c49ce303c5-kube-api-access-zppg7\") pod \"iptables-alerter-q7qlw\" (UID: \"50554e1a-b518-4975-ad4f-b4c49ce303c5\") " pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.626163 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.626125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zlcd\" (UniqueName: \"kubernetes.io/projected/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-kube-api-access-5zlcd\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:11.628305 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.628270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdp4t\" (UniqueName: \"kubernetes.io/projected/b411dba4-f74f-4819-819a-90e50a4ddaa5-kube-api-access-rdp4t\") pod \"multus-additional-cni-plugins-xjgr2\" (UID: \"b411dba4-f74f-4819-819a-90e50a4ddaa5\") " pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.628305 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.628289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfjrj\" (UniqueName: \"kubernetes.io/projected/c98dfa59-a5af-4f60-a2f3-7d8b584cc71a-kube-api-access-zfjrj\") pod \"ovnkube-node-cg9p5\" (UID: \"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.704662 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.704619    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5fdp"
Aug 04 18:28:11.711632 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.711610    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t5sv2"
Aug 04 18:28:11.714070 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:11.714000    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2243ff_fa74_46ad_970e_87af0461c9f0.slice/crio-eeb55331a4c8652d1bbac49c64d49b47a2110f9ca137c3c255c9d4014c36a7b0 WatchSource:0}: Error finding container eeb55331a4c8652d1bbac49c64d49b47a2110f9ca137c3c255c9d4014c36a7b0: Status 404 returned error can't find the container with id eeb55331a4c8652d1bbac49c64d49b47a2110f9ca137c3c255c9d4014c36a7b0
Aug 04 18:28:11.719840 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.719817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4qhwg"
Aug 04 18:28:11.721517 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:11.721484    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6fafb2_b4b6_49a0_855c_a2e85fa42c32.slice/crio-c1914a8ba6446f86a50a67c3a26bd24df7706c61026e3df55187d2e7c99134ee WatchSource:0}: Error finding container c1914a8ba6446f86a50a67c3a26bd24df7706c61026e3df55187d2e7c99134ee: Status 404 returned error can't find the container with id c1914a8ba6446f86a50a67c3a26bd24df7706c61026e3df55187d2e7c99134ee
Aug 04 18:28:11.725554 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.725348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v54tj"
Aug 04 18:28:11.732654 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.732485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xjgr2"
Aug 04 18:28:11.734224 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:11.734202    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eec25a0_5d2f_47e4_80c0_eabf920db1eb.slice/crio-7d1ab04e1869e90519611894541902aee4ebfc29c0689db9a9b20df11b0d3dc6 WatchSource:0}: Error finding container 7d1ab04e1869e90519611894541902aee4ebfc29c0689db9a9b20df11b0d3dc6: Status 404 returned error can't find the container with id 7d1ab04e1869e90519611894541902aee4ebfc29c0689db9a9b20df11b0d3dc6
Aug 04 18:28:11.738583 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.738561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:11.745706 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:11.745680    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb411dba4_f74f_4819_819a_90e50a4ddaa5.slice/crio-8360a7c2bd56e921ffc1d9d650fd0447ac5640a975bb149ccaaa27bde7497d64 WatchSource:0}: Error finding container 8360a7c2bd56e921ffc1d9d650fd0447ac5640a975bb149ccaaa27bde7497d64: Status 404 returned error can't find the container with id 8360a7c2bd56e921ffc1d9d650fd0447ac5640a975bb149ccaaa27bde7497d64
Aug 04 18:28:11.747205 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.746879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q7qlw"
Aug 04 18:28:11.747205 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:11.747076    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a50a40_9b27_4214_bb8a_8868393b5945.slice/crio-24faf6fd6332c96aafd92dd662034316b5cffe135376ea25e80656b43d3a7664 WatchSource:0}: Error finding container 24faf6fd6332c96aafd92dd662034316b5cffe135376ea25e80656b43d3a7664: Status 404 returned error can't find the container with id 24faf6fd6332c96aafd92dd662034316b5cffe135376ea25e80656b43d3a7664
Aug 04 18:28:11.753152 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.753134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:11.761727 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:11.761693    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50554e1a_b518_4975_ad4f_b4c49ce303c5.slice/crio-ab9c80e70a7a6693404b1f0f6101a1d955f85e9fb2078101b5568c491a7ba6ab WatchSource:0}: Error finding container ab9c80e70a7a6693404b1f0f6101a1d955f85e9fb2078101b5568c491a7ba6ab: Status 404 returned error can't find the container with id ab9c80e70a7a6693404b1f0f6101a1d955f85e9fb2078101b5568c491a7ba6ab
Aug 04 18:28:11.764299 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:11.764150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb"
Aug 04 18:28:11.767220 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:11.767196    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c616a19_ab9e_4dc7_8e12_da5e77bbfde6.slice/crio-27750a5d6d90ce7e0bc9a01ccc663bf455dbeb5046960a86f10ef081c0fff3f2 WatchSource:0}: Error finding container 27750a5d6d90ce7e0bc9a01ccc663bf455dbeb5046960a86f10ef081c0fff3f2: Status 404 returned error can't find the container with id 27750a5d6d90ce7e0bc9a01ccc663bf455dbeb5046960a86f10ef081c0fff3f2
Aug 04 18:28:11.775671 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:11.775643    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d53110_886d_4481_a506_17a46b5de32c.slice/crio-5286775b54bef648e63a8d84077cd8d7425be8e20de42675864e66945efd2e6c WatchSource:0}: Error finding container 5286775b54bef648e63a8d84077cd8d7425be8e20de42675864e66945efd2e6c: Status 404 returned error can't find the container with id 5286775b54bef648e63a8d84077cd8d7425be8e20de42675864e66945efd2e6c
Aug 04 18:28:12.018982 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.018902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:12.019115 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:12.019052    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:12.019155 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:12.019129    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret podName:19b4a443-3471-4aea-8e62-dd47eaf3dbbd nodeName:}" failed. No retries permitted until 2026-08-04 18:28:13.019111289 +0000 UTC m=+3.987001828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret") pod "global-pull-secret-syncer-xsqt4" (UID: "19b4a443-3471-4aea-8e62-dd47eaf3dbbd") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:12.119429 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.119390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:12.119569 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.119457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:12.119569 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:12.119553    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:12.119643 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:12.119583    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:12.119643 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:12.119593    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nd2q5 for pod openshift-network-diagnostics/network-check-target-m27lg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:12.119643 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:12.119637    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5 podName:7635de3b-ce81-42c0-afca-e0b89c0bb2ee nodeName:}" failed. No retries permitted until 2026-08-04 18:28:13.119624834 +0000 UTC m=+4.087515358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd2q5" (UniqueName: "kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5") pod "network-check-target-m27lg" (UID: "7635de3b-ce81-42c0-afca-e0b89c0bb2ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:12.119755 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:12.119561    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:12.119755 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:12.119694    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs podName:7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:13.119680507 +0000 UTC m=+4.087571036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs") pod "network-metrics-daemon-gz4tk" (UID: "7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:12.447726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.447617    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 18:23:11 +0000 UTC" deadline="2028-02-08 16:41:20.789300655 +0000 UTC"
Aug 04 18:28:12.447726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.447662    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13270h13m8.341644005s"
Aug 04 18:28:12.576159 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.576123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xhbv8" event={"ID":"8c616a19-ab9e-4dc7-8e12-da5e77bbfde6","Type":"ContainerStarted","Data":"27750a5d6d90ce7e0bc9a01ccc663bf455dbeb5046960a86f10ef081c0fff3f2"}
Aug 04 18:28:12.578704 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.578677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"259b856006f90be9c4c5d680eec30d3cfabcccefb498a05c2bcab7dfea31087b"}
Aug 04 18:28:12.581649 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.581568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v54tj" event={"ID":"b3a50a40-9b27-4214-bb8a-8868393b5945","Type":"ContainerStarted","Data":"24faf6fd6332c96aafd92dd662034316b5cffe135376ea25e80656b43d3a7664"}
Aug 04 18:28:12.583646 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.583621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t5sv2" event={"ID":"da6fafb2-b4b6-49a0-855c-a2e85fa42c32","Type":"ContainerStarted","Data":"c1914a8ba6446f86a50a67c3a26bd24df7706c61026e3df55187d2e7c99134ee"}
Aug 04 18:28:12.585132 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.585108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q7qlw" event={"ID":"50554e1a-b518-4975-ad4f-b4c49ce303c5","Type":"ContainerStarted","Data":"ab9c80e70a7a6693404b1f0f6101a1d955f85e9fb2078101b5568c491a7ba6ab"}
Aug 04 18:28:12.586442 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.586417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerStarted","Data":"8360a7c2bd56e921ffc1d9d650fd0447ac5640a975bb149ccaaa27bde7497d64"}
Aug 04 18:28:12.588337 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.588286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4qhwg" event={"ID":"0eec25a0-5d2f-47e4-80c0-eabf920db1eb","Type":"ContainerStarted","Data":"7d1ab04e1869e90519611894541902aee4ebfc29c0689db9a9b20df11b0d3dc6"}
Aug 04 18:28:12.589715 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.589676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5fdp" event={"ID":"eb2243ff-fa74-46ad-970e-87af0461c9f0","Type":"ContainerStarted","Data":"eeb55331a4c8652d1bbac49c64d49b47a2110f9ca137c3c255c9d4014c36a7b0"}
Aug 04 18:28:12.591209 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:12.591182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb" event={"ID":"11d53110-886d-4481-a506-17a46b5de32c","Type":"ContainerStarted","Data":"5286775b54bef648e63a8d84077cd8d7425be8e20de42675864e66945efd2e6c"}
Aug 04 18:28:13.025879 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.025840    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:13.026068 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.026046    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:13.026132 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.026110    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret podName:19b4a443-3471-4aea-8e62-dd47eaf3dbbd nodeName:}" failed. No retries permitted until 2026-08-04 18:28:15.026091757 +0000 UTC m=+5.993982286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret") pod "global-pull-secret-syncer-xsqt4" (UID: "19b4a443-3471-4aea-8e62-dd47eaf3dbbd") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:13.075846 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.075807    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:13.127402 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.127147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:13.127402 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.127252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:13.127633 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.127446    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:13.127633 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.127485    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:13.127633 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.127500    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nd2q5 for pod openshift-network-diagnostics/network-check-target-m27lg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:13.127633 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.127559    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5 podName:7635de3b-ce81-42c0-afca-e0b89c0bb2ee nodeName:}" failed. No retries permitted until 2026-08-04 18:28:15.127539751 +0000 UTC m=+6.095430279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd2q5" (UniqueName: "kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5") pod "network-check-target-m27lg" (UID: "7635de3b-ce81-42c0-afca-e0b89c0bb2ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:13.128007 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.127989    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:13.128065 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.128038    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs podName:7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:15.128021039 +0000 UTC m=+6.095911569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs") pod "network-metrics-daemon-gz4tk" (UID: "7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:13.448747 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.448631    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 18:23:11 +0000 UTC" deadline="2028-01-16 16:05:36.9909694 +0000 UTC"
Aug 04 18:28:13.448747 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.448697    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12717h37m23.54227755s"
Aug 04 18:28:13.565411 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.565371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:13.565572 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.565526    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:13.566004 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.565980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:13.566110 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.566092    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:13.568169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:13.567146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:13.568169 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:13.567250    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:15.043229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:15.043190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:15.043615 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.043367    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:15.043615 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.043422    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret podName:19b4a443-3471-4aea-8e62-dd47eaf3dbbd nodeName:}" failed. No retries permitted until 2026-08-04 18:28:19.043404376 +0000 UTC m=+10.011294904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret") pod "global-pull-secret-syncer-xsqt4" (UID: "19b4a443-3471-4aea-8e62-dd47eaf3dbbd") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:15.143722 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:15.143685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:15.143922 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:15.143788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:15.143993 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.143942    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:15.143993 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.143963    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:15.143993 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.143977    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nd2q5 for pod openshift-network-diagnostics/network-check-target-m27lg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:15.144144 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.144032    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5 podName:7635de3b-ce81-42c0-afca-e0b89c0bb2ee nodeName:}" failed. No retries permitted until 2026-08-04 18:28:19.144015396 +0000 UTC m=+10.111905923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd2q5" (UniqueName: "kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5") pod "network-check-target-m27lg" (UID: "7635de3b-ce81-42c0-afca-e0b89c0bb2ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:15.144549 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.144528    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:15.144626 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.144588    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs podName:7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:19.144572101 +0000 UTC m=+10.112462639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs") pod "network-metrics-daemon-gz4tk" (UID: "7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:15.567274 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:15.566771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:15.567274 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.566915    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:15.567274 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:15.566961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:15.567274 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.567137    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:15.567274 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:15.567171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:15.567274 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:15.567239    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:17.564830 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:17.564793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:17.565348 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:17.564928    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:17.565348 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:17.565312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:17.565570 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:17.565533    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:17.565570 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:17.565550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:17.565749 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:17.565718    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:19.078097 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:19.077486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:19.078097 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.077687    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:19.078097 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.077747    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret podName:19b4a443-3471-4aea-8e62-dd47eaf3dbbd nodeName:}" failed. No retries permitted until 2026-08-04 18:28:27.077728991 +0000 UTC m=+18.045619521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret") pod "global-pull-secret-syncer-xsqt4" (UID: "19b4a443-3471-4aea-8e62-dd47eaf3dbbd") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:19.178537 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:19.178330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:19.178537 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:19.178414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:19.178537 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.178527    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:19.178858 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.178557    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:19.178858 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.178577    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:19.178858 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.178590    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nd2q5 for pod openshift-network-diagnostics/network-check-target-m27lg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:19.178858 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.178601    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs podName:7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:27.178579274 +0000 UTC m=+18.146469819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs") pod "network-metrics-daemon-gz4tk" (UID: "7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:19.178858 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.178639    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5 podName:7635de3b-ce81-42c0-afca-e0b89c0bb2ee nodeName:}" failed. No retries permitted until 2026-08-04 18:28:27.178623413 +0000 UTC m=+18.146513954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd2q5" (UniqueName: "kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5") pod "network-check-target-m27lg" (UID: "7635de3b-ce81-42c0-afca-e0b89c0bb2ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:19.565881 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:19.565405    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:19.565881 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.565530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:19.565881 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:19.565554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:19.565881 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.565666    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:19.565881 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:19.565698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:19.565881 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:19.565766    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:21.565044 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:21.565003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:21.565044 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:21.565034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:21.565547 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:21.565023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:21.565547 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:21.565254    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:21.565547 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:21.565347    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:21.565547 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:21.565442    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:23.564113 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:23.564073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:23.564572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:23.564073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:23.564572 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:23.564223    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:23.564572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:23.564072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:23.564572 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:23.564284    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:23.564572 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:23.564373    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:25.564241 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:25.564208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:25.564686 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:25.564260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:25.564686 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:25.564209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:25.564686 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:25.564338    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:25.564686 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:25.564427    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:25.564686 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:25.564521    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:27.140217 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:27.140170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:27.140719 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.140306    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:27.140719 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.140359    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret podName:19b4a443-3471-4aea-8e62-dd47eaf3dbbd nodeName:}" failed. No retries permitted until 2026-08-04 18:28:43.140346774 +0000 UTC m=+34.108237302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret") pod "global-pull-secret-syncer-xsqt4" (UID: "19b4a443-3471-4aea-8e62-dd47eaf3dbbd") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:27.240796 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:27.240751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:27.240981 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.240924    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:27.240981 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:27.240938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:27.241083 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.240997    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs podName:7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:43.240975898 +0000 UTC m=+34.208866427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs") pod "network-metrics-daemon-gz4tk" (UID: "7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:27.241083 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.241056    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:27.241083 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.241077    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:27.241226 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.241089    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nd2q5 for pod openshift-network-diagnostics/network-check-target-m27lg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:27.241226 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.241136    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5 podName:7635de3b-ce81-42c0-afca-e0b89c0bb2ee nodeName:}" failed. No retries permitted until 2026-08-04 18:28:43.241124306 +0000 UTC m=+34.209014830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd2q5" (UniqueName: "kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5") pod "network-check-target-m27lg" (UID: "7635de3b-ce81-42c0-afca-e0b89c0bb2ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:27.564274 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:27.564028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:27.564441 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:27.564045    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:27.564441 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.564380    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:27.564441 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:27.564097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:27.564598 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.564448    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:27.564598 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:27.564547    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:29.565848 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:29.565811    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:29.566310 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:29.565905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:29.566310 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:29.565951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:29.566310 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:29.565945    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:29.566310 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:29.566038    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:29.566310 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:29.566132    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:30.639853 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:30.639404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal" event={"ID":"e0cde0a1474f8dd5c5f71e57322005ab","Type":"ContainerStarted","Data":"610b389c8484c292cce257c9ec734f2419db90481b936a23b475403c34182507"}
Aug 04 18:28:30.645362 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:30.644649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4qhwg" event={"ID":"0eec25a0-5d2f-47e4-80c0-eabf920db1eb","Type":"ContainerStarted","Data":"d8910dfd0721f705e7334824a63987ff0bb963384bb7cf26ca7b4216f44bbce5"}
Aug 04 18:28:30.650099 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:30.649938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"fdae222c74a06032e333d4033a9b3c2518af074f09a5c0fe9f2c73fabf02665a"}
Aug 04 18:28:30.650099 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:30.650028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"6a6d0fba732b1f352ee7393f05a6a9dba4ceacba99f1de39993f772ccdc60bff"}
Aug 04 18:28:30.652404 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:30.652337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t5sv2" event={"ID":"da6fafb2-b4b6-49a0-855c-a2e85fa42c32","Type":"ContainerStarted","Data":"10261b1f675310566175b86a64484da2aa586e259b71372484c5bd43d5301be5"}
Aug 04 18:28:30.656850 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:30.656729    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal" podStartSLOduration=20.656715284 podStartE2EDuration="20.656715284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:30.656427026 +0000 UTC m=+21.624317574" watchObservedRunningTime="2026-08-04 18:28:30.656715284 +0000 UTC m=+21.624605831"
Aug 04 18:28:30.696834 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:30.696769    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4qhwg" podStartSLOduration=3.121209737 podStartE2EDuration="21.696751961s" totalImagesPullingTime="18.575542224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:30.676870806 +0000 UTC m=+21.644761353" watchObservedRunningTime="2026-08-04 18:28:30.696751961 +0000 UTC m=+21.664642507"
Aug 04 18:28:30.697240 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:30.697141    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t5sv2" podStartSLOduration=3.035111685 podStartE2EDuration="21.69712899s" totalImagesPullingTime="18.662017305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:30.696459182 +0000 UTC m=+21.664349732" watchObservedRunningTime="2026-08-04 18:28:30.69712899 +0000 UTC m=+21.665019537"
Aug 04 18:28:31.564439 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.564184    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:31.564599 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.564200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:31.564599 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:31.564542    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:31.564599 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.564215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:31.564761 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:31.564613    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:31.564761 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:31.564689    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:31.655700 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.655673    2565 generic.go:356] "Generic (PLEG): container finished" podID="b411dba4-f74f-4819-819a-90e50a4ddaa5" containerID="c9c261df9f0e2a707666f0dffa4ee34abd2b58b638ee0fb3e9a4983cc936fff4" exitCode=0
Aug 04 18:28:31.656194 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.655747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerDied","Data":"c9c261df9f0e2a707666f0dffa4ee34abd2b58b638ee0fb3e9a4983cc936fff4"}
Aug 04 18:28:31.657499 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.657213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5fdp" event={"ID":"eb2243ff-fa74-46ad-970e-87af0461c9f0","Type":"ContainerStarted","Data":"8df78b07e5305a55e53188ba1da1b2942bda4bd634cbfc08bea417f9fd0ce610"}
Aug 04 18:28:31.658815 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.658797    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb" event={"ID":"11d53110-886d-4481-a506-17a46b5de32c","Type":"ContainerStarted","Data":"8f23f588758395f5e4efcf05ff7ed9dd34010541f31c3e7583ae7652f2c259e4"}
Aug 04 18:28:31.660324 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.660293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xhbv8" event={"ID":"8c616a19-ab9e-4dc7-8e12-da5e77bbfde6","Type":"ContainerStarted","Data":"62ebc636f4f22ef21df3876aefc925bc4bf1eef534cb1a006bd58e9f978c87be"}
Aug 04 18:28:31.663582 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.663560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"b0f2c3ed0a602c2cc0e59ff0c49e8f331ce6a2368757040b857239ad1e228c1b"}
Aug 04 18:28:31.663679 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.663628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"8fe8566c15bc5172fe3562167adbc985e7535c2303f51d3324ef1d53dedc8217"}
Aug 04 18:28:31.663726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.663684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"4a190e3435a2f06cd4f371b4367e4319f17ca5d3cf623158dd211c2bc4f2ad16"}
Aug 04 18:28:31.663764 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.663727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"7fc6f0f9cadb187fc0b26c93d4468bfdf38dce892d6e52fb98b4da8f75184bd5"}
Aug 04 18:28:31.665066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.665046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v54tj" event={"ID":"b3a50a40-9b27-4214-bb8a-8868393b5945","Type":"ContainerStarted","Data":"fca06a973fd31c211de25c328063abe0d194d807a556ea2e975f12e5dee66733"}
Aug 04 18:28:31.671317 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.671288    2565 generic.go:356] "Generic (PLEG): container finished" podID="01753f04e1d7f592531bb95e3750c1c0" containerID="eabd488a7c0abd3245436af9cebd845e81e0fefd6e8d50e83705e759989bb4c4" exitCode=0
Aug 04 18:28:31.671414 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.671390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal" event={"ID":"01753f04e1d7f592531bb95e3750c1c0","Type":"ContainerDied","Data":"eabd488a7c0abd3245436af9cebd845e81e0fefd6e8d50e83705e759989bb4c4"}
Aug 04 18:28:31.673200 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.673153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q7qlw" event={"ID":"50554e1a-b518-4975-ad4f-b4c49ce303c5","Type":"ContainerStarted","Data":"d0f6797fd35d50f35dd7b1554cc823de403adf082e53c7807ba460e94ba24ccb"}
Aug 04 18:28:31.694574 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.694534    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c5fdp" podStartSLOduration=4.099635063 podStartE2EDuration="22.694518657s" totalImagesPullingTime="18.594883594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:31.694107735 +0000 UTC m=+22.661998283" watchObservedRunningTime="2026-08-04 18:28:31.694518657 +0000 UTC m=+22.662409202"
Aug 04 18:28:31.708846 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.708804    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q7qlw" podStartSLOduration=4.160685136 podStartE2EDuration="22.708787599s" totalImagesPullingTime="18.548102463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:31.708733523 +0000 UTC m=+22.676624060" watchObservedRunningTime="2026-08-04 18:28:31.708787599 +0000 UTC m=+22.676678137"
Aug 04 18:28:31.723028 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.722985    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xhbv8" podStartSLOduration=12.17997998 podStartE2EDuration="22.722966684s" totalImagesPullingTime="10.542986704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:31.72276305 +0000 UTC m=+22.690653599" watchObservedRunningTime="2026-08-04 18:28:31.722966684 +0000 UTC m=+22.690857231"
Aug 04 18:28:31.752993 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:31.752929    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v54tj" podStartSLOduration=4.35251228 podStartE2EDuration="22.752912597s" totalImagesPullingTime="18.400400317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:31.752740899 +0000 UTC m=+22.720631441" watchObservedRunningTime="2026-08-04 18:28:31.752912597 +0000 UTC m=+22.720803144"
Aug 04 18:28:32.256049 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:32.256024    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 18:28:32.472168 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:32.472005    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T18:28:32.256041291Z","UUID":"dd184558-e41d-4ba6-916d-611c8034910c","Handler":null,"Name":"","Endpoint":""}
Aug 04 18:28:32.475107 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:32.475073    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 18:28:32.475235 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:32.475119    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 18:28:32.677682 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:32.677642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb" event={"ID":"11d53110-886d-4481-a506-17a46b5de32c","Type":"ContainerStarted","Data":"8b8c870269054c823f2811982fc9829a49f0d8a889be64484f719e8129fa8c59"}
Aug 04 18:28:32.679980 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:32.679926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal" event={"ID":"01753f04e1d7f592531bb95e3750c1c0","Type":"ContainerStarted","Data":"aaa115d84d59f05aa76b9bcb782f81dca2ae2221240e42d819dec810648af211"}
Aug 04 18:28:32.696432 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:32.696385    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal" podStartSLOduration=22.696369366 podStartE2EDuration="22.696369366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:32.696226681 +0000 UTC m=+23.664117245" watchObservedRunningTime="2026-08-04 18:28:32.696369366 +0000 UTC m=+23.664259911"
Aug 04 18:28:33.563987 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:33.563957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:33.563987 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:33.563974    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:33.564160 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:33.564000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:33.564160 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:33.564074    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:33.564160 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:33.564119    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:33.564287 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:33.564207    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:33.685114 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:33.685042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb" event={"ID":"11d53110-886d-4481-a506-17a46b5de32c","Type":"ContainerStarted","Data":"05626e84531bd7e06155fe4142acfa4c1e56e108486cc32b8ce5e32bde5f9a3d"}
Aug 04 18:28:33.688200 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:33.688175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:33.688766 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:33.688736    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:33.689086 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:33.689063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"5c424bbe54bcd4af6bdf12ebcc9c6194d36f3184f994a17d351da9b07f03cd83"}
Aug 04 18:28:33.702915 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:33.702867    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ngrb" podStartSLOduration=3.506328329 podStartE2EDuration="24.702849461s" totalImagesPullingTime="21.196521132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:33.702540534 +0000 UTC m=+24.670431083" watchObservedRunningTime="2026-08-04 18:28:33.702849461 +0000 UTC m=+24.670740010"
Aug 04 18:28:34.690726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:34.690693    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 18:28:35.564218 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:35.564186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:35.564218 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:35.564211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:35.564456 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:35.564198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:35.564456 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:35.564354    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:35.564456 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:35.564428    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:35.564617 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:35.564520    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:36.697370 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:36.697152    2565 generic.go:356] "Generic (PLEG): container finished" podID="b411dba4-f74f-4819-819a-90e50a4ddaa5" containerID="f24e85d6819d73f7e97e93824129880282a21ff85ef80a6b8d80ca5d748cf35d" exitCode=0
Aug 04 18:28:36.697370 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:36.697213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerDied","Data":"f24e85d6819d73f7e97e93824129880282a21ff85ef80a6b8d80ca5d748cf35d"}
Aug 04 18:28:36.701438 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:36.701417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" event={"ID":"c98dfa59-a5af-4f60-a2f3-7d8b584cc71a","Type":"ContainerStarted","Data":"a4cbd31d1631e47a87d9ec647d0670b785317f6a54b4b5247dde7752abf7aeb8"}
Aug 04 18:28:36.701700 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:36.701681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:36.702332 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:36.702307    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:36.720544 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:36.720523    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:36.720661 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:36.720638    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:36.763139 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:36.763090    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5" podStartSLOduration=9.111688101 podStartE2EDuration="27.763074502s" totalImagesPullingTime="18.651386401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:36.761307512 +0000 UTC m=+27.729198058" watchObservedRunningTime="2026-08-04 18:28:36.763074502 +0000 UTC m=+27.730965047"
Aug 04 18:28:37.564030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:37.563951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:37.564193 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:37.563951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:37.564193 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:37.564075    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:37.564193 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:37.564184    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:37.564338 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:37.563951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:37.564338 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:37.564301    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:37.651171 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:37.651121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:28:37.707106 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:37.706964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerStarted","Data":"c3c2b0591273f72ea0bcffceef5a5118d8ecfc25ea06fb4d94e901d7ee4d950e"}
Aug 04 18:28:38.175040 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:38.174814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gz4tk"]
Aug 04 18:28:38.175248 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:38.175191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:38.175345 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:38.175311    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:38.175485 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:38.175456    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xsqt4"]
Aug 04 18:28:38.175614 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:38.175561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:38.175685 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:38.175662    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:38.176036 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:38.176012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m27lg"]
Aug 04 18:28:38.176121 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:38.176091    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:38.176176 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:38.176160    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:38.712080 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:38.712049    2565 generic.go:356] "Generic (PLEG): container finished" podID="b411dba4-f74f-4819-819a-90e50a4ddaa5" containerID="c3c2b0591273f72ea0bcffceef5a5118d8ecfc25ea06fb4d94e901d7ee4d950e" exitCode=0
Aug 04 18:28:38.712461 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:38.712122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerDied","Data":"c3c2b0591273f72ea0bcffceef5a5118d8ecfc25ea06fb4d94e901d7ee4d950e"}
Aug 04 18:28:39.566933 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:39.566741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:39.566933 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:39.566879    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:39.567119 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:39.567067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:39.567211 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:39.567161    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:40.564950 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:40.564923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:40.565280 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:40.565013    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:40.723207 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:40.723172    2565 generic.go:356] "Generic (PLEG): container finished" podID="b411dba4-f74f-4819-819a-90e50a4ddaa5" containerID="f769223a95c0038fcf383734d5b3b6ff620f8f465fa933b276b83ce7c5452a18" exitCode=0
Aug 04 18:28:40.723335 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:40.723247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerDied","Data":"f769223a95c0038fcf383734d5b3b6ff620f8f465fa933b276b83ce7c5452a18"}
Aug 04 18:28:41.059629 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:41.059598    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:41.059764 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:41.059716    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 18:28:41.060152 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:41.060136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xhbv8"
Aug 04 18:28:41.564423 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:41.564389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:41.564598 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:41.564531    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:41.564598 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:41.564552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:41.564746 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:41.564646    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:42.563965 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:42.563934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:42.564405 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:42.564037    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m27lg" podUID="7635de3b-ce81-42c0-afca-e0b89c0bb2ee"
Aug 04 18:28:43.157144 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:43.157106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:43.157346 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.157227    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:43.157346 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.157294    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret podName:19b4a443-3471-4aea-8e62-dd47eaf3dbbd nodeName:}" failed. No retries permitted until 2026-08-04 18:29:15.15727506 +0000 UTC m=+66.125165598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret") pod "global-pull-secret-syncer-xsqt4" (UID: "19b4a443-3471-4aea-8e62-dd47eaf3dbbd") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:43.257584 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:43.257552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:43.257756 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:43.257617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:43.257756 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.257729    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:43.257866 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.257737    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:43.257866 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.257816    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs podName:7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:15.257795106 +0000 UTC m=+66.225685647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs") pod "network-metrics-daemon-gz4tk" (UID: "7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:43.257866 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.257817    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:43.257866 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.257838    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nd2q5 for pod openshift-network-diagnostics/network-check-target-m27lg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:43.258020 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.257882    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5 podName:7635de3b-ce81-42c0-afca-e0b89c0bb2ee nodeName:}" failed. No retries permitted until 2026-08-04 18:29:15.257869696 +0000 UTC m=+66.225760221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nd2q5" (UniqueName: "kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5") pod "network-check-target-m27lg" (UID: "7635de3b-ce81-42c0-afca-e0b89c0bb2ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:43.564763 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:43.564709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:43.565369 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.564850    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gz4tk" podUID="7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4"
Aug 04 18:28:43.565369 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:43.564889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:43.565369 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:43.564961    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xsqt4" podUID="19b4a443-3471-4aea-8e62-dd47eaf3dbbd"
Aug 04 18:28:44.331050 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.330839    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeReady"
Aug 04 18:28:44.331237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.331176    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 18:28:44.382353 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.382324    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g5jmk"]
Aug 04 18:28:44.411065 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.411039    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-49w9b"]
Aug 04 18:28:44.411216 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.411176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.415373 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.415211    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8fxw\""
Aug 04 18:28:44.415373 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.415247    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 18:28:44.415373 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.415208    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 18:28:44.425223 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.425202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g5jmk"]
Aug 04 18:28:44.425332 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.425239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-49w9b"]
Aug 04 18:28:44.425332 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.425291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-49w9b"
Aug 04 18:28:44.428709 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.428026    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 18:28:44.428709 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.428139    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ss77g\""
Aug 04 18:28:44.428709 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.428335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 18:28:44.428709 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.428379    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 18:28:44.564269 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.564240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:28:44.566054 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.566028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de66c1b7-4b86-4d92-b4a6-a64878863e31-config-volume\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.566423 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.566072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/585d547e-15a5-4e00-8f37-985cdcc6781b-cert\") pod \"ingress-canary-49w9b\" (UID: \"585d547e-15a5-4e00-8f37-985cdcc6781b\") " pod="openshift-ingress-canary/ingress-canary-49w9b"
Aug 04 18:28:44.566423 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.566239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.566423 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.566336    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de66c1b7-4b86-4d92-b4a6-a64878863e31-tmp-dir\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.566423 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.566389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk4fd\" (UniqueName: \"kubernetes.io/projected/de66c1b7-4b86-4d92-b4a6-a64878863e31-kube-api-access-kk4fd\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.566423 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.566415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58jzz\" (UniqueName: \"kubernetes.io/projected/585d547e-15a5-4e00-8f37-985cdcc6781b-kube-api-access-58jzz\") pod \"ingress-canary-49w9b\" (UID: \"585d547e-15a5-4e00-8f37-985cdcc6781b\") " pod="openshift-ingress-canary/ingress-canary-49w9b"
Aug 04 18:28:44.567401 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.567329    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bpqnp\""
Aug 04 18:28:44.567596 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.567578    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 18:28:44.589566 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.589495    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 18:28:44.666963 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.666922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de66c1b7-4b86-4d92-b4a6-a64878863e31-tmp-dir\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.667144 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.666981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk4fd\" (UniqueName: \"kubernetes.io/projected/de66c1b7-4b86-4d92-b4a6-a64878863e31-kube-api-access-kk4fd\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.667144 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.667005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58jzz\" (UniqueName: \"kubernetes.io/projected/585d547e-15a5-4e00-8f37-985cdcc6781b-kube-api-access-58jzz\") pod \"ingress-canary-49w9b\" (UID: \"585d547e-15a5-4e00-8f37-985cdcc6781b\") " pod="openshift-ingress-canary/ingress-canary-49w9b"
Aug 04 18:28:44.667144 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.667039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de66c1b7-4b86-4d92-b4a6-a64878863e31-config-volume\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.667144 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.667055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/585d547e-15a5-4e00-8f37-985cdcc6781b-cert\") pod \"ingress-canary-49w9b\" (UID: \"585d547e-15a5-4e00-8f37-985cdcc6781b\") " pod="openshift-ingress-canary/ingress-canary-49w9b"
Aug 04 18:28:44.667144 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.667072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.667394 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:44.667190    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:44.667394 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:44.667248    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls podName:de66c1b7-4b86-4d92-b4a6-a64878863e31 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:45.167229485 +0000 UTC m=+36.135120033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls") pod "dns-default-g5jmk" (UID: "de66c1b7-4b86-4d92-b4a6-a64878863e31") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:44.667613 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.667592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de66c1b7-4b86-4d92-b4a6-a64878863e31-tmp-dir\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.667917 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.667894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de66c1b7-4b86-4d92-b4a6-a64878863e31-config-volume\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.671602 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.671572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/585d547e-15a5-4e00-8f37-985cdcc6781b-cert\") pod \"ingress-canary-49w9b\" (UID: \"585d547e-15a5-4e00-8f37-985cdcc6781b\") " pod="openshift-ingress-canary/ingress-canary-49w9b"
Aug 04 18:28:44.676607 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.676581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk4fd\" (UniqueName: \"kubernetes.io/projected/de66c1b7-4b86-4d92-b4a6-a64878863e31-kube-api-access-kk4fd\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:44.676854 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.676829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58jzz\" (UniqueName: \"kubernetes.io/projected/585d547e-15a5-4e00-8f37-985cdcc6781b-kube-api-access-58jzz\") pod \"ingress-canary-49w9b\" (UID: \"585d547e-15a5-4e00-8f37-985cdcc6781b\") " pod="openshift-ingress-canary/ingress-canary-49w9b"
Aug 04 18:28:44.734621 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:44.734590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-49w9b"
Aug 04 18:28:45.172181 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.172150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:45.172308 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:45.172278    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:45.172365 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:45.172355    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls podName:de66c1b7-4b86-4d92-b4a6-a64878863e31 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:46.172340013 +0000 UTC m=+37.140230538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls") pod "dns-default-g5jmk" (UID: "de66c1b7-4b86-4d92-b4a6-a64878863e31") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:45.211268 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.211240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-49w9b"]
Aug 04 18:28:45.286432 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:28:45.286404    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585d547e_15a5_4e00_8f37_985cdcc6781b.slice/crio-f39aca8cde33f6cddadfb5d66c2205eaf3e28967b3995d7d58602dcb384d79d1 WatchSource:0}: Error finding container f39aca8cde33f6cddadfb5d66c2205eaf3e28967b3995d7d58602dcb384d79d1: Status 404 returned error can't find the container with id f39aca8cde33f6cddadfb5d66c2205eaf3e28967b3995d7d58602dcb384d79d1
Aug 04 18:28:45.564825 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.564582    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:28:45.564951 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.564628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:28:45.567643 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.567618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 18:28:45.567643 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.567636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 18:28:45.568274 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.567636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zw2lq\""
Aug 04 18:28:45.738790 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.738757    2565 generic.go:356] "Generic (PLEG): container finished" podID="b411dba4-f74f-4819-819a-90e50a4ddaa5" containerID="442006c8c03c653984c613c041533748fa70fddf463cbc5becdd07a40f023440" exitCode=0
Aug 04 18:28:45.738920 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.738860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerDied","Data":"442006c8c03c653984c613c041533748fa70fddf463cbc5becdd07a40f023440"}
Aug 04 18:28:45.740014 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:45.739991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-49w9b" event={"ID":"585d547e-15a5-4e00-8f37-985cdcc6781b","Type":"ContainerStarted","Data":"f39aca8cde33f6cddadfb5d66c2205eaf3e28967b3995d7d58602dcb384d79d1"}
Aug 04 18:28:46.178664 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:46.178555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:46.178821 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:46.178740    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:46.178882 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:46.178833    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls podName:de66c1b7-4b86-4d92-b4a6-a64878863e31 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:48.178811837 +0000 UTC m=+39.146702364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls") pod "dns-default-g5jmk" (UID: "de66c1b7-4b86-4d92-b4a6-a64878863e31") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:46.745322 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:46.745290    2565 generic.go:356] "Generic (PLEG): container finished" podID="b411dba4-f74f-4819-819a-90e50a4ddaa5" containerID="809a25c2c8a9ffc8d2623a4068077083195e0bb763b66a0f4fe93c9e1a2a9df5" exitCode=0
Aug 04 18:28:46.745685 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:46.745354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerDied","Data":"809a25c2c8a9ffc8d2623a4068077083195e0bb763b66a0f4fe93c9e1a2a9df5"}
Aug 04 18:28:47.750440 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:47.750411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" event={"ID":"b411dba4-f74f-4819-819a-90e50a4ddaa5","Type":"ContainerStarted","Data":"87bdca9232337b1f6c80042fa6faca259a22ac6190f700256f79f55d6a2322d5"}
Aug 04 18:28:47.796185 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:47.796142    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xjgr2" podStartSLOduration=9.18968744 podStartE2EDuration="38.796127066s" totalImagesPullingTime="29.606439626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:47.795438284 +0000 UTC m=+38.763328829" watchObservedRunningTime="2026-08-04 18:28:47.796127066 +0000 UTC m=+38.764017612"
Aug 04 18:28:48.195189 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:48.195164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:48.195337 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:48.195319    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:48.195404 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:48.195391    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls podName:de66c1b7-4b86-4d92-b4a6-a64878863e31 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:52.195371763 +0000 UTC m=+43.163262307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls") pod "dns-default-g5jmk" (UID: "de66c1b7-4b86-4d92-b4a6-a64878863e31") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:48.753876 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:48.753838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-49w9b" event={"ID":"585d547e-15a5-4e00-8f37-985cdcc6781b","Type":"ContainerStarted","Data":"55a757c1f6121f9e11816e30e38ce00afa6b0ef8d9aeb878f2d49ec2280ba809"}
Aug 04 18:28:48.770836 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:48.770770    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-49w9b" podStartSLOduration=1.951198068 podStartE2EDuration="4.770755485s" totalImagesPullingTime="2.819557417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:48.769731115 +0000 UTC m=+39.737621658" watchObservedRunningTime="2026-08-04 18:28:48.770755485 +0000 UTC m=+39.738646032"
Aug 04 18:28:52.225739 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:28:52.225697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:28:52.226120 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:52.225836    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:52.226120 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:28:52.225891    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls podName:de66c1b7-4b86-4d92-b4a6-a64878863e31 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:00.225875893 +0000 UTC m=+51.193766418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls") pod "dns-default-g5jmk" (UID: "de66c1b7-4b86-4d92-b4a6-a64878863e31") : secret "dns-default-metrics-tls" not found
Aug 04 18:29:00.278752 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:00.278714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:29:00.279217 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:00.278867    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:29:00.279217 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:00.278932    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls podName:de66c1b7-4b86-4d92-b4a6-a64878863e31 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:16.278913287 +0000 UTC m=+67.246803816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls") pod "dns-default-g5jmk" (UID: "de66c1b7-4b86-4d92-b4a6-a64878863e31") : secret "dns-default-metrics-tls" not found
Aug 04 18:29:08.722812 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:08.722765    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9p5"
Aug 04 18:29:10.272714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.272679    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"]
Aug 04 18:29:10.275933 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.275914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:10.278441 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.278416    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fsqtm\""
Aug 04 18:29:10.278565 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.278439    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Aug 04 18:29:10.278715 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.278699    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:29:10.279698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.279679    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Aug 04 18:29:10.289009 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.288989    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"]
Aug 04 18:29:10.383274 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.383238    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-wwhmp"]
Aug 04 18:29:10.385022 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.385006    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c9767d44f-8dq7j"]
Aug 04 18:29:10.385214 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.385115    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.386974 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.386955    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"]
Aug 04 18:29:10.387061 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.387049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.388714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.388696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.391289 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.391267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 04 18:29:10.391663 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.391640    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t5t8s\""
Aug 04 18:29:10.391897 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.391880    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 18:29:10.392307 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.392292    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 04 18:29:10.392552 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.392536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 04 18:29:10.392882 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.392857    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 04 18:29:10.392882 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.392877    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:29:10.393042 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.392924    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 18:29:10.393087 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.393076    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 04 18:29:10.393616 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.393598    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 18:29:10.394168 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.394146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-87ls6\""
Aug 04 18:29:10.394257 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.394197    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 18:29:10.394409 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.394396    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 18:29:10.395596 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.395583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qzsp5\""
Aug 04 18:29:10.402864 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.402800    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-wwhmp"]
Aug 04 18:29:10.403502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.403480    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 18:29:10.408593 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.408571    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 04 18:29:10.416684 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.416664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c9767d44f-8dq7j"]
Aug 04 18:29:10.420790 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.417304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"]
Aug 04 18:29:10.447262 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.447231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrl7h\" (UniqueName: \"kubernetes.io/projected/a2b26397-82fe-4436-8d2a-08bb767ea9b1-kube-api-access-wrl7h\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:10.447393 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.447311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:10.477512 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.477486    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-8zwng"]
Aug 04 18:29:10.479391 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.479378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.481984 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.481966    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 04 18:29:10.482290 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.482279    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 04 18:29:10.482839 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.482818    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:29:10.482942 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.482922    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t6tfv\""
Aug 04 18:29:10.483180 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.483159    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 04 18:29:10.487567 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.487550    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 04 18:29:10.493990 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.493972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-8zwng"]
Aug 04 18:29:10.547908 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.547851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.547908 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.547887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:10.547908 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.547906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b893bc-1de6-40ec-a965-a26aece839eb-tmp\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.548070 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.547922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b893bc-1de6-40ec-a965-a26aece839eb-service-ca-bundle\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.548070 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.547959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrl7h\" (UniqueName: \"kubernetes.io/projected/a2b26397-82fe-4436-8d2a-08bb767ea9b1-kube-api-access-wrl7h\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:10.548070 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.547975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53db9174-a310-48c0-bd74-7dc71e129aa4-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.548070 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mpj2\" (UniqueName: \"kubernetes.io/projected/53db9174-a310-48c0-bd74-7dc71e129aa4-kube-api-access-4mpj2\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.548070 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-trusted-ca\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.548282 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:10.548093    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 18:29:10.548282 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53db9174-a310-48c0-bd74-7dc71e129aa4-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.548282 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-image-registry-private-configuration\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.548282 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:10.548149    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls podName:a2b26397-82fe-4436-8d2a-08bb767ea9b1 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:11.04813607 +0000 UTC m=+62.016026595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tjdnp" (UID: "a2b26397-82fe-4436-8d2a-08bb767ea9b1") : secret "samples-operator-tls" not found
Aug 04 18:29:10.548282 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqt9\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-kube-api-access-jvqt9\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.548282 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b893bc-1de6-40ec-a965-a26aece839eb-trusted-ca-bundle\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.548526 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm7dd\" (UniqueName: \"kubernetes.io/projected/a6b893bc-1de6-40ec-a965-a26aece839eb-kube-api-access-vm7dd\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.548526 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6b893bc-1de6-40ec-a965-a26aece839eb-snapshots\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.548526 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19d4316b-d7f5-4d81-b77a-e00c1ebea357-ca-trust-extracted\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.548526 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-certificates\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.548526 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-installation-pull-secrets\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.548526 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b893bc-1de6-40ec-a965-a26aece839eb-serving-cert\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.548526 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.548513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-bound-sa-token\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.560000 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.559983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrl7h\" (UniqueName: \"kubernetes.io/projected/a2b26397-82fe-4436-8d2a-08bb767ea9b1-kube-api-access-wrl7h\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:10.649546 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-image-registry-private-configuration\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.649672 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqt9\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-kube-api-access-jvqt9\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.649672 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b893bc-1de6-40ec-a965-a26aece839eb-trusted-ca-bundle\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.649810 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19d4316b-d7f5-4d81-b77a-e00c1ebea357-ca-trust-extracted\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.649810 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6b893bc-1de6-40ec-a965-a26aece839eb-snapshots\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.649810 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-installation-pull-secrets\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.649963 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p72wl\" (UniqueName: \"kubernetes.io/projected/4b549cc5-d752-4434-8943-c18c9b334388-kube-api-access-p72wl\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.649963 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b893bc-1de6-40ec-a965-a26aece839eb-serving-cert\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.649963 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.649918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b549cc5-d752-4434-8943-c18c9b334388-config\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.650109 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mpj2\" (UniqueName: \"kubernetes.io/projected/53db9174-a310-48c0-bd74-7dc71e129aa4-kube-api-access-4mpj2\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.650109 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-trusted-ca\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.650221 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b549cc5-d752-4434-8943-c18c9b334388-trusted-ca\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.650221 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53db9174-a310-48c0-bd74-7dc71e129aa4-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.650221 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm7dd\" (UniqueName: \"kubernetes.io/projected/a6b893bc-1de6-40ec-a965-a26aece839eb-kube-api-access-vm7dd\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.650367 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-certificates\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.650367 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-bound-sa-token\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.650367 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b549cc5-d752-4434-8943-c18c9b334388-serving-cert\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.650367 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b893bc-1de6-40ec-a965-a26aece839eb-tmp\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.650572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.650572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6b893bc-1de6-40ec-a965-a26aece839eb-snapshots\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.650572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b893bc-1de6-40ec-a965-a26aece839eb-service-ca-bundle\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.650572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650441    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b893bc-1de6-40ec-a965-a26aece839eb-trusted-ca-bundle\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.650572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53db9174-a310-48c0-bd74-7dc71e129aa4-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.650847 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b893bc-1de6-40ec-a965-a26aece839eb-tmp\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.650991 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.650972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19d4316b-d7f5-4d81-b77a-e00c1ebea357-ca-trust-extracted\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.651095 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:10.651077    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 18:29:10.651152 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:10.651099    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9767d44f-8dq7j: secret "image-registry-tls" not found
Aug 04 18:29:10.651203 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:10.651156    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls podName:19d4316b-d7f5-4d81-b77a-e00c1ebea357 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:11.151140047 +0000 UTC m=+62.119030586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls") pod "image-registry-7c9767d44f-8dq7j" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357") : secret "image-registry-tls" not found
Aug 04 18:29:10.651269 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.651219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53db9174-a310-48c0-bd74-7dc71e129aa4-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.651593 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.651571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b893bc-1de6-40ec-a965-a26aece839eb-service-ca-bundle\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.651819 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.651793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-certificates\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.652170 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.652139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-trusted-ca\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.652319 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.652303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-image-registry-private-configuration\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.652378 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.652358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b893bc-1de6-40ec-a965-a26aece839eb-serving-cert\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.652534 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.652513    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-installation-pull-secrets\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.652808 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.652770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53db9174-a310-48c0-bd74-7dc71e129aa4-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.661907 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.661882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mpj2\" (UniqueName: \"kubernetes.io/projected/53db9174-a310-48c0-bd74-7dc71e129aa4-kube-api-access-4mpj2\") pod \"kube-storage-version-migrator-operator-7878f4b88c-c4zpf\" (UID: \"53db9174-a310-48c0-bd74-7dc71e129aa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.662001 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.661982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm7dd\" (UniqueName: \"kubernetes.io/projected/a6b893bc-1de6-40ec-a965-a26aece839eb-kube-api-access-vm7dd\") pod \"insights-operator-77696685b-wwhmp\" (UID: \"a6b893bc-1de6-40ec-a965-a26aece839eb\") " pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.662157 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.662140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqt9\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-kube-api-access-jvqt9\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.662199 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.662185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-bound-sa-token\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:10.695241 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.695221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-wwhmp"
Aug 04 18:29:10.708113 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.708095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"
Aug 04 18:29:10.751809 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.751699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b549cc5-d752-4434-8943-c18c9b334388-config\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.751809 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.751738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b549cc5-d752-4434-8943-c18c9b334388-trusted-ca\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.752093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b549cc5-d752-4434-8943-c18c9b334388-serving-cert\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.752192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p72wl\" (UniqueName: \"kubernetes.io/projected/4b549cc5-d752-4434-8943-c18c9b334388-kube-api-access-p72wl\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.752489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b549cc5-d752-4434-8943-c18c9b334388-config\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.753073 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.752905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b549cc5-d752-4434-8943-c18c9b334388-trusted-ca\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.756789 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.756598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b549cc5-d752-4434-8943-c18c9b334388-serving-cert\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.764370 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.764343    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p72wl\" (UniqueName: \"kubernetes.io/projected/4b549cc5-d752-4434-8943-c18c9b334388-kube-api-access-p72wl\") pod \"console-operator-5ccd6b445f-8zwng\" (UID: \"4b549cc5-d752-4434-8943-c18c9b334388\") " pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.788527 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.788498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:10.821901 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.821870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-wwhmp"]
Aug 04 18:29:10.825871 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:10.825838    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b893bc_1de6_40ec_a965_a26aece839eb.slice/crio-f0d8003c4a336c94d3ec68ffce89b642bbb5c90e1cc156beb4f929b616224abe WatchSource:0}: Error finding container f0d8003c4a336c94d3ec68ffce89b642bbb5c90e1cc156beb4f929b616224abe: Status 404 returned error can't find the container with id f0d8003c4a336c94d3ec68ffce89b642bbb5c90e1cc156beb4f929b616224abe
Aug 04 18:29:10.840378 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.840337    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf"]
Aug 04 18:29:10.844581 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:10.844551    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53db9174_a310_48c0_bd74_7dc71e129aa4.slice/crio-6ace27586f43dc712afdac1fe1770169f71fc391e62db14f0270bffffe0adb6c WatchSource:0}: Error finding container 6ace27586f43dc712afdac1fe1770169f71fc391e62db14f0270bffffe0adb6c: Status 404 returned error can't find the container with id 6ace27586f43dc712afdac1fe1770169f71fc391e62db14f0270bffffe0adb6c
Aug 04 18:29:10.911698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:10.911668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-8zwng"]
Aug 04 18:29:10.914275 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:10.914253    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b549cc5_d752_4434_8943_c18c9b334388.slice/crio-c6083a246f88b542332ebc489b04d165176967d6fcacb1017d67a97f8cc78f38 WatchSource:0}: Error finding container c6083a246f88b542332ebc489b04d165176967d6fcacb1017d67a97f8cc78f38: Status 404 returned error can't find the container with id c6083a246f88b542332ebc489b04d165176967d6fcacb1017d67a97f8cc78f38
Aug 04 18:29:11.053530 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:11.053448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:11.053645 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:11.053595    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 18:29:11.053693 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:11.053682    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls podName:a2b26397-82fe-4436-8d2a-08bb767ea9b1 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:12.053665512 +0000 UTC m=+63.021556039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tjdnp" (UID: "a2b26397-82fe-4436-8d2a-08bb767ea9b1") : secret "samples-operator-tls" not found
Aug 04 18:29:11.154007 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:11.153976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:11.154142 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:11.154114    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 18:29:11.154142 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:11.154131    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9767d44f-8dq7j: secret "image-registry-tls" not found
Aug 04 18:29:11.154218 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:11.154177    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls podName:19d4316b-d7f5-4d81-b77a-e00c1ebea357 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:12.154163275 +0000 UTC m=+63.122053799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls") pod "image-registry-7c9767d44f-8dq7j" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357") : secret "image-registry-tls" not found
Aug 04 18:29:11.807592 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:11.807506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng" event={"ID":"4b549cc5-d752-4434-8943-c18c9b334388","Type":"ContainerStarted","Data":"c6083a246f88b542332ebc489b04d165176967d6fcacb1017d67a97f8cc78f38"}
Aug 04 18:29:11.809245 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:11.809208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-wwhmp" event={"ID":"a6b893bc-1de6-40ec-a965-a26aece839eb","Type":"ContainerStarted","Data":"f0d8003c4a336c94d3ec68ffce89b642bbb5c90e1cc156beb4f929b616224abe"}
Aug 04 18:29:11.810572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:11.810548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf" event={"ID":"53db9174-a310-48c0-bd74-7dc71e129aa4","Type":"ContainerStarted","Data":"6ace27586f43dc712afdac1fe1770169f71fc391e62db14f0270bffffe0adb6c"}
Aug 04 18:29:12.064585 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:12.064494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:12.064755 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:12.064648    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 18:29:12.064755 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:12.064716    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls podName:a2b26397-82fe-4436-8d2a-08bb767ea9b1 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:14.06469556 +0000 UTC m=+65.032586091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tjdnp" (UID: "a2b26397-82fe-4436-8d2a-08bb767ea9b1") : secret "samples-operator-tls" not found
Aug 04 18:29:12.165673 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:12.165630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:12.165862 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:12.165815    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 18:29:12.165862 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:12.165832    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9767d44f-8dq7j: secret "image-registry-tls" not found
Aug 04 18:29:12.165989 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:12.165893    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls podName:19d4316b-d7f5-4d81-b77a-e00c1ebea357 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:14.165874855 +0000 UTC m=+65.133765382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls") pod "image-registry-7c9767d44f-8dq7j" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357") : secret "image-registry-tls" not found
Aug 04 18:29:14.081865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.081837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:14.082181 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:14.081994    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 18:29:14.082181 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:14.082058    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls podName:a2b26397-82fe-4436-8d2a-08bb767ea9b1 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:18.082043387 +0000 UTC m=+69.049933922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tjdnp" (UID: "a2b26397-82fe-4436-8d2a-08bb767ea9b1") : secret "samples-operator-tls" not found
Aug 04 18:29:14.182568 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.182489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:14.182696 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:14.182660    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 18:29:14.182696 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:14.182681    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9767d44f-8dq7j: secret "image-registry-tls" not found
Aug 04 18:29:14.182793 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:14.182743    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls podName:19d4316b-d7f5-4d81-b77a-e00c1ebea357 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:18.182724558 +0000 UTC m=+69.150615084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls") pod "image-registry-7c9767d44f-8dq7j" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357") : secret "image-registry-tls" not found
Aug 04 18:29:14.820358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.820333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/0.log"
Aug 04 18:29:14.820531 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.820372    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b549cc5-d752-4434-8943-c18c9b334388" containerID="c10ad8017f9e7f169139ec0138a38dde3cbf237034b73e8856404255ff04b578" exitCode=255
Aug 04 18:29:14.820531 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.820448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng" event={"ID":"4b549cc5-d752-4434-8943-c18c9b334388","Type":"ContainerDied","Data":"c10ad8017f9e7f169139ec0138a38dde3cbf237034b73e8856404255ff04b578"}
Aug 04 18:29:14.820707 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.820688    2565 scope.go:117] "RemoveContainer" containerID="c10ad8017f9e7f169139ec0138a38dde3cbf237034b73e8856404255ff04b578"
Aug 04 18:29:14.822086 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.822059    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-wwhmp" event={"ID":"a6b893bc-1de6-40ec-a965-a26aece839eb","Type":"ContainerStarted","Data":"94fe726a7c04ef1b331d41baab568aa60f4340a91dd67a4699fd8237ffa427df"}
Aug 04 18:29:14.823637 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.823607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf" event={"ID":"53db9174-a310-48c0-bd74-7dc71e129aa4","Type":"ContainerStarted","Data":"95572cda71c1568d6076497c54c58ad407efd94e279690e54ebb7a169dd8edba"}
Aug 04 18:29:14.852375 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.852254    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-wwhmp" podStartSLOduration=1.746931509 podStartE2EDuration="4.852237708s" totalImagesPullingTime="3.105306199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:14.851730931 +0000 UTC m=+65.819621476" watchObservedRunningTime="2026-08-04 18:29:14.852237708 +0000 UTC m=+65.820128255"
Aug 04 18:29:14.867072 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:14.867033    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf" podStartSLOduration=1.780484458 podStartE2EDuration="4.867018632s" totalImagesPullingTime="3.086534174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:14.86617814 +0000 UTC m=+65.834068708" watchObservedRunningTime="2026-08-04 18:29:14.867018632 +0000 UTC m=+65.834909177"
Aug 04 18:29:15.192572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.192494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:29:15.195412 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.195392    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 18:29:15.205830 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.205801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19b4a443-3471-4aea-8e62-dd47eaf3dbbd-original-pull-secret\") pod \"global-pull-secret-syncer-xsqt4\" (UID: \"19b4a443-3471-4aea-8e62-dd47eaf3dbbd\") " pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:29:15.275520 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.275481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xsqt4"
Aug 04 18:29:15.292945 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.292923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:29:15.293040 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.292989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:29:15.295814 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.295795    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 18:29:15.295916 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.295851    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 18:29:15.304148 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:15.304125    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 18:29:15.304233 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:15.304208    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs podName:7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4 nodeName:}" failed. No retries permitted until 2026-08-04 18:30:19.304185821 +0000 UTC m=+130.272076359 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs") pod "network-metrics-daemon-gz4tk" (UID: "7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4") : secret "metrics-daemon-secret" not found
Aug 04 18:29:15.306529 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.306512    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 18:29:15.317279 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.317255    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2q5\" (UniqueName: \"kubernetes.io/projected/7635de3b-ce81-42c0-afca-e0b89c0bb2ee-kube-api-access-nd2q5\") pod \"network-check-target-m27lg\" (UID: \"7635de3b-ce81-42c0-afca-e0b89c0bb2ee\") " pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:29:15.410712 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.410644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xsqt4"]
Aug 04 18:29:15.413949 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:15.413913    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b4a443_3471_4aea_8e62_dd47eaf3dbbd.slice/crio-b3e1be62c8143b98c3c5296f7b725b58de2c839bf1cd84f84e7d538cde04fc2d WatchSource:0}: Error finding container b3e1be62c8143b98c3c5296f7b725b58de2c839bf1cd84f84e7d538cde04fc2d: Status 404 returned error can't find the container with id b3e1be62c8143b98c3c5296f7b725b58de2c839bf1cd84f84e7d538cde04fc2d
Aug 04 18:29:15.477818 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.477734    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bpqnp\""
Aug 04 18:29:15.485807 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.485769    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:29:15.621677 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.621643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m27lg"]
Aug 04 18:29:15.624988 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:15.624961    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7635de3b_ce81_42c0_afca_e0b89c0bb2ee.slice/crio-0d0dbe567106636056d5aee50975a9717caf211a071f0d7dea16ce3bcaa0a748 WatchSource:0}: Error finding container 0d0dbe567106636056d5aee50975a9717caf211a071f0d7dea16ce3bcaa0a748: Status 404 returned error can't find the container with id 0d0dbe567106636056d5aee50975a9717caf211a071f0d7dea16ce3bcaa0a748
Aug 04 18:29:15.827745 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.827710    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xsqt4" event={"ID":"19b4a443-3471-4aea-8e62-dd47eaf3dbbd","Type":"ContainerStarted","Data":"b3e1be62c8143b98c3c5296f7b725b58de2c839bf1cd84f84e7d538cde04fc2d"}
Aug 04 18:29:15.829318 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.829297    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:29:15.829701 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.829685    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/0.log"
Aug 04 18:29:15.829805 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.829717    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b549cc5-d752-4434-8943-c18c9b334388" containerID="46dc4e118409d889cd9a25946e8010b2af70fad17256913efcaa3d9284cca83b" exitCode=255
Aug 04 18:29:15.829805 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.829747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng" event={"ID":"4b549cc5-d752-4434-8943-c18c9b334388","Type":"ContainerDied","Data":"46dc4e118409d889cd9a25946e8010b2af70fad17256913efcaa3d9284cca83b"}
Aug 04 18:29:15.829917 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.829817    2565 scope.go:117] "RemoveContainer" containerID="c10ad8017f9e7f169139ec0138a38dde3cbf237034b73e8856404255ff04b578"
Aug 04 18:29:15.830064 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.830032    2565 scope.go:117] "RemoveContainer" containerID="46dc4e118409d889cd9a25946e8010b2af70fad17256913efcaa3d9284cca83b"
Aug 04 18:29:15.830263 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:15.830234    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-8zwng_openshift-console-operator(4b549cc5-d752-4434-8943-c18c9b334388)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng" podUID="4b549cc5-d752-4434-8943-c18c9b334388"
Aug 04 18:29:15.831087 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.831055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m27lg" event={"ID":"7635de3b-ce81-42c0-afca-e0b89c0bb2ee","Type":"ContainerStarted","Data":"0d0dbe567106636056d5aee50975a9717caf211a071f0d7dea16ce3bcaa0a748"}
Aug 04 18:29:15.989831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.989796    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7wqnl"]
Aug 04 18:29:15.992972 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.992951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:15.995607 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.995588    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 18:29:15.995715 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.995588    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 18:29:15.996078 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:15.996065    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hcmth\""
Aug 04 18:29:16.009341 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.009320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7wqnl"]
Aug 04 18:29:16.100665 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.100589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e2e3352-35b1-4302-ae2a-03db9051b80c-crio-socket\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.100665 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.100638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e2e3352-35b1-4302-ae2a-03db9051b80c-data-volume\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.100891 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.100683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.100891 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.100793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.100992 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.100898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcl9j\" (UniqueName: \"kubernetes.io/projected/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-api-access-jcl9j\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.201763 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.201724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e2e3352-35b1-4302-ae2a-03db9051b80c-data-volume\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.201763 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.201823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.201861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.201956    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.201997    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.202046    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:16.702021214 +0000 UTC m=+67.669911779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.202100    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:16.702080116 +0000 UTC m=+67.669970646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.202112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e2e3352-35b1-4302-ae2a-03db9051b80c-data-volume\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.202176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcl9j\" (UniqueName: \"kubernetes.io/projected/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-api-access-jcl9j\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.202239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e2e3352-35b1-4302-ae2a-03db9051b80c-crio-socket\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.202341 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.202329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e2e3352-35b1-4302-ae2a-03db9051b80c-crio-socket\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.214313 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.214290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcl9j\" (UniqueName: \"kubernetes.io/projected/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-api-access-jcl9j\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.302700 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.302661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:29:16.302904 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.302851    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:29:16.302991 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.302953    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls podName:de66c1b7-4b86-4d92-b4a6-a64878863e31 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:48.302931406 +0000 UTC m=+99.270821945 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls") pod "dns-default-g5jmk" (UID: "de66c1b7-4b86-4d92-b4a6-a64878863e31") : secret "dns-default-metrics-tls" not found
Aug 04 18:29:16.705585 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.705548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.705766 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.705691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:16.705854 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.705797    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:16.705903 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.705871    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:17.70585151 +0000 UTC m=+68.673742040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:16.706296 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.706273    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:16.706388 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.706332    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:17.706316761 +0000 UTC m=+68.674207286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:16.836266 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.836231    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:29:16.836694 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:16.836671    2565 scope.go:117] "RemoveContainer" containerID="46dc4e118409d889cd9a25946e8010b2af70fad17256913efcaa3d9284cca83b"
Aug 04 18:29:16.837026 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:16.836878    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-8zwng_openshift-console-operator(4b549cc5-d752-4434-8943-c18c9b334388)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng" podUID="4b549cc5-d752-4434-8943-c18c9b334388"
Aug 04 18:29:17.714392 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:17.714345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:17.714878 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:17.714404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:17.714878 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:17.714481    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:17.714878 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:17.714575    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:19.714553374 +0000 UTC m=+70.682443903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:17.714878 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:17.714584    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:17.714878 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:17.714640    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:19.714623127 +0000 UTC m=+70.682513657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:18.117262 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:18.117230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:18.117471 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:18.117419    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 18:29:18.117561 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:18.117497    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls podName:a2b26397-82fe-4436-8d2a-08bb767ea9b1 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:26.117478969 +0000 UTC m=+77.085369493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tjdnp" (UID: "a2b26397-82fe-4436-8d2a-08bb767ea9b1") : secret "samples-operator-tls" not found
Aug 04 18:29:18.218722 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:18.218686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:18.218907 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:18.218865    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 18:29:18.218907 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:18.218888    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9767d44f-8dq7j: secret "image-registry-tls" not found
Aug 04 18:29:18.219016 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:18.218959    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls podName:19d4316b-d7f5-4d81-b77a-e00c1ebea357 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:26.218938161 +0000 UTC m=+77.186828684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls") pod "image-registry-7c9767d44f-8dq7j" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357") : secret "image-registry-tls" not found
Aug 04 18:29:18.752145 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:18.752108    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5fdp_eb2243ff-fa74-46ad-970e-87af0461c9f0/dns-node-resolver/0.log"
Aug 04 18:29:19.733193 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:19.733154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:19.733409 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:19.733216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:19.733409 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:19.733303    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:19.733409 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:19.733345    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:19.733409 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:19.733393    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:23.733364559 +0000 UTC m=+74.701255088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:19.733612 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:19.733437    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:23.733420198 +0000 UTC m=+74.701310725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:19.946744 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:19.946713    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v54tj_b3a50a40-9b27-4214-bb8a-8868393b5945/node-ca/0.log"
Aug 04 18:29:20.353338 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.353308    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-49w9b_585d547e-15a5-4e00-8f37-985cdcc6781b/serve-healthcheck-canary/0.log"
Aug 04 18:29:20.789596 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.789571    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:20.789707 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.789629    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:20.790045 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.789966    2565 scope.go:117] "RemoveContainer" containerID="46dc4e118409d889cd9a25946e8010b2af70fad17256913efcaa3d9284cca83b"
Aug 04 18:29:20.790173 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:20.790133    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-8zwng_openshift-console-operator(4b549cc5-d752-4434-8943-c18c9b334388)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng" podUID="4b549cc5-d752-4434-8943-c18c9b334388"
Aug 04 18:29:20.847793 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.847752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m27lg" event={"ID":"7635de3b-ce81-42c0-afca-e0b89c0bb2ee","Type":"ContainerStarted","Data":"6560d255ddbec246e31cf16d315b811070060448c583423e0e3e4bb8319f6546"}
Aug 04 18:29:20.847957 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.847922    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:29:20.849237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.849212    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xsqt4" event={"ID":"19b4a443-3471-4aea-8e62-dd47eaf3dbbd","Type":"ContainerStarted","Data":"a5517f77c38b46398b2a728368d6037f3ebaae138945ec9ab8a339fa8278110a"}
Aug 04 18:29:20.867218 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.867142    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m27lg" podStartSLOduration=66.856331168 podStartE2EDuration="1m11.867124121s" totalImagesPullingTime="5.010792953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:20.865683185 +0000 UTC m=+71.833573731" watchObservedRunningTime="2026-08-04 18:29:20.867124121 +0000 UTC m=+71.835014663"
Aug 04 18:29:20.885154 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:20.885075    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xsqt4" podStartSLOduration=66.652936815 podStartE2EDuration="1m11.885059142s" totalImagesPullingTime="5.232122327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:20.884670048 +0000 UTC m=+71.852560594" watchObservedRunningTime="2026-08-04 18:29:20.885059142 +0000 UTC m=+71.852949688"
Aug 04 18:29:21.346614 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:21.346585    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-c4zpf_53db9174-a310-48c0-bd74-7dc71e129aa4/kube-storage-version-migrator-operator/0.log"
Aug 04 18:29:23.763790 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:23.763743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:23.763790 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:23.763791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:23.764219 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:23.763858    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:23.764219 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:23.763877    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:23.764219 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:23.763930    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:31.763910249 +0000 UTC m=+82.731800792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:23.764219 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:23.763949    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls podName:7e2e3352-35b1-4302-ae2a-03db9051b80c nodeName:}" failed. No retries permitted until 2026-08-04 18:29:31.76394104 +0000 UTC m=+82.731831569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wqnl" (UID: "7e2e3352-35b1-4302-ae2a-03db9051b80c") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:26.180452 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.180417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:26.182717 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.182695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2b26397-82fe-4436-8d2a-08bb767ea9b1-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tjdnp\" (UID: \"a2b26397-82fe-4436-8d2a-08bb767ea9b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:26.184572 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.184550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"
Aug 04 18:29:26.281240 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.281208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:26.283580 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.283546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"image-registry-7c9767d44f-8dq7j\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") " pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:26.301406 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.301371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:26.321295 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.321265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp"]
Aug 04 18:29:26.430088 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.430060    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c9767d44f-8dq7j"]
Aug 04 18:29:26.432632 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:26.432609    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d4316b_d7f5_4d81_b77a_e00c1ebea357.slice/crio-236bc6f03c9e682147b3da727dea413c4392a441c252296bffdee7b60fb541c2 WatchSource:0}: Error finding container 236bc6f03c9e682147b3da727dea413c4392a441c252296bffdee7b60fb541c2: Status 404 returned error can't find the container with id 236bc6f03c9e682147b3da727dea413c4392a441c252296bffdee7b60fb541c2
Aug 04 18:29:26.867271 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.867231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp" event={"ID":"a2b26397-82fe-4436-8d2a-08bb767ea9b1","Type":"ContainerStarted","Data":"b3c7186d650e7d5d56d00617b2e7e12287732d1f39f5ed9f6084742d63ccc1ed"}
Aug 04 18:29:26.868567 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.868546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j" event={"ID":"19d4316b-d7f5-4d81-b77a-e00c1ebea357","Type":"ContainerStarted","Data":"a09ce6f35d2ca5e7c432683d65833609522fb5520cd393634b27d6337cf9159d"}
Aug 04 18:29:26.868670 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.868583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j" event={"ID":"19d4316b-d7f5-4d81-b77a-e00c1ebea357","Type":"ContainerStarted","Data":"236bc6f03c9e682147b3da727dea413c4392a441c252296bffdee7b60fb541c2"}
Aug 04 18:29:26.868716 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.868684    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:29:26.888381 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:26.888337    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j" podStartSLOduration=16.888324763 podStartE2EDuration="16.888324763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:26.887524394 +0000 UTC m=+77.855414940" watchObservedRunningTime="2026-08-04 18:29:26.888324763 +0000 UTC m=+77.856215308"
Aug 04 18:29:28.877226 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:28.877194    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp" event={"ID":"a2b26397-82fe-4436-8d2a-08bb767ea9b1","Type":"ContainerStarted","Data":"0040e0fe9bfa7876f99620edd649c09c835e57dface9bef41887f21524b8456a"}
Aug 04 18:29:28.877602 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:28.877245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp" event={"ID":"a2b26397-82fe-4436-8d2a-08bb767ea9b1","Type":"ContainerStarted","Data":"678b856fb1eeb4583f4a05878fe9029fa0a2c34a8e51fc0609c862249302a2c9"}
Aug 04 18:29:28.894165 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:28.894118    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tjdnp" podStartSLOduration=16.846128568 podStartE2EDuration="18.894099766s" totalImagesPullingTime="2.047971198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:28.893871728 +0000 UTC m=+79.861762299" watchObservedRunningTime="2026-08-04 18:29:28.894099766 +0000 UTC m=+79.861990313"
Aug 04 18:29:31.826974 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:31.826839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:31.826974 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:31.826898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:31.827472 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:31.827446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e2e3352-35b1-4302-ae2a-03db9051b80c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:31.829213 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:31.829196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e2e3352-35b1-4302-ae2a-03db9051b80c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wqnl\" (UID: \"7e2e3352-35b1-4302-ae2a-03db9051b80c\") " pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:31.902993 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:31.902969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7wqnl"
Aug 04 18:29:32.027985 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:32.027930    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7wqnl"]
Aug 04 18:29:32.030873 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:32.030844    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2e3352_35b1_4302_ae2a_03db9051b80c.slice/crio-6af0b9579af79ffdba79efa9150582c57a3df00da1ff6350faa591471ca73451 WatchSource:0}: Error finding container 6af0b9579af79ffdba79efa9150582c57a3df00da1ff6350faa591471ca73451: Status 404 returned error can't find the container with id 6af0b9579af79ffdba79efa9150582c57a3df00da1ff6350faa591471ca73451
Aug 04 18:29:32.891024 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:32.890988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7wqnl" event={"ID":"7e2e3352-35b1-4302-ae2a-03db9051b80c","Type":"ContainerStarted","Data":"9a8e53488d7a9ca56cbd6c1e9cd444eae69bf72955cfea4a3bdf5e7cf4d623cd"}
Aug 04 18:29:32.891400 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:32.891049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7wqnl" event={"ID":"7e2e3352-35b1-4302-ae2a-03db9051b80c","Type":"ContainerStarted","Data":"6af0b9579af79ffdba79efa9150582c57a3df00da1ff6350faa591471ca73451"}
Aug 04 18:29:33.565439 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:33.565384    2565 scope.go:117] "RemoveContainer" containerID="46dc4e118409d889cd9a25946e8010b2af70fad17256913efcaa3d9284cca83b"
Aug 04 18:29:33.897701 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:33.897631    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:29:33.898154 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:33.897756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng" event={"ID":"4b549cc5-d752-4434-8943-c18c9b334388","Type":"ContainerStarted","Data":"99dcf1d097023c5f4f561236d76a2fa50974af7b56b4349d9fdd4b4001159683"}
Aug 04 18:29:33.898463 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:33.898437    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:33.900378 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:33.900354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7wqnl" event={"ID":"7e2e3352-35b1-4302-ae2a-03db9051b80c","Type":"ContainerStarted","Data":"73cc8167339dced7b430efe5b8ed1b645aac90533af5f1387756fe27db8a1f4e"}
Aug 04 18:29:33.918741 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:33.918697    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng" podStartSLOduration=20.905787727 podStartE2EDuration="23.918682979s" totalImagesPullingTime="3.012895252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:33.917603993 +0000 UTC m=+84.885494541" watchObservedRunningTime="2026-08-04 18:29:33.918682979 +0000 UTC m=+84.886573533"
Aug 04 18:29:34.451971 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:34.451937    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-8zwng"
Aug 04 18:29:34.905246 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:34.905214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7wqnl" event={"ID":"7e2e3352-35b1-4302-ae2a-03db9051b80c","Type":"ContainerStarted","Data":"4b0b269d65db68fd6bac43a8fef5148af12ffc8982de4c36f29c574c85655a9d"}
Aug 04 18:29:34.925236 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:34.925190    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7wqnl" podStartSLOduration=17.419719201 podStartE2EDuration="19.925174716s" totalImagesPullingTime="2.505455515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:29:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:34.924224763 +0000 UTC m=+85.892115334" watchObservedRunningTime="2026-08-04 18:29:34.925174716 +0000 UTC m=+85.893065261"
Aug 04 18:29:36.869696 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.869656    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"]
Aug 04 18:29:36.871811 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.871792    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"]
Aug 04 18:29:36.871891 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.871863    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"
Aug 04 18:29:36.873521 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.873501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"
Aug 04 18:29:36.879887 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.879862    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 04 18:29:36.880011 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.879868    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 04 18:29:36.880011 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.879871    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-26cbc\""
Aug 04 18:29:36.880878 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.880862    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c9767d44f-8dq7j"]
Aug 04 18:29:36.881117 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.881096    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 04 18:29:36.881213 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.881125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dqd7r\""
Aug 04 18:29:36.899002 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.898980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"]
Aug 04 18:29:36.899706 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.899688    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"]
Aug 04 18:29:36.941242 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.941214    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-2gtqj"]
Aug 04 18:29:36.943318 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.943302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-2gtqj"
Aug 04 18:29:36.945870 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.945847    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 18:29:36.946030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.945880    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 18:29:36.946030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.945938    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m6j9h\""
Aug 04 18:29:36.957704 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.957683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-2gtqj"]
Aug 04 18:29:36.968311 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.968287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ce3146a-2e6b-45e2-84ed-39434a7330f6-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-c9xt9\" (UID: \"1ce3146a-2e6b-45e2-84ed-39434a7330f6\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"
Aug 04 18:29:36.968405 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.968321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ce3146a-2e6b-45e2-84ed-39434a7330f6-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-c9xt9\" (UID: \"1ce3146a-2e6b-45e2-84ed-39434a7330f6\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"
Aug 04 18:29:36.968449 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:36.968430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5ed9cb74-fa47-4e84-a74f-ca86fb6e373a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-zdqp4\" (UID: \"5ed9cb74-fa47-4e84-a74f-ca86fb6e373a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"
Aug 04 18:29:37.069005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.068973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5ed9cb74-fa47-4e84-a74f-ca86fb6e373a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-zdqp4\" (UID: \"5ed9cb74-fa47-4e84-a74f-ca86fb6e373a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"
Aug 04 18:29:37.069005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.069009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5x2z\" (UniqueName: \"kubernetes.io/projected/2e932a80-dde9-4ade-bda1-3dd7a4351f2e-kube-api-access-j5x2z\") pod \"downloads-77c974ffcf-2gtqj\" (UID: \"2e932a80-dde9-4ade-bda1-3dd7a4351f2e\") " pod="openshift-console/downloads-77c974ffcf-2gtqj"
Aug 04 18:29:37.069277 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.069035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ce3146a-2e6b-45e2-84ed-39434a7330f6-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-c9xt9\" (UID: \"1ce3146a-2e6b-45e2-84ed-39434a7330f6\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"
Aug 04 18:29:37.069277 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.069058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ce3146a-2e6b-45e2-84ed-39434a7330f6-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-c9xt9\" (UID: \"1ce3146a-2e6b-45e2-84ed-39434a7330f6\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"
Aug 04 18:29:37.069705 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.069669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ce3146a-2e6b-45e2-84ed-39434a7330f6-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-c9xt9\" (UID: \"1ce3146a-2e6b-45e2-84ed-39434a7330f6\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"
Aug 04 18:29:37.071365 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.071336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5ed9cb74-fa47-4e84-a74f-ca86fb6e373a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-zdqp4\" (UID: \"5ed9cb74-fa47-4e84-a74f-ca86fb6e373a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"
Aug 04 18:29:37.071465 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.071438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ce3146a-2e6b-45e2-84ed-39434a7330f6-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-c9xt9\" (UID: \"1ce3146a-2e6b-45e2-84ed-39434a7330f6\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"
Aug 04 18:29:37.169923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.169841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5x2z\" (UniqueName: \"kubernetes.io/projected/2e932a80-dde9-4ade-bda1-3dd7a4351f2e-kube-api-access-j5x2z\") pod \"downloads-77c974ffcf-2gtqj\" (UID: \"2e932a80-dde9-4ade-bda1-3dd7a4351f2e\") " pod="openshift-console/downloads-77c974ffcf-2gtqj"
Aug 04 18:29:37.181648 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.181625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5x2z\" (UniqueName: \"kubernetes.io/projected/2e932a80-dde9-4ade-bda1-3dd7a4351f2e-kube-api-access-j5x2z\") pod \"downloads-77c974ffcf-2gtqj\" (UID: \"2e932a80-dde9-4ade-bda1-3dd7a4351f2e\") " pod="openshift-console/downloads-77c974ffcf-2gtqj"
Aug 04 18:29:37.181771 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.181718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"
Aug 04 18:29:37.187767 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.187748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"
Aug 04 18:29:37.253248 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.253071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-2gtqj"
Aug 04 18:29:37.327019 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.326962    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"]
Aug 04 18:29:37.329906 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:37.329872    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed9cb74_fa47_4e84_a74f_ca86fb6e373a.slice/crio-a6d68c3d412c3be39ba1ebb97f20681dc10bfe9dd10c1f0019fadc92447be2f2 WatchSource:0}: Error finding container a6d68c3d412c3be39ba1ebb97f20681dc10bfe9dd10c1f0019fadc92447be2f2: Status 404 returned error can't find the container with id a6d68c3d412c3be39ba1ebb97f20681dc10bfe9dd10c1f0019fadc92447be2f2
Aug 04 18:29:37.351550 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:37.351523    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce3146a_2e6b_45e2_84ed_39434a7330f6.slice/crio-9c4f195639128529502ca94c8602c003a5dfb53326bd760b1aaa0653f7683ce1 WatchSource:0}: Error finding container 9c4f195639128529502ca94c8602c003a5dfb53326bd760b1aaa0653f7683ce1: Status 404 returned error can't find the container with id 9c4f195639128529502ca94c8602c003a5dfb53326bd760b1aaa0653f7683ce1
Aug 04 18:29:37.358177 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.353580    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9"]
Aug 04 18:29:37.395809 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.395765    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-2gtqj"]
Aug 04 18:29:37.399477 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:37.399457    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e932a80_dde9_4ade_bda1_3dd7a4351f2e.slice/crio-4aaed3f3f0735b1ecf786893983a82f636c0143741a20b0adab92929c2d59620 WatchSource:0}: Error finding container 4aaed3f3f0735b1ecf786893983a82f636c0143741a20b0adab92929c2d59620: Status 404 returned error can't find the container with id 4aaed3f3f0735b1ecf786893983a82f636c0143741a20b0adab92929c2d59620
Aug 04 18:29:37.914515 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.914481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-2gtqj" event={"ID":"2e932a80-dde9-4ade-bda1-3dd7a4351f2e","Type":"ContainerStarted","Data":"4aaed3f3f0735b1ecf786893983a82f636c0143741a20b0adab92929c2d59620"}
Aug 04 18:29:37.915571 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.915544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4" event={"ID":"5ed9cb74-fa47-4e84-a74f-ca86fb6e373a","Type":"ContainerStarted","Data":"a6d68c3d412c3be39ba1ebb97f20681dc10bfe9dd10c1f0019fadc92447be2f2"}
Aug 04 18:29:37.916538 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:37.916512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9" event={"ID":"1ce3146a-2e6b-45e2-84ed-39434a7330f6","Type":"ContainerStarted","Data":"9c4f195639128529502ca94c8602c003a5dfb53326bd760b1aaa0653f7683ce1"}
Aug 04 18:29:38.560329 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.560296    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-746c797ff8-ctk7k"]
Aug 04 18:29:38.562923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.562877    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.565661 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.565637    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 18:29:38.566341 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.565958    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 18:29:38.567015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.566719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jxbgl\""
Aug 04 18:29:38.567015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.566814    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 18:29:38.568605 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.567230    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 18:29:38.568605 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.567590    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 18:29:38.572233 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.572178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746c797ff8-ctk7k"]
Aug 04 18:29:38.683578 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.683548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-oauth-config\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.683702 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.683649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-serving-cert\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.683771 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.683712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-service-ca\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.683849 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.683827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-oauth-serving-cert\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.683909 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.683862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25pv9\" (UniqueName: \"kubernetes.io/projected/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-kube-api-access-25pv9\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.684085 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.683918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-config\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.785300 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.785263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-oauth-config\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.785519 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.785316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-serving-cert\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.785519 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.785352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-service-ca\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.785519 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.785404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-oauth-serving-cert\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.785519 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.785441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25pv9\" (UniqueName: \"kubernetes.io/projected/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-kube-api-access-25pv9\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.785519 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.785478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-config\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.786336 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.786224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-config\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.786714 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.786675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-service-ca\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.786983 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.786960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-oauth-serving-cert\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.788245 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.788221    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-oauth-config\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.789376 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.789353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-serving-cert\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.794662 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.794618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25pv9\" (UniqueName: \"kubernetes.io/projected/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-kube-api-access-25pv9\") pod \"console-746c797ff8-ctk7k\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") " pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.882429 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.882293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:38.922016 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.921975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4" event={"ID":"5ed9cb74-fa47-4e84-a74f-ca86fb6e373a","Type":"ContainerStarted","Data":"c83b45b3d21ed8728ce622c51b70b257b78f217b0c992e7424dc7c5693ebc3b4"}
Aug 04 18:29:38.922424 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.922236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"
Aug 04 18:29:38.927848 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.927827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4"
Aug 04 18:29:38.938991 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:38.938942    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zdqp4" podStartSLOduration=1.611944117 podStartE2EDuration="2.938923775s" totalImagesPullingTime="1.326979658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:38.937438757 +0000 UTC m=+89.905329284" watchObservedRunningTime="2026-08-04 18:29:38.938923775 +0000 UTC m=+89.906814322"
Aug 04 18:29:39.201621 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.201587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746c797ff8-ctk7k"]
Aug 04 18:29:39.204352 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:39.204311    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ad06b7_9d5e_4bda_8596_cd3460bf71f6.slice/crio-c46a4da0ea959eb201f0a7cef8202d4715bf46423863627d852ef2ff7bbefe76 WatchSource:0}: Error finding container c46a4da0ea959eb201f0a7cef8202d4715bf46423863627d852ef2ff7bbefe76: Status 404 returned error can't find the container with id c46a4da0ea959eb201f0a7cef8202d4715bf46423863627d852ef2ff7bbefe76
Aug 04 18:29:39.843730 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.843695    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-wgshh"]
Aug 04 18:29:39.846585 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.846567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:39.850948 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.850917    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 18:29:39.850948 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.850947    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 18:29:39.851114 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.850962    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 04 18:29:39.851114 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.850961    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-s687p\""
Aug 04 18:29:39.851114 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.850925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 04 18:29:39.851114 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.850986    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 18:29:39.858123 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.858104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-wgshh"]
Aug 04 18:29:39.928934 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.928890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746c797ff8-ctk7k" event={"ID":"52ad06b7-9d5e-4bda-8596-cd3460bf71f6","Type":"ContainerStarted","Data":"c46a4da0ea959eb201f0a7cef8202d4715bf46423863627d852ef2ff7bbefe76"}
Aug 04 18:29:39.931015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.930983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9" event={"ID":"1ce3146a-2e6b-45e2-84ed-39434a7330f6","Type":"ContainerStarted","Data":"5724c95fb232a5ac23d77779268bc3aa57c30a3561cfad14f4c102174d299b99"}
Aug 04 18:29:39.948427 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.948379    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-c9xt9" podStartSLOduration=2.215576185 podStartE2EDuration="3.948361098s" totalImagesPullingTime="1.732784913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:39.947326194 +0000 UTC m=+90.915216752" watchObservedRunningTime="2026-08-04 18:29:39.948361098 +0000 UTC m=+90.916251645"
Aug 04 18:29:39.995053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.995015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a8ed287-2258-499d-bb7a-21a452a4b136-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:39.995217 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.995068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfgv2\" (UniqueName: \"kubernetes.io/projected/4a8ed287-2258-499d-bb7a-21a452a4b136-kube-api-access-sfgv2\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:39.995217 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.995174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8ed287-2258-499d-bb7a-21a452a4b136-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:39.995340 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:39.995254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8ed287-2258-499d-bb7a-21a452a4b136-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.096643 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.096550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8ed287-2258-499d-bb7a-21a452a4b136-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.096830 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.096646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8ed287-2258-499d-bb7a-21a452a4b136-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.096830 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.096737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a8ed287-2258-499d-bb7a-21a452a4b136-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.096830 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.096794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfgv2\" (UniqueName: \"kubernetes.io/projected/4a8ed287-2258-499d-bb7a-21a452a4b136-kube-api-access-sfgv2\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.097583 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.097554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8ed287-2258-499d-bb7a-21a452a4b136-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.099659 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.099631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8ed287-2258-499d-bb7a-21a452a4b136-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.100306 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.100279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a8ed287-2258-499d-bb7a-21a452a4b136-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.105244 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.105216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfgv2\" (UniqueName: \"kubernetes.io/projected/4a8ed287-2258-499d-bb7a-21a452a4b136-kube-api-access-sfgv2\") pod \"prometheus-operator-758d7cb874-wgshh\" (UID: \"4a8ed287-2258-499d-bb7a-21a452a4b136\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.156091 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.156059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh"
Aug 04 18:29:40.304369 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.304337    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-wgshh"]
Aug 04 18:29:40.309813 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:40.309768    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8ed287_2258_499d_bb7a_21a452a4b136.slice/crio-5cd8ad1a77032034898c73cfd569afdf59a72431441d3d467c8f5af1ca028f87 WatchSource:0}: Error finding container 5cd8ad1a77032034898c73cfd569afdf59a72431441d3d467c8f5af1ca028f87: Status 404 returned error can't find the container with id 5cd8ad1a77032034898c73cfd569afdf59a72431441d3d467c8f5af1ca028f87
Aug 04 18:29:40.937854 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:40.937766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh" event={"ID":"4a8ed287-2258-499d-bb7a-21a452a4b136","Type":"ContainerStarted","Data":"5cd8ad1a77032034898c73cfd569afdf59a72431441d3d467c8f5af1ca028f87"}
Aug 04 18:29:42.947833 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:42.947802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746c797ff8-ctk7k" event={"ID":"52ad06b7-9d5e-4bda-8596-cd3460bf71f6","Type":"ContainerStarted","Data":"aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b"}
Aug 04 18:29:42.949664 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:42.949631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh" event={"ID":"4a8ed287-2258-499d-bb7a-21a452a4b136","Type":"ContainerStarted","Data":"83186c23bc22ac379e4321b0845230b763c9e7da7f5cda9c6203d70c3c3dc3d0"}
Aug 04 18:29:42.967339 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:42.967212    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-746c797ff8-ctk7k" podStartSLOduration=1.325132571 podStartE2EDuration="4.967191414s" totalImagesPullingTime="3.642058843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:42.966444397 +0000 UTC m=+93.934334946" watchObservedRunningTime="2026-08-04 18:29:42.967191414 +0000 UTC m=+93.935081960"
Aug 04 18:29:43.956012 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:43.955971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh" event={"ID":"4a8ed287-2258-499d-bb7a-21a452a4b136","Type":"ContainerStarted","Data":"93be68dc21952eed58d0a3ced61d1f33af5e448519513f8d9ce8f88c14a98832"}
Aug 04 18:29:43.983303 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:43.983254    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-wgshh" podStartSLOduration=2.4482359369999998 podStartE2EDuration="4.983239688s" totalImagesPullingTime="2.535003751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:43.983046465 +0000 UTC m=+94.950937013" watchObservedRunningTime="2026-08-04 18:29:43.983239688 +0000 UTC m=+94.951130215"
Aug 04 18:29:46.233119 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.233085    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"]
Aug 04 18:29:46.235613 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.235595    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.238204 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.238184    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"]
Aug 04 18:29:46.238499 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.238483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 04 18:29:46.238639 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.238610    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 04 18:29:46.238722 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.238647    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tfkzw\""
Aug 04 18:29:46.240358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.240338    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.242790 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.242587    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 04 18:29:46.242790 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.242589    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 04 18:29:46.242790 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.242596    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9qm72\""
Aug 04 18:29:46.243314 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.243106    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 04 18:29:46.251067 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.251047    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"]
Aug 04 18:29:46.260380 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.260317    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"]
Aug 04 18:29:46.300000 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.299968    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dsrbt"]
Aug 04 18:29:46.302644 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.302617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.305294 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.305266    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 18:29:46.312039 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.312006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tl7g6\""
Aug 04 18:29:46.312344 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.312326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 18:29:46.312536 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.312514    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 18:29:46.350210 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.350358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.350358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.350358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/def47f39-6c6a-4bfd-96a0-1a236ff09095-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.350358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/def47f39-6c6a-4bfd-96a0-1a236ff09095-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.350563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.350563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjszs\" (UniqueName: \"kubernetes.io/projected/1ac582e2-5891-4e6a-8435-e90b2cd68f56-kube-api-access-pjszs\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.350563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ac582e2-5891-4e6a-8435-e90b2cd68f56-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.350563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkwb\" (UniqueName: \"kubernetes.io/projected/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-api-access-8pkwb\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.350563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.350545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.451667 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkwb\" (UniqueName: \"kubernetes.io/projected/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-api-access-8pkwb\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.451860 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-root\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.451860 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.451860 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.451860 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.451860 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.452117 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:46.451858    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Aug 04 18:29:46.452117 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/def47f39-6c6a-4bfd-96a0-1a236ff09095-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.452117 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.452117 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:29:46.451930    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-tls podName:1ac582e2-5891-4e6a-8435-e90b2cd68f56 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:46.95190812 +0000 UTC m=+97.919798660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-m422w" (UID: "1ac582e2-5891-4e6a-8435-e90b2cd68f56") : secret "openshift-state-metrics-tls" not found
Aug 04 18:29:46.452117 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.451955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-accelerators-collector-config\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.452117 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-wtmp\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.452117 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-textfile\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/def47f39-6c6a-4bfd-96a0-1a236ff09095-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjszs\" (UniqueName: \"kubernetes.io/projected/1ac582e2-5891-4e6a-8435-e90b2cd68f56-kube-api-access-pjszs\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eadd8054-17cd-46f6-9c74-44c109c2df46-metrics-client-ca\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfnwj\" (UniqueName: \"kubernetes.io/projected/eadd8054-17cd-46f6-9c74-44c109c2df46-kube-api-access-kfnwj\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ac582e2-5891-4e6a-8435-e90b2cd68f56-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-sys\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-tls\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.452450 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/def47f39-6c6a-4bfd-96a0-1a236ff09095-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.452938 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.452916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/def47f39-6c6a-4bfd-96a0-1a236ff09095-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.453197 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.453174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ac582e2-5891-4e6a-8435-e90b2cd68f56-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.453361 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.453338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.454757 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.454732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.454870 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.454761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.455346 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.455324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.467400 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.467374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkwb\" (UniqueName: \"kubernetes.io/projected/def47f39-6c6a-4bfd-96a0-1a236ff09095-kube-api-access-8pkwb\") pod \"kube-state-metrics-6bd9664c4-xqghk\" (UID: \"def47f39-6c6a-4bfd-96a0-1a236ff09095\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.467586 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.467569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjszs\" (UniqueName: \"kubernetes.io/projected/1ac582e2-5891-4e6a-8435-e90b2cd68f56-kube-api-access-pjszs\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.553842 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.553795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-wtmp\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554040 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.553864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-textfile\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554040 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.553895    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"
Aug 04 18:29:46.554040 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.553964    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-wtmp\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554040 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.553900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eadd8054-17cd-46f6-9c74-44c109c2df46-metrics-client-ca\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554263 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfnwj\" (UniqueName: \"kubernetes.io/projected/eadd8054-17cd-46f6-9c74-44c109c2df46-kube-api-access-kfnwj\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554263 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-sys\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554263 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-tls\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554263 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-root\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554263 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-sys\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eadd8054-17cd-46f6-9c74-44c109c2df46-root\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554267    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-textfile\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-accelerators-collector-config\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554759 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eadd8054-17cd-46f6-9c74-44c109c2df46-metrics-client-ca\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.554957 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.554932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-accelerators-collector-config\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.556525 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.556502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.556656 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.556639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eadd8054-17cd-46f6-9c74-44c109c2df46-node-exporter-tls\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.563108 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.563086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfnwj\" (UniqueName: \"kubernetes.io/projected/eadd8054-17cd-46f6-9c74-44c109c2df46-kube-api-access-kfnwj\") pod \"node-exporter-dsrbt\" (UID: \"eadd8054-17cd-46f6-9c74-44c109c2df46\") " pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.613304 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.613216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dsrbt"
Aug 04 18:29:46.627508 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:46.627469    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadd8054_17cd_46f6_9c74_44c109c2df46.slice/crio-a07763f6bd09d2c4f8b629963917b9d0ce23b957a87c92390ed5d2d3705d114f WatchSource:0}: Error finding container a07763f6bd09d2c4f8b629963917b9d0ce23b957a87c92390ed5d2d3705d114f: Status 404 returned error can't find the container with id a07763f6bd09d2c4f8b629963917b9d0ce23b957a87c92390ed5d2d3705d114f
Aug 04 18:29:46.696503 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.696462    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk"]
Aug 04 18:29:46.699733 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:46.699706    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef47f39_6c6a_4bfd_96a0_1a236ff09095.slice/crio-b1384afbc8510308d5f1f28e52b8719ce11fd037dbc03f36b0a340eb2307f296 WatchSource:0}: Error finding container b1384afbc8510308d5f1f28e52b8719ce11fd037dbc03f36b0a340eb2307f296: Status 404 returned error can't find the container with id b1384afbc8510308d5f1f28e52b8719ce11fd037dbc03f36b0a340eb2307f296
Aug 04 18:29:46.887055 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.886969    2565 patch_prober.go:28] interesting pod/image-registry-7c9767d44f-8dq7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 18:29:46.887179 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.887036    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j" podUID="19d4316b-d7f5-4d81-b77a-e00c1ebea357" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:29:46.959668 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.959632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.962243 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.962217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ac582e2-5891-4e6a-8435-e90b2cd68f56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m422w\" (UID: \"1ac582e2-5891-4e6a-8435-e90b2cd68f56\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:46.968814 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.968766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dsrbt" event={"ID":"eadd8054-17cd-46f6-9c74-44c109c2df46","Type":"ContainerStarted","Data":"a07763f6bd09d2c4f8b629963917b9d0ce23b957a87c92390ed5d2d3705d114f"}
Aug 04 18:29:46.970031 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:46.970001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk" event={"ID":"def47f39-6c6a-4bfd-96a0-1a236ff09095","Type":"ContainerStarted","Data":"b1384afbc8510308d5f1f28e52b8719ce11fd037dbc03f36b0a340eb2307f296"}
Aug 04 18:29:47.146930 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:47.146846    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"
Aug 04 18:29:47.325418 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:47.325265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w"]
Aug 04 18:29:47.334762 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:47.334706    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac582e2_5891_4e6a_8435_e90b2cd68f56.slice/crio-cd2255bbd94bbdefd52e5c20f18a14f93ba6a20fa2bd6a56d827367b4e278ac1 WatchSource:0}: Error finding container cd2255bbd94bbdefd52e5c20f18a14f93ba6a20fa2bd6a56d827367b4e278ac1: Status 404 returned error can't find the container with id cd2255bbd94bbdefd52e5c20f18a14f93ba6a20fa2bd6a56d827367b4e278ac1
Aug 04 18:29:47.977361 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:47.977284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w" event={"ID":"1ac582e2-5891-4e6a-8435-e90b2cd68f56","Type":"ContainerStarted","Data":"bbb2fc200cce4f54352dbe32078caabd0a77357f7a4c3a5246250692d50b680c"}
Aug 04 18:29:47.977361 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:47.977355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w" event={"ID":"1ac582e2-5891-4e6a-8435-e90b2cd68f56","Type":"ContainerStarted","Data":"91aa5185ab03bb80380ea3d9be02142ba600ab6d70a359d4b190654c227accf2"}
Aug 04 18:29:47.977583 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:47.977386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w" event={"ID":"1ac582e2-5891-4e6a-8435-e90b2cd68f56","Type":"ContainerStarted","Data":"cd2255bbd94bbdefd52e5c20f18a14f93ba6a20fa2bd6a56d827367b4e278ac1"}
Aug 04 18:29:48.377888 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:48.377853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:29:48.380449 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:48.380413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de66c1b7-4b86-4d92-b4a6-a64878863e31-metrics-tls\") pod \"dns-default-g5jmk\" (UID: \"de66c1b7-4b86-4d92-b4a6-a64878863e31\") " pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:29:48.625047 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:48.625026    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8fxw\""
Aug 04 18:29:48.633226 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:48.633169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:29:48.883137 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:48.883107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:48.883342 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:48.883174    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:29:48.884596 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:48.884568    2565 patch_prober.go:28] interesting pod/console-746c797ff8-ctk7k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
Aug 04 18:29:48.884720 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:48.884614    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-746c797ff8-ctk7k" podUID="52ad06b7-9d5e-4bda-8596-cd3460bf71f6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
Aug 04 18:29:49.242978 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.242947    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"]
Aug 04 18:29:49.263846 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.263815    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"]
Aug 04 18:29:49.264019 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.263913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.266867 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.266831    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-av8cpgh19hlda\""
Aug 04 18:29:49.266867 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.266845    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6klnj\""
Aug 04 18:29:49.267063 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.266876    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 04 18:29:49.267063 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.266847    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 04 18:29:49.267063 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.266835    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 04 18:29:49.267063 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.266833    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 04 18:29:49.267305 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.267288    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 04 18:29:49.386121 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.386088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.386584 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.386139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-tls\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.386584 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.386200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-metrics-client-ca\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.386584 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.386236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-grpc-tls\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.386584 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.386304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.386584 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.386354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpsw8\" (UniqueName: \"kubernetes.io/projected/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-kube-api-access-hpsw8\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.386584 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.386399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.386584 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.386484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.486967 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.486930    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.487142 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.486993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.487142 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.487031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-tls\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.487142 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.487061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-metrics-client-ca\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.487142 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.487086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-grpc-tls\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.487142 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.487131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.487420 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.487171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpsw8\" (UniqueName: \"kubernetes.io/projected/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-kube-api-access-hpsw8\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.487420 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.487202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.490799 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.490757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-tls\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.491141 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.491099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.491506 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.491463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-metrics-client-ca\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.491712 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.491670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.492041 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.492017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.492350 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.492328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.493178 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.493043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-secret-grpc-tls\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.496889 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.496848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpsw8\" (UniqueName: \"kubernetes.io/projected/513fd842-c43e-4ad6-a3bc-6172bfdbdd1c-kube-api-access-hpsw8\") pod \"thanos-querier-d6b8d8c7b-qhxkt\" (UID: \"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c\") " pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:49.576670 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:49.576640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:29:50.505787 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.505755    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6ff967758-dz9rk"]
Aug 04 18:29:50.524082 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.524053    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ff967758-dz9rk"]
Aug 04 18:29:50.524244 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.524137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.527847 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.527808    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 04 18:29:50.528125 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.528106    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-l2ssz\""
Aug 04 18:29:50.528668 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.528120    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-co3dvdkgr0j0b\""
Aug 04 18:29:50.528668 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.528121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 04 18:29:50.528668 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.528133    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 18:29:50.528668 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.528178    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 04 18:29:50.699725 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.699697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-client-ca-bundle\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.699923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.699736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vqxv\" (UniqueName: \"kubernetes.io/projected/32e16744-06f9-4190-be9b-c75046e9b0f8-kube-api-access-2vqxv\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.699923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.699811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/32e16744-06f9-4190-be9b-c75046e9b0f8-audit-log\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.699923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.699868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-secret-metrics-server-tls\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.700080 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.699919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32e16744-06f9-4190-be9b-c75046e9b0f8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.700080 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.699979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-secret-metrics-server-client-certs\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.700080 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.700066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/32e16744-06f9-4190-be9b-c75046e9b0f8-metrics-server-audit-profiles\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.801178 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.801093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/32e16744-06f9-4190-be9b-c75046e9b0f8-metrics-server-audit-profiles\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.801178 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.801157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-client-ca-bundle\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.801415 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.801189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqxv\" (UniqueName: \"kubernetes.io/projected/32e16744-06f9-4190-be9b-c75046e9b0f8-kube-api-access-2vqxv\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.801415 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.801243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/32e16744-06f9-4190-be9b-c75046e9b0f8-audit-log\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.801415 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.801279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-secret-metrics-server-tls\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.801415 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.801313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32e16744-06f9-4190-be9b-c75046e9b0f8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.801415 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.801366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-secret-metrics-server-client-certs\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.801692 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.801667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/32e16744-06f9-4190-be9b-c75046e9b0f8-audit-log\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.802257 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.802233    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32e16744-06f9-4190-be9b-c75046e9b0f8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.802364 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.802273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/32e16744-06f9-4190-be9b-c75046e9b0f8-metrics-server-audit-profiles\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.804174 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.804153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-secret-metrics-server-tls\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.804285 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.804249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-secret-metrics-server-client-certs\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.805102 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.805079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32e16744-06f9-4190-be9b-c75046e9b0f8-client-ca-bundle\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.809899 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.809878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vqxv\" (UniqueName: \"kubernetes.io/projected/32e16744-06f9-4190-be9b-c75046e9b0f8-kube-api-access-2vqxv\") pod \"metrics-server-6ff967758-dz9rk\" (UID: \"32e16744-06f9-4190-be9b-c75046e9b0f8\") " pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:50.835689 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:50.835665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:29:51.387504 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.387468    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6df49689b-km9g7"]
Aug 04 18:29:51.404864 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.404831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6df49689b-km9g7"]
Aug 04 18:29:51.405016 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.404965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.407639 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.407612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2x4lw\""
Aug 04 18:29:51.407814 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.407702    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 04 18:29:51.407882 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.407868    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 04 18:29:51.408020 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.408000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 04 18:29:51.408142 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.408112    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 04 18:29:51.408203 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.408193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 04 18:29:51.413421 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.413398    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 04 18:29:51.507107 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.507070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-metrics-client-ca\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.507513 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.507150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-serving-certs-ca-bundle\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.507513 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.507198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-secret-telemeter-client\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.507513 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.507251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.507513 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.507285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.507513 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.507324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpz6b\" (UniqueName: \"kubernetes.io/projected/489c86d7-ca86-4c58-8b53-8004d4eec554-kube-api-access-hpz6b\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.507513 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.507363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-telemeter-client-tls\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.507513 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.507391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-federate-client-tls\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.607843 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.607808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpz6b\" (UniqueName: \"kubernetes.io/projected/489c86d7-ca86-4c58-8b53-8004d4eec554-kube-api-access-hpz6b\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.608023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.607859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-telemeter-client-tls\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.608023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.607887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-federate-client-tls\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.608023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.607925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-metrics-client-ca\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.608023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.607984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-serving-certs-ca-bundle\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.608227 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.608027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-secret-telemeter-client\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.608227 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.608078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.608227 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.608113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.609805 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.608973    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-serving-certs-ca-bundle\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.609805 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.609116    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-metrics-client-ca\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.610081 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.610049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489c86d7-ca86-4c58-8b53-8004d4eec554-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.611041 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.611015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-telemeter-client-tls\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.611041 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.611030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.611216 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.611141    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-federate-client-tls\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.611387 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.611361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/489c86d7-ca86-4c58-8b53-8004d4eec554-secret-telemeter-client\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.616912 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.616888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpz6b\" (UniqueName: \"kubernetes.io/projected/489c86d7-ca86-4c58-8b53-8004d4eec554-kube-api-access-hpz6b\") pod \"telemeter-client-6df49689b-km9g7\" (UID: \"489c86d7-ca86-4c58-8b53-8004d4eec554\") " pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.717588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.717507    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6df49689b-km9g7"
Aug 04 18:29:51.855020 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:51.854992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m27lg"
Aug 04 18:29:55.921531 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:55.921494    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"]
Aug 04 18:29:56.017757 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:56.017666    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513fd842_c43e_4ad6_a3bc_6172bfdbdd1c.slice/crio-f8e95b2379892d9fcd4d3651d30fe7d01ab78f900eab5115b93ef3ad66090cb2 WatchSource:0}: Error finding container f8e95b2379892d9fcd4d3651d30fe7d01ab78f900eab5115b93ef3ad66090cb2: Status 404 returned error can't find the container with id f8e95b2379892d9fcd4d3651d30fe7d01ab78f900eab5115b93ef3ad66090cb2
Aug 04 18:29:56.193179 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.192959    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g5jmk"]
Aug 04 18:29:56.204338 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:56.204301    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde66c1b7_4b86_4d92_b4a6_a64878863e31.slice/crio-b51a6a9352d311bcfc090aceb223331c7d4313bb7c35b8440c7800165389b294 WatchSource:0}: Error finding container b51a6a9352d311bcfc090aceb223331c7d4313bb7c35b8440c7800165389b294: Status 404 returned error can't find the container with id b51a6a9352d311bcfc090aceb223331c7d4313bb7c35b8440c7800165389b294
Aug 04 18:29:56.245907 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.245634    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ff967758-dz9rk"]
Aug 04 18:29:56.257701 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:56.257671    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e16744_06f9_4190_be9b_c75046e9b0f8.slice/crio-adcc6ef501f0e753d9428542b86105f54d10a36f1d10aa398ee2e2ae6f85ad25 WatchSource:0}: Error finding container adcc6ef501f0e753d9428542b86105f54d10a36f1d10aa398ee2e2ae6f85ad25: Status 404 returned error can't find the container with id adcc6ef501f0e753d9428542b86105f54d10a36f1d10aa398ee2e2ae6f85ad25
Aug 04 18:29:56.301256 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.301222    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6df49689b-km9g7"]
Aug 04 18:29:56.330278 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:56.330242    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489c86d7_ca86_4c58_8b53_8004d4eec554.slice/crio-a9fd5ec199c50a54d3a1006a6261768bc710fc2d3d8cf18f4b06fee7e747a961 WatchSource:0}: Error finding container a9fd5ec199c50a54d3a1006a6261768bc710fc2d3d8cf18f4b06fee7e747a961: Status 404 returned error can't find the container with id a9fd5ec199c50a54d3a1006a6261768bc710fc2d3d8cf18f4b06fee7e747a961
Aug 04 18:29:56.613300 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.613211    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746c797ff8-ctk7k"]
Aug 04 18:29:56.680464 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.678867    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fb46675bb-xmhnl"]
Aug 04 18:29:56.682021 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.681996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.698524 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.695284    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 18:29:56.703180 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.701164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fb46675bb-xmhnl"]
Aug 04 18:29:56.754353 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.754315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-serving-cert\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.754575 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.754559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-console-config\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.754687 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.754674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-service-ca\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.754820 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.754806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-oauth-config\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.755021 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.754999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-trusted-ca-bundle\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.755169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.755156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-oauth-serving-cert\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.755326 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.755313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pm2q\" (UniqueName: \"kubernetes.io/projected/9399033e-80db-4245-a1ba-436e89a5fbae-kube-api-access-9pm2q\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.859353 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.859314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-trusted-ca-bundle\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.860620 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.860595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-oauth-serving-cert\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.860882 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.860863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pm2q\" (UniqueName: \"kubernetes.io/projected/9399033e-80db-4245-a1ba-436e89a5fbae-kube-api-access-9pm2q\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.861107 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.860524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-trusted-ca-bundle\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.861232 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.861213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-serving-cert\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.861348 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.861333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-console-config\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.862148 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.862130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-service-ca\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.862911 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.862893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-oauth-config\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.863504 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.861229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-oauth-serving-cert\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.863636 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.862839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-service-ca\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.864328 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.862067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-console-config\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.864469 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.864205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-serving-cert\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.869849 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.869829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-oauth-config\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.871443 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.871399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pm2q\" (UniqueName: \"kubernetes.io/projected/9399033e-80db-4245-a1ba-436e89a5fbae-kube-api-access-9pm2q\") pod \"console-7fb46675bb-xmhnl\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") " pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:56.887684 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.887650    2565 patch_prober.go:28] interesting pod/image-registry-7c9767d44f-8dq7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 18:29:56.887858 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:56.887707    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j" podUID="19d4316b-d7f5-4d81-b77a-e00c1ebea357" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:29:57.006867 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.006829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:29:57.017666 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.016983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk" event={"ID":"def47f39-6c6a-4bfd-96a0-1a236ff09095","Type":"ContainerStarted","Data":"bd5f298bf0c9d193b54b46fad439bd276e9592c5d0db7a2766268d1e4544fc0b"}
Aug 04 18:29:57.017666 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.017052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk" event={"ID":"def47f39-6c6a-4bfd-96a0-1a236ff09095","Type":"ContainerStarted","Data":"68de043d4fa022168ab776bd377fd3a448d15cca6f3de9791186a146ceb6eb99"}
Aug 04 18:29:57.017666 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.017083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk" event={"ID":"def47f39-6c6a-4bfd-96a0-1a236ff09095","Type":"ContainerStarted","Data":"866dfb88311733bbcb18b6e6f07daf96e41cfb735a6a9bf9895ad5f7ee2f897c"}
Aug 04 18:29:57.033181 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.033140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-2gtqj" event={"ID":"2e932a80-dde9-4ade-bda1-3dd7a4351f2e","Type":"ContainerStarted","Data":"4ee33e78e7ba7f6cd8d2d83320aa5ae9a44399d44c4a7bbeb4e2270e66e1a49b"}
Aug 04 18:29:57.035829 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.035730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-2gtqj"
Aug 04 18:29:57.037634 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.037576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6df49689b-km9g7" event={"ID":"489c86d7-ca86-4c58-8b53-8004d4eec554","Type":"ContainerStarted","Data":"a9fd5ec199c50a54d3a1006a6261768bc710fc2d3d8cf18f4b06fee7e747a961"}
Aug 04 18:29:57.045323 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.042994    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-xqghk" podStartSLOduration=1.7456857860000001 podStartE2EDuration="11.042976506s" totalImagesPullingTime="9.29729072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:57.040553313 +0000 UTC m=+108.008443859" watchObservedRunningTime="2026-08-04 18:29:57.042976506 +0000 UTC m=+108.010867053"
Aug 04 18:29:57.049099 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.049073    2565 generic.go:356] "Generic (PLEG): container finished" podID="eadd8054-17cd-46f6-9c74-44c109c2df46" containerID="2995eb00633579e7d4e8ddc6d79793e41ba915614f157f51bf5e12e4a73b8f07" exitCode=0
Aug 04 18:29:57.049600 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.049495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dsrbt" event={"ID":"eadd8054-17cd-46f6-9c74-44c109c2df46","Type":"ContainerDied","Data":"2995eb00633579e7d4e8ddc6d79793e41ba915614f157f51bf5e12e4a73b8f07"}
Aug 04 18:29:57.050792 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.050547    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-2gtqj"
Aug 04 18:29:57.056376 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.056318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5jmk" event={"ID":"de66c1b7-4b86-4d92-b4a6-a64878863e31","Type":"ContainerStarted","Data":"b51a6a9352d311bcfc090aceb223331c7d4313bb7c35b8440c7800165389b294"}
Aug 04 18:29:57.060523 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.060499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w" event={"ID":"1ac582e2-5891-4e6a-8435-e90b2cd68f56","Type":"ContainerStarted","Data":"0b017fe2f05307aa005b9618d80913ab55a8206889b26d1fec308aa169dfbf86"}
Aug 04 18:29:57.063440 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.063325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk" event={"ID":"32e16744-06f9-4190-be9b-c75046e9b0f8","Type":"ContainerStarted","Data":"adcc6ef501f0e753d9428542b86105f54d10a36f1d10aa398ee2e2ae6f85ad25"}
Aug 04 18:29:57.069725 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.069701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt" event={"ID":"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c","Type":"ContainerStarted","Data":"f8e95b2379892d9fcd4d3651d30fe7d01ab78f900eab5115b93ef3ad66090cb2"}
Aug 04 18:29:57.086212 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.085712    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m422w" podStartSLOduration=2.591463594 podStartE2EDuration="11.085690534s" totalImagesPullingTime="8.49422694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:57.084280461 +0000 UTC m=+108.052171008" watchObservedRunningTime="2026-08-04 18:29:57.085690534 +0000 UTC m=+108.053581082"
Aug 04 18:29:57.086901 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.086856    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-2gtqj" podStartSLOduration=2.3742924690000002 podStartE2EDuration="21.086836293s" totalImagesPullingTime="18.712543824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:57.064759831 +0000 UTC m=+108.032650378" watchObservedRunningTime="2026-08-04 18:29:57.086836293 +0000 UTC m=+108.054726841"
Aug 04 18:29:57.200985 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:57.200947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fb46675bb-xmhnl"]
Aug 04 18:29:57.205915 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:29:57.205883    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9399033e_80db_4245_a1ba_436e89a5fbae.slice/crio-a72ec31927bda5449490545ecad7060080273a28775e7c1a26e3363594c6490e WatchSource:0}: Error finding container a72ec31927bda5449490545ecad7060080273a28775e7c1a26e3363594c6490e: Status 404 returned error can't find the container with id a72ec31927bda5449490545ecad7060080273a28775e7c1a26e3363594c6490e
Aug 04 18:29:58.081707 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:58.081664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dsrbt" event={"ID":"eadd8054-17cd-46f6-9c74-44c109c2df46","Type":"ContainerStarted","Data":"fc0a346f7f2f8ef31678bde713d824f63a3ec3392afa1a37bc8c06bc998edbfc"}
Aug 04 18:29:58.082184 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:58.081732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dsrbt" event={"ID":"eadd8054-17cd-46f6-9c74-44c109c2df46","Type":"ContainerStarted","Data":"7aca3e71a095dbd78f6ad56b18add2316e9ef79f2dc4ca89187cc9ee225c10a3"}
Aug 04 18:29:58.089179 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:58.089149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb46675bb-xmhnl" event={"ID":"9399033e-80db-4245-a1ba-436e89a5fbae","Type":"ContainerStarted","Data":"e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f"}
Aug 04 18:29:58.089321 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:58.089199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb46675bb-xmhnl" event={"ID":"9399033e-80db-4245-a1ba-436e89a5fbae","Type":"ContainerStarted","Data":"a72ec31927bda5449490545ecad7060080273a28775e7c1a26e3363594c6490e"}
Aug 04 18:29:58.142196 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:58.140010    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dsrbt" podStartSLOduration=2.884698551 podStartE2EDuration="12.139989671s" totalImagesPullingTime="9.137970705s" totalInitContainerRuntime="117.320415ms" isStatefulPod=true podCreationTimestamp="2026-08-04 18:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:58.108547304 +0000 UTC m=+109.076437853" watchObservedRunningTime="2026-08-04 18:29:58.139989671 +0000 UTC m=+109.107880218"
Aug 04 18:29:58.142196 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:29:58.141550    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fb46675bb-xmhnl" podStartSLOduration=2.141534906 podStartE2EDuration="2.141534906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:58.13802745 +0000 UTC m=+109.105917990" watchObservedRunningTime="2026-08-04 18:29:58.141534906 +0000 UTC m=+109.109425454"
Aug 04 18:30:01.900433 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:01.900362    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j" podUID="19d4316b-d7f5-4d81-b77a-e00c1ebea357" containerName="registry" containerID="cri-o://a09ce6f35d2ca5e7c432683d65833609522fb5520cd393634b27d6337cf9159d" gracePeriod=30
Aug 04 18:30:02.125172 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.125080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6df49689b-km9g7" event={"ID":"489c86d7-ca86-4c58-8b53-8004d4eec554","Type":"ContainerStarted","Data":"ed0a8a8d391f2738e2a250bf850f47c347782264101931a4dd1ba6783f4f12e1"}
Aug 04 18:30:02.128882 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.128667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5jmk" event={"ID":"de66c1b7-4b86-4d92-b4a6-a64878863e31","Type":"ContainerStarted","Data":"d1fffb68b0deb4f3dc3532de1c1430ff404f5b4ec1eaead359bc70a9df3fe254"}
Aug 04 18:30:02.128882 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.128719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5jmk" event={"ID":"de66c1b7-4b86-4d92-b4a6-a64878863e31","Type":"ContainerStarted","Data":"2228e5507ad03a78152155c5314d0d178898559e5094b367f1f1e8188b3342b2"}
Aug 04 18:30:02.129265 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.129054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:30:02.131553 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.131017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk" event={"ID":"32e16744-06f9-4190-be9b-c75046e9b0f8","Type":"ContainerStarted","Data":"f6b71e713fbbb6dea538f32ed4264117d7a44e09b58bea9dc9d4ac8051c6c9af"}
Aug 04 18:30:02.133330 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.133188    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt" event={"ID":"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c","Type":"ContainerStarted","Data":"06f2ace65ce81faac3119a70b583ba85268f8989566bf9dcd8fa07bc38ca3e0f"}
Aug 04 18:30:02.133330 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.133256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt" event={"ID":"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c","Type":"ContainerStarted","Data":"b6478fb5b6d62336ad3689e0f9e1a0371dbbf5509af8f275b9c536c239c6a53d"}
Aug 04 18:30:02.136374 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.136343    2565 generic.go:356] "Generic (PLEG): container finished" podID="19d4316b-d7f5-4d81-b77a-e00c1ebea357" containerID="a09ce6f35d2ca5e7c432683d65833609522fb5520cd393634b27d6337cf9159d" exitCode=0
Aug 04 18:30:02.136666 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.136529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j" event={"ID":"19d4316b-d7f5-4d81-b77a-e00c1ebea357","Type":"ContainerDied","Data":"a09ce6f35d2ca5e7c432683d65833609522fb5520cd393634b27d6337cf9159d"}
Aug 04 18:30:02.154819 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.153972    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g5jmk" podStartSLOduration=72.676514968 podStartE2EDuration="1m18.153955308s" totalImagesPullingTime="5.47744034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:30:02.151329054 +0000 UTC m=+113.119219601" watchObservedRunningTime="2026-08-04 18:30:02.153955308 +0000 UTC m=+113.121845854"
Aug 04 18:30:02.177466 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.177360    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk" podStartSLOduration=6.753476675 podStartE2EDuration="12.177341161s" totalImagesPullingTime="5.423864486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:30:02.175421271 +0000 UTC m=+113.143311839" watchObservedRunningTime="2026-08-04 18:30:02.177341161 +0000 UTC m=+113.145231709"
Aug 04 18:30:02.194913 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.194887    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:30:02.221588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.221006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-bound-sa-token\") pod \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") "
Aug 04 18:30:02.221588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.221055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-installation-pull-secrets\") pod \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") "
Aug 04 18:30:02.221588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.221095    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") pod \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") "
Aug 04 18:30:02.221588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.221154    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-image-registry-private-configuration\") pod \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") "
Aug 04 18:30:02.221588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.221180    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvqt9\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-kube-api-access-jvqt9\") pod \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") "
Aug 04 18:30:02.221588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.221217    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-certificates\") pod \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") "
Aug 04 18:30:02.221588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.221267    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-trusted-ca\") pod \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") "
Aug 04 18:30:02.221588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.221321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19d4316b-d7f5-4d81-b77a-e00c1ebea357-ca-trust-extracted\") pod \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\" (UID: \"19d4316b-d7f5-4d81-b77a-e00c1ebea357\") "
Aug 04 18:30:02.224661 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.224635    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-kube-api-access-jvqt9" (OuterVolumeSpecName: "kube-api-access-jvqt9") pod "19d4316b-d7f5-4d81-b77a-e00c1ebea357" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357"). InnerVolumeSpecName "kube-api-access-jvqt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:30:02.224818 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.224732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "19d4316b-d7f5-4d81-b77a-e00c1ebea357" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:02.228137 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.228107    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "19d4316b-d7f5-4d81-b77a-e00c1ebea357" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:02.230229 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.230176    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "19d4316b-d7f5-4d81-b77a-e00c1ebea357" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:30:02.230613 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.230564    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "19d4316b-d7f5-4d81-b77a-e00c1ebea357" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:30:02.230877 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.230840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "19d4316b-d7f5-4d81-b77a-e00c1ebea357" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:30:02.232538 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.232511    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "19d4316b-d7f5-4d81-b77a-e00c1ebea357" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:30:02.236211 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.236184    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d4316b-d7f5-4d81-b77a-e00c1ebea357-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "19d4316b-d7f5-4d81-b77a-e00c1ebea357" (UID: "19d4316b-d7f5-4d81-b77a-e00c1ebea357"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:30:02.322878 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.322768    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-trusted-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:02.322878 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.322826    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19d4316b-d7f5-4d81-b77a-e00c1ebea357-ca-trust-extracted\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:02.322878 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.322841    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-bound-sa-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:02.322878 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.322859    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-installation-pull-secrets\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:02.322878 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.322873    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-tls\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:02.323239 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.322887    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19d4316b-d7f5-4d81-b77a-e00c1ebea357-image-registry-private-configuration\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:02.323239 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.322901    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvqt9\" (UniqueName: \"kubernetes.io/projected/19d4316b-d7f5-4d81-b77a-e00c1ebea357-kube-api-access-jvqt9\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:02.323239 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:02.322914    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19d4316b-d7f5-4d81-b77a-e00c1ebea357-registry-certificates\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:03.145647 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:03.145599    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt" event={"ID":"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c","Type":"ContainerStarted","Data":"840417677e2eb83e446580b9122d526ad9413656bc6f1e018923cbe26b473256"}
Aug 04 18:30:03.149795 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:03.147892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j" event={"ID":"19d4316b-d7f5-4d81-b77a-e00c1ebea357","Type":"ContainerDied","Data":"236bc6f03c9e682147b3da727dea413c4392a441c252296bffdee7b60fb541c2"}
Aug 04 18:30:03.149795 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:03.147952    2565 scope.go:117] "RemoveContainer" containerID="a09ce6f35d2ca5e7c432683d65833609522fb5520cd393634b27d6337cf9159d"
Aug 04 18:30:03.149795 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:03.148221    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9767d44f-8dq7j"
Aug 04 18:30:03.176310 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:03.176280    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c9767d44f-8dq7j"]
Aug 04 18:30:03.182796 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:03.182744    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c9767d44f-8dq7j"]
Aug 04 18:30:03.570231 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:03.570195    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19d4316b-d7f5-4d81-b77a-e00c1ebea357" path="/var/lib/kubelet/pods/19d4316b-d7f5-4d81-b77a-e00c1ebea357/volumes"
Aug 04 18:30:04.155827 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:04.155799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6df49689b-km9g7" event={"ID":"489c86d7-ca86-4c58-8b53-8004d4eec554","Type":"ContainerStarted","Data":"7d12a5ad3c59c926434b97e4ed96296c2a080886dea9ded1c6c5de61be4d44cb"}
Aug 04 18:30:05.161355 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:05.161321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6df49689b-km9g7" event={"ID":"489c86d7-ca86-4c58-8b53-8004d4eec554","Type":"ContainerStarted","Data":"85a89e9711bf45a2d632d81d801eddadcb9bf38486a013e7f28be1cb49b10b80"}
Aug 04 18:30:05.186275 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:05.186231    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6df49689b-km9g7" podStartSLOduration=6.72467454 podStartE2EDuration="14.186216161s" totalImagesPullingTime="7.461541621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:30:05.185383498 +0000 UTC m=+116.153274110" watchObservedRunningTime="2026-08-04 18:30:05.186216161 +0000 UTC m=+116.154106685"
Aug 04 18:30:05.298865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:05.298837    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fb46675bb-xmhnl"]
Aug 04 18:30:06.168132 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:06.168094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt" event={"ID":"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c","Type":"ContainerStarted","Data":"4591ffde3ddeb9a5f7975cf18704f265695efe413443d6b54e9ef27ec6e11ab5"}
Aug 04 18:30:06.168520 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:06.168190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt" event={"ID":"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c","Type":"ContainerStarted","Data":"3bd4cb462338bfdcbd32aa8ac2aa729ef895f7f4c1e4a193d6d42637fdafab50"}
Aug 04 18:30:06.168520 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:06.168216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt" event={"ID":"513fd842-c43e-4ad6-a3bc-6172bfdbdd1c","Type":"ContainerStarted","Data":"d5babcc89cce4cfcd35187e92976449ae51d408063d8e29ca75e63a9498153fa"}
Aug 04 18:30:06.168520 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:06.168291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:30:06.209889 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:06.209834    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt" podStartSLOduration=8.563620849 podStartE2EDuration="17.209815958s" totalImagesPullingTime="8.646195109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:30:06.208627676 +0000 UTC m=+117.176518222" watchObservedRunningTime="2026-08-04 18:30:06.209815958 +0000 UTC m=+117.177706499"
Aug 04 18:30:07.008155 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:07.008121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:30:07.178047 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:07.178021    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d6b8d8c7b-qhxkt"
Aug 04 18:30:10.836150 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:10.836118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:30:10.836583 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:10.836184    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:30:12.150831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:12.150802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g5jmk"
Aug 04 18:30:19.387179 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:19.387143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:30:19.389452 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:19.389431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4-metrics-certs\") pod \"network-metrics-daemon-gz4tk\" (UID: \"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4\") " pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:30:19.482167 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:19.482141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zw2lq\""
Aug 04 18:30:19.489132 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:19.489110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gz4tk"
Aug 04 18:30:19.653181 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:19.653109    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gz4tk"]
Aug 04 18:30:19.663723 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:30:19.663693    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8c1386_7676_4dc7_a14c_1c5ea12bf7c4.slice/crio-9a4d0fe72aa66620b8ac18728dd0f913dcda6a39444c80cab3dfe40ddd47f0d4 WatchSource:0}: Error finding container 9a4d0fe72aa66620b8ac18728dd0f913dcda6a39444c80cab3dfe40ddd47f0d4: Status 404 returned error can't find the container with id 9a4d0fe72aa66620b8ac18728dd0f913dcda6a39444c80cab3dfe40ddd47f0d4
Aug 04 18:30:20.229446 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:20.229411    2565 generic.go:356] "Generic (PLEG): container finished" podID="53db9174-a310-48c0-bd74-7dc71e129aa4" containerID="95572cda71c1568d6076497c54c58ad407efd94e279690e54ebb7a169dd8edba" exitCode=0
Aug 04 18:30:20.229636 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:20.229453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf" event={"ID":"53db9174-a310-48c0-bd74-7dc71e129aa4","Type":"ContainerDied","Data":"95572cda71c1568d6076497c54c58ad407efd94e279690e54ebb7a169dd8edba"}
Aug 04 18:30:20.229915 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:20.229873    2565 scope.go:117] "RemoveContainer" containerID="95572cda71c1568d6076497c54c58ad407efd94e279690e54ebb7a169dd8edba"
Aug 04 18:30:20.231026 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:20.230998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gz4tk" event={"ID":"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4","Type":"ContainerStarted","Data":"9a4d0fe72aa66620b8ac18728dd0f913dcda6a39444c80cab3dfe40ddd47f0d4"}
Aug 04 18:30:21.236544 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:21.236511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-c4zpf" event={"ID":"53db9174-a310-48c0-bd74-7dc71e129aa4","Type":"ContainerStarted","Data":"ea87d86071a8be82e3993b646b8c82fea1b445c8d86f031b7df3247efaf2b5a7"}
Aug 04 18:30:21.643251 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:21.643138    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-746c797ff8-ctk7k" podUID="52ad06b7-9d5e-4bda-8596-cd3460bf71f6" containerName="console" containerID="cri-o://aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b" gracePeriod=15
Aug 04 18:30:21.919336 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:21.919270    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:30:22.011031 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.010997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-oauth-config\") pod \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") "
Aug 04 18:30:22.011031 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011032    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-oauth-serving-cert\") pod \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") "
Aug 04 18:30:22.011319 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-service-ca\") pod \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") "
Aug 04 18:30:22.011319 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-serving-cert\") pod \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") "
Aug 04 18:30:22.011319 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011136    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25pv9\" (UniqueName: \"kubernetes.io/projected/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-kube-api-access-25pv9\") pod \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") "
Aug 04 18:30:22.011478 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-config\") pod \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\" (UID: \"52ad06b7-9d5e-4bda-8596-cd3460bf71f6\") "
Aug 04 18:30:22.011533 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011468    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "52ad06b7-9d5e-4bda-8596-cd3460bf71f6" (UID: "52ad06b7-9d5e-4bda-8596-cd3460bf71f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:22.011533 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011496    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "52ad06b7-9d5e-4bda-8596-cd3460bf71f6" (UID: "52ad06b7-9d5e-4bda-8596-cd3460bf71f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:22.011708 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011683    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-config" (OuterVolumeSpecName: "console-config") pod "52ad06b7-9d5e-4bda-8596-cd3460bf71f6" (UID: "52ad06b7-9d5e-4bda-8596-cd3460bf71f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:22.011813 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011796    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-oauth-serving-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:22.011860 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011822    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:22.011860 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.011837    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-config\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:22.013508 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.013457    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-kube-api-access-25pv9" (OuterVolumeSpecName: "kube-api-access-25pv9") pod "52ad06b7-9d5e-4bda-8596-cd3460bf71f6" (UID: "52ad06b7-9d5e-4bda-8596-cd3460bf71f6"). InnerVolumeSpecName "kube-api-access-25pv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:30:22.013605 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.013509    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "52ad06b7-9d5e-4bda-8596-cd3460bf71f6" (UID: "52ad06b7-9d5e-4bda-8596-cd3460bf71f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:30:22.013605 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.013528    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "52ad06b7-9d5e-4bda-8596-cd3460bf71f6" (UID: "52ad06b7-9d5e-4bda-8596-cd3460bf71f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:30:22.113249 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.113216    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-oauth-config\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:22.113249 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.113242    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-console-serving-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:22.113249 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.113251    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25pv9\" (UniqueName: \"kubernetes.io/projected/52ad06b7-9d5e-4bda-8596-cd3460bf71f6-kube-api-access-25pv9\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:22.241722 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.241690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gz4tk" event={"ID":"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4","Type":"ContainerStarted","Data":"dcb7403e2dd210dcc1a6ecc215370bddd29dc7d3fc5f1580f9015e400cadb6fe"}
Aug 04 18:30:22.242197 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.241747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gz4tk" event={"ID":"7b8c1386-7676-4dc7-a14c-1c5ea12bf7c4","Type":"ContainerStarted","Data":"6eb41b571ba2d824b2e4a2fef5cc702106d4fb0397c399f168b362e28de2a3be"}
Aug 04 18:30:22.243063 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.243038    2565 generic.go:356] "Generic (PLEG): container finished" podID="52ad06b7-9d5e-4bda-8596-cd3460bf71f6" containerID="aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b" exitCode=0
Aug 04 18:30:22.243170 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.243077    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746c797ff8-ctk7k"
Aug 04 18:30:22.243170 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.243130    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746c797ff8-ctk7k" event={"ID":"52ad06b7-9d5e-4bda-8596-cd3460bf71f6","Type":"ContainerDied","Data":"aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b"}
Aug 04 18:30:22.243278 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.243185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746c797ff8-ctk7k" event={"ID":"52ad06b7-9d5e-4bda-8596-cd3460bf71f6","Type":"ContainerDied","Data":"c46a4da0ea959eb201f0a7cef8202d4715bf46423863627d852ef2ff7bbefe76"}
Aug 04 18:30:22.243278 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.243216    2565 scope.go:117] "RemoveContainer" containerID="aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b"
Aug 04 18:30:22.263818 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.263800    2565 scope.go:117] "RemoveContainer" containerID="aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b"
Aug 04 18:30:22.264114 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:30:22.264094    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b\": container with ID starting with aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b not found: ID does not exist" containerID="aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b"
Aug 04 18:30:22.264175 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.264124    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b"} err="failed to get container status \"aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b\": rpc error: code = NotFound desc = could not find container \"aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b\": container with ID starting with aeffcfdfad0d178a706812c58d49506b18139aa2974832383bc72880c68dd22b not found: ID does not exist"
Aug 04 18:30:22.264399 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.264364    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gz4tk" podStartSLOduration=131.805112277 podStartE2EDuration="2m13.264351759s" totalImagesPullingTime="1.459239482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:30:22.263405494 +0000 UTC m=+133.231296039" watchObservedRunningTime="2026-08-04 18:30:22.264351759 +0000 UTC m=+133.232242305"
Aug 04 18:30:22.282451 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.282425    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746c797ff8-ctk7k"]
Aug 04 18:30:22.287531 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:22.287511    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-746c797ff8-ctk7k"]
Aug 04 18:30:23.569099 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:23.569067    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52ad06b7-9d5e-4bda-8596-cd3460bf71f6" path="/var/lib/kubelet/pods/52ad06b7-9d5e-4bda-8596-cd3460bf71f6/volumes"
Aug 04 18:30:25.258211 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:25.258182    2565 generic.go:356] "Generic (PLEG): container finished" podID="a6b893bc-1de6-40ec-a965-a26aece839eb" containerID="94fe726a7c04ef1b331d41baab568aa60f4340a91dd67a4699fd8237ffa427df" exitCode=0
Aug 04 18:30:25.258589 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:25.258256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-wwhmp" event={"ID":"a6b893bc-1de6-40ec-a965-a26aece839eb","Type":"ContainerDied","Data":"94fe726a7c04ef1b331d41baab568aa60f4340a91dd67a4699fd8237ffa427df"}
Aug 04 18:30:25.258642 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:25.258588    2565 scope.go:117] "RemoveContainer" containerID="94fe726a7c04ef1b331d41baab568aa60f4340a91dd67a4699fd8237ffa427df"
Aug 04 18:30:26.265112 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:26.265080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-wwhmp" event={"ID":"a6b893bc-1de6-40ec-a965-a26aece839eb","Type":"ContainerStarted","Data":"8837878c4d938149e3ea6beb6c755519eb146831ba076140ec9670e9609d9239"}
Aug 04 18:30:30.317128 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.317082    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fb46675bb-xmhnl" podUID="9399033e-80db-4245-a1ba-436e89a5fbae" containerName="console" containerID="cri-o://e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f" gracePeriod=15
Aug 04 18:30:30.587228 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.587164    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:30:30.687789 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.687753    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-trusted-ca-bundle\") pod \"9399033e-80db-4245-a1ba-436e89a5fbae\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") "
Aug 04 18:30:30.687789 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.687795    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-service-ca\") pod \"9399033e-80db-4245-a1ba-436e89a5fbae\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") "
Aug 04 18:30:30.688005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.687817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-console-config\") pod \"9399033e-80db-4245-a1ba-436e89a5fbae\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") "
Aug 04 18:30:30.688005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.687837    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-oauth-serving-cert\") pod \"9399033e-80db-4245-a1ba-436e89a5fbae\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") "
Aug 04 18:30:30.688005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.687888    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-oauth-config\") pod \"9399033e-80db-4245-a1ba-436e89a5fbae\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") "
Aug 04 18:30:30.688005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.687936    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-serving-cert\") pod \"9399033e-80db-4245-a1ba-436e89a5fbae\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") "
Aug 04 18:30:30.688005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.687991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pm2q\" (UniqueName: \"kubernetes.io/projected/9399033e-80db-4245-a1ba-436e89a5fbae-kube-api-access-9pm2q\") pod \"9399033e-80db-4245-a1ba-436e89a5fbae\" (UID: \"9399033e-80db-4245-a1ba-436e89a5fbae\") "
Aug 04 18:30:30.688296 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.688196    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-service-ca" (OuterVolumeSpecName: "service-ca") pod "9399033e-80db-4245-a1ba-436e89a5fbae" (UID: "9399033e-80db-4245-a1ba-436e89a5fbae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:30.688379 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.688318    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9399033e-80db-4245-a1ba-436e89a5fbae" (UID: "9399033e-80db-4245-a1ba-436e89a5fbae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:30.688379 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.688337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-console-config" (OuterVolumeSpecName: "console-config") pod "9399033e-80db-4245-a1ba-436e89a5fbae" (UID: "9399033e-80db-4245-a1ba-436e89a5fbae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:30.688462 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.688443    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9399033e-80db-4245-a1ba-436e89a5fbae" (UID: "9399033e-80db-4245-a1ba-436e89a5fbae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:30.690122 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.690093    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9399033e-80db-4245-a1ba-436e89a5fbae" (UID: "9399033e-80db-4245-a1ba-436e89a5fbae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:30:30.690122 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.690104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9399033e-80db-4245-a1ba-436e89a5fbae-kube-api-access-9pm2q" (OuterVolumeSpecName: "kube-api-access-9pm2q") pod "9399033e-80db-4245-a1ba-436e89a5fbae" (UID: "9399033e-80db-4245-a1ba-436e89a5fbae"). InnerVolumeSpecName "kube-api-access-9pm2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:30:30.690248 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.690137    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9399033e-80db-4245-a1ba-436e89a5fbae" (UID: "9399033e-80db-4245-a1ba-436e89a5fbae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:30:30.789102 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.789069    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-console-config\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:30.789102 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.789096    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-oauth-serving-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:30.789102 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.789105    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-oauth-config\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:30.789102 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.789113    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9399033e-80db-4245-a1ba-436e89a5fbae-console-serving-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:30.789358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.789126    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pm2q\" (UniqueName: \"kubernetes.io/projected/9399033e-80db-4245-a1ba-436e89a5fbae-kube-api-access-9pm2q\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:30.789358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.789139    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-trusted-ca-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:30.789358 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.789151    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9399033e-80db-4245-a1ba-436e89a5fbae-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:30:30.841130 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.841067    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:30:30.844742 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:30.844725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6ff967758-dz9rk"
Aug 04 18:30:31.286514 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.286478    2565 generic.go:356] "Generic (PLEG): container finished" podID="9399033e-80db-4245-a1ba-436e89a5fbae" containerID="e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f" exitCode=0
Aug 04 18:30:31.286691 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.286546    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb46675bb-xmhnl"
Aug 04 18:30:31.286691 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.286549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb46675bb-xmhnl" event={"ID":"9399033e-80db-4245-a1ba-436e89a5fbae","Type":"ContainerDied","Data":"e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f"}
Aug 04 18:30:31.286691 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.286651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb46675bb-xmhnl" event={"ID":"9399033e-80db-4245-a1ba-436e89a5fbae","Type":"ContainerDied","Data":"a72ec31927bda5449490545ecad7060080273a28775e7c1a26e3363594c6490e"}
Aug 04 18:30:31.286691 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.286680    2565 scope.go:117] "RemoveContainer" containerID="e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f"
Aug 04 18:30:31.295696 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.295676    2565 scope.go:117] "RemoveContainer" containerID="e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f"
Aug 04 18:30:31.295982 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:30:31.295963    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f\": container with ID starting with e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f not found: ID does not exist" containerID="e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f"
Aug 04 18:30:31.296040 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.295990    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f"} err="failed to get container status \"e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f\": rpc error: code = NotFound desc = could not find container \"e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f\": container with ID starting with e81ffab5aa2002ed4903c515fa78856d2c9b58a8fbbf82e1b25ddb99325b623f not found: ID does not exist"
Aug 04 18:30:31.307322 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.307299    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fb46675bb-xmhnl"]
Aug 04 18:30:31.311072 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.311042    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fb46675bb-xmhnl"]
Aug 04 18:30:31.571294 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:30:31.571208    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9399033e-80db-4245-a1ba-436e89a5fbae" path="/var/lib/kubelet/pods/9399033e-80db-4245-a1ba-436e89a5fbae/volumes"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.038195    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f745cc79-lp8m5"]
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.038981    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9399033e-80db-4245-a1ba-436e89a5fbae" containerName="console"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.039002    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9399033e-80db-4245-a1ba-436e89a5fbae" containerName="console"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.039020    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19d4316b-d7f5-4d81-b77a-e00c1ebea357" containerName="registry"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.039029    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="19d4316b-d7f5-4d81-b77a-e00c1ebea357" containerName="registry"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.039075    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52ad06b7-9d5e-4bda-8596-cd3460bf71f6" containerName="console"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.039084    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52ad06b7-9d5e-4bda-8596-cd3460bf71f6" containerName="console"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.039220    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="19d4316b-d7f5-4d81-b77a-e00c1ebea357" containerName="registry"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.039238    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9399033e-80db-4245-a1ba-436e89a5fbae" containerName="console"
Aug 04 18:31:03.041419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.039247    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="52ad06b7-9d5e-4bda-8596-cd3460bf71f6" containerName="console"
Aug 04 18:31:03.042326 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.042278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.045874 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.045848    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 18:31:03.046038 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.045878    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jxbgl\""
Aug 04 18:31:03.046038 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.045903    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 18:31:03.047763 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.047739    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 18:31:03.047872 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.047821    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 18:31:03.048795 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.048758    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 18:31:03.054056 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.054037    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 18:31:03.054600 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.054584    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f745cc79-lp8m5"]
Aug 04 18:31:03.153936 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.153908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-oauth-serving-cert\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.154091 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.153946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-trusted-ca-bundle\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.154091 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.154012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-service-ca\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.154091 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.154041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-config\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.154091 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.154074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcx9l\" (UniqueName: \"kubernetes.io/projected/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-kube-api-access-zcx9l\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.154243 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.154100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-oauth-config\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.154243 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.154122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-serving-cert\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.254933 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.254903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcx9l\" (UniqueName: \"kubernetes.io/projected/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-kube-api-access-zcx9l\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.255066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.254941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-oauth-config\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.255066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.254971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-serving-cert\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.255066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.255028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-oauth-serving-cert\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.255174 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.255068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-trusted-ca-bundle\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.255174 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.255100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-service-ca\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.255174 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.255130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-config\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.255794 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.255749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-oauth-serving-cert\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.255918 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.255798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-config\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.256004 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.255982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-service-ca\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.256076 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.256056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-trusted-ca-bundle\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.257654 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.257623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-oauth-config\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.257756 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.257625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-serving-cert\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.272061 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.272033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcx9l\" (UniqueName: \"kubernetes.io/projected/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-kube-api-access-zcx9l\") pod \"console-76f745cc79-lp8m5\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") " pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.354098 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.354031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:03.485064 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:03.485022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f745cc79-lp8m5"]
Aug 04 18:31:03.488889 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:31:03.488862    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b064a1a_9c55_4ce8_affe_455aefd9e7e2.slice/crio-32c2ad9e96141da78d9a1e23e73674b763af05055a58ee957e236f1a0b9b86d5 WatchSource:0}: Error finding container 32c2ad9e96141da78d9a1e23e73674b763af05055a58ee957e236f1a0b9b86d5: Status 404 returned error can't find the container with id 32c2ad9e96141da78d9a1e23e73674b763af05055a58ee957e236f1a0b9b86d5
Aug 04 18:31:04.423751 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:04.423722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f745cc79-lp8m5" event={"ID":"1b064a1a-9c55-4ce8-affe-455aefd9e7e2","Type":"ContainerStarted","Data":"0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84"}
Aug 04 18:31:04.424138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:04.423766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f745cc79-lp8m5" event={"ID":"1b064a1a-9c55-4ce8-affe-455aefd9e7e2","Type":"ContainerStarted","Data":"32c2ad9e96141da78d9a1e23e73674b763af05055a58ee957e236f1a0b9b86d5"}
Aug 04 18:31:04.440925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:04.440876    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76f745cc79-lp8m5" podStartSLOduration=1.440858991 podStartE2EDuration="1.440858991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:04.439884642 +0000 UTC m=+175.407775187" watchObservedRunningTime="2026-08-04 18:31:04.440858991 +0000 UTC m=+175.408749536"
Aug 04 18:31:08.817413 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.817380    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:31:08.820826 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.820807    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.823408 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.823385    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 18:31:08.823545 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.823526    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 18:31:08.823624 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.823609    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 18:31:08.824399 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.824378    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 18:31:08.824519 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.824403    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 18:31:08.824519 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.824459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 18:31:08.824690 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.824676    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nzdhn\""
Aug 04 18:31:08.825588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.825569    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 18:31:08.825695 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.825572    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 18:31:08.830454 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.830436    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 18:31:08.841383 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.841362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:31:08.903600 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-web-config\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903732 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903732 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903732 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce16b6cd-1123-4315-874f-23d36f0cef78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903732 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903967 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddsbx\" (UniqueName: \"kubernetes.io/projected/ce16b6cd-1123-4315-874f-23d36f0cef78-kube-api-access-ddsbx\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903967 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce16b6cd-1123-4315-874f-23d36f0cef78-config-out\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903967 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903967 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce16b6cd-1123-4315-874f-23d36f0cef78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.903967 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce16b6cd-1123-4315-874f-23d36f0cef78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.904197 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.903993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce16b6cd-1123-4315-874f-23d36f0cef78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.904197 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.904020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.904197 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:08.904101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.004909 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.004876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce16b6cd-1123-4315-874f-23d36f0cef78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.004917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce16b6cd-1123-4315-874f-23d36f0cef78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.004943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce16b6cd-1123-4315-874f-23d36f0cef78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.004967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-web-config\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005285 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005333 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005333 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce16b6cd-1123-4315-874f-23d36f0cef78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005422 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005422 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddsbx\" (UniqueName: \"kubernetes.io/projected/ce16b6cd-1123-4315-874f-23d36f0cef78-kube-api-access-ddsbx\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005422 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce16b6cd-1123-4315-874f-23d36f0cef78-config-out\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005575 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce16b6cd-1123-4315-874f-23d36f0cef78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005575 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.005914 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.005890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce16b6cd-1123-4315-874f-23d36f0cef78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.007180 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.006830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce16b6cd-1123-4315-874f-23d36f0cef78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.008405 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.008336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.008405 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.008343    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce16b6cd-1123-4315-874f-23d36f0cef78-config-out\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.008588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.008436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce16b6cd-1123-4315-874f-23d36f0cef78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.008588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.008436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-web-config\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.008733 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.008713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.008886 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.008865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.008944 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.008931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.009995 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.009979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.010061 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.009994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce16b6cd-1123-4315-874f-23d36f0cef78-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.018262 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.018242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddsbx\" (UniqueName: \"kubernetes.io/projected/ce16b6cd-1123-4315-874f-23d36f0cef78-kube-api-access-ddsbx\") pod \"alertmanager-main-0\" (UID: \"ce16b6cd-1123-4315-874f-23d36f0cef78\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.131135 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.131075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:09.267241 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.267218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:31:09.269620 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:31:09.269593    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce16b6cd_1123_4315_874f_23d36f0cef78.slice/crio-b0b657ed65e32aa5f2f5702b38a59bf4e922c9137c6b70ae81575398361975b8 WatchSource:0}: Error finding container b0b657ed65e32aa5f2f5702b38a59bf4e922c9137c6b70ae81575398361975b8: Status 404 returned error can't find the container with id b0b657ed65e32aa5f2f5702b38a59bf4e922c9137c6b70ae81575398361975b8
Aug 04 18:31:09.444942 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.444918    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce16b6cd-1123-4315-874f-23d36f0cef78" containerID="daf3de49be4c114f513966493ac90d59caaf8db5b5d97b12c06a4e587fde6b98" exitCode=0
Aug 04 18:31:09.445047 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.444997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce16b6cd-1123-4315-874f-23d36f0cef78","Type":"ContainerDied","Data":"daf3de49be4c114f513966493ac90d59caaf8db5b5d97b12c06a4e587fde6b98"}
Aug 04 18:31:09.445093 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:09.445068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce16b6cd-1123-4315-874f-23d36f0cef78","Type":"ContainerStarted","Data":"b0b657ed65e32aa5f2f5702b38a59bf4e922c9137c6b70ae81575398361975b8"}
Aug 04 18:31:11.458850 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:11.458811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce16b6cd-1123-4315-874f-23d36f0cef78","Type":"ContainerStarted","Data":"f55c261e89ba7409e890964a0a3503659b3c3050bb797484b8bea9337e00f694"}
Aug 04 18:31:11.459201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:11.458895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce16b6cd-1123-4315-874f-23d36f0cef78","Type":"ContainerStarted","Data":"0b7f9876867b46959b7a0c306d83dc86154c00ba844f87fb41d65f79506dc19a"}
Aug 04 18:31:11.459201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:11.458937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce16b6cd-1123-4315-874f-23d36f0cef78","Type":"ContainerStarted","Data":"192b21447dfe7dddc6efaa4ae4fb447462d90be88d63f18676d58f81608dc457"}
Aug 04 18:31:11.459201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:11.458976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce16b6cd-1123-4315-874f-23d36f0cef78","Type":"ContainerStarted","Data":"3584c53d4f0e68eb0760d2dfe9caa55eaad85f470b9501fecf420a8519b96688"}
Aug 04 18:31:11.459201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:11.459009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce16b6cd-1123-4315-874f-23d36f0cef78","Type":"ContainerStarted","Data":"42a132140c7729574c8d920ffb4bddda16e8e5f50babe7e9ae5854ee14ce92d6"}
Aug 04 18:31:11.459201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:11.459043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce16b6cd-1123-4315-874f-23d36f0cef78","Type":"ContainerStarted","Data":"cfe78af2f0a01bc4cb1b38d988e30cc538a8204bcbade6cce562a966228b498a"}
Aug 04 18:31:11.514078 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:11.514019    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.924693043 podStartE2EDuration="3.513999148s" totalImagesPullingTime="1.576484716s" totalInitContainerRuntime="12.821389ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:11.512863286 +0000 UTC m=+182.480753831" watchObservedRunningTime="2026-08-04 18:31:11.513999148 +0000 UTC m=+182.481889696"
Aug 04 18:31:13.354706 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:13.354664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:13.355155 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:13.354751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:13.359346 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:13.359329    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:31:13.471180 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:31:13.471155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:32:40.129015 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.128905    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"]
Aug 04 18:32:40.131459 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.131441    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.134030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.134010    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 18:32:40.134143 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.134097    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 18:32:40.134205 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.134155    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wqrm6\""
Aug 04 18:32:40.141097 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.141076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"]
Aug 04 18:32:40.301488 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.301450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.301668 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.301502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8r8f\" (UniqueName: \"kubernetes.io/projected/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-kube-api-access-x8r8f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.301668 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.301583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.403153 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.403062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.403153 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.403119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8r8f\" (UniqueName: \"kubernetes.io/projected/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-kube-api-access-x8r8f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.403153 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.403143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.403452 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.403433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.403494 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.403461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.411895 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.411871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8r8f\" (UniqueName: \"kubernetes.io/projected/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-kube-api-access-x8r8f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.440646 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.440622    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:32:40.570028 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.570006    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"]
Aug 04 18:32:40.572275 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:32:40.572246    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ebec37_b03b_4240_a6b7_d9fdc4ab3a63.slice/crio-8c07eb11d637333ca12a36673fe88089785d5aa2d121cedd6be5fe3ada48b412 WatchSource:0}: Error finding container 8c07eb11d637333ca12a36673fe88089785d5aa2d121cedd6be5fe3ada48b412: Status 404 returned error can't find the container with id 8c07eb11d637333ca12a36673fe88089785d5aa2d121cedd6be5fe3ada48b412
Aug 04 18:32:40.817228 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:40.817194    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6" event={"ID":"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63","Type":"ContainerStarted","Data":"8c07eb11d637333ca12a36673fe88089785d5aa2d121cedd6be5fe3ada48b412"}
Aug 04 18:32:50.868042 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:50.867965    2565 generic.go:356] "Generic (PLEG): container finished" podID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerID="6370b12de70ba7fe825d60aa995a20070cac0255e5bc4ad63f34b911dc7f1292" exitCode=0
Aug 04 18:32:50.868042 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:50.868019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6" event={"ID":"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63","Type":"ContainerDied","Data":"6370b12de70ba7fe825d60aa995a20070cac0255e5bc4ad63f34b911dc7f1292"}
Aug 04 18:32:52.879948 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:52.879911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6" event={"ID":"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63","Type":"ContainerStarted","Data":"2438d2bcb14059667e5118dabeadc3008c78f00a608a32256ba3f9d6fb96c9c7"}
Aug 04 18:32:53.885431 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:53.885394    2565 generic.go:356] "Generic (PLEG): container finished" podID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerID="2438d2bcb14059667e5118dabeadc3008c78f00a608a32256ba3f9d6fb96c9c7" exitCode=0
Aug 04 18:32:53.885830 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:32:53.885437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6" event={"ID":"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63","Type":"ContainerDied","Data":"2438d2bcb14059667e5118dabeadc3008c78f00a608a32256ba3f9d6fb96c9c7"}
Aug 04 18:33:00.178036 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:33:00.178002    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ebec37_b03b_4240_a6b7_d9fdc4ab3a63.slice/crio-conmon-6f538a6438a6b4fe857b7be0658309ca62b0d5f81817382736f1ed4911b7f452.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:33:00.919524 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:00.919487    2565 generic.go:356] "Generic (PLEG): container finished" podID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerID="6f538a6438a6b4fe857b7be0658309ca62b0d5f81817382736f1ed4911b7f452" exitCode=0
Aug 04 18:33:00.919690 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:00.919539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6" event={"ID":"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63","Type":"ContainerDied","Data":"6f538a6438a6b4fe857b7be0658309ca62b0d5f81817382736f1ed4911b7f452"}
Aug 04 18:33:02.052391 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.052366    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:33:02.096871 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.096848    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-util\") pod \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") "
Aug 04 18:33:02.097014 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.096907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8r8f\" (UniqueName: \"kubernetes.io/projected/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-kube-api-access-x8r8f\") pod \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") "
Aug 04 18:33:02.097014 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.096924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-bundle\") pod \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\" (UID: \"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63\") "
Aug 04 18:33:02.100201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.097989    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-bundle" (OuterVolumeSpecName: "bundle") pod "e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" (UID: "e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:02.104472 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.104445    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-kube-api-access-x8r8f" (OuterVolumeSpecName: "kube-api-access-x8r8f") pod "e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" (UID: "e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63"). InnerVolumeSpecName "kube-api-access-x8r8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:02.104680 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.104653    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-util" (OuterVolumeSpecName: "util") pod "e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" (UID: "e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:02.197851 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.197757    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-util\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:02.197851 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.197806    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8r8f\" (UniqueName: \"kubernetes.io/projected/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-kube-api-access-x8r8f\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:02.197851 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.197817    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:02.930874 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.930849    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6"
Aug 04 18:33:02.930874 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.930866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6g6" event={"ID":"e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63","Type":"ContainerDied","Data":"8c07eb11d637333ca12a36673fe88089785d5aa2d121cedd6be5fe3ada48b412"}
Aug 04 18:33:02.931086 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:02.930908    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c07eb11d637333ca12a36673fe88089785d5aa2d121cedd6be5fe3ada48b412"
Aug 04 18:33:08.588011 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.587977    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"]
Aug 04 18:33:08.588428 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.588310    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerName="util"
Aug 04 18:33:08.588428 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.588320    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerName="util"
Aug 04 18:33:08.588428 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.588328    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerName="extract"
Aug 04 18:33:08.588428 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.588333    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerName="extract"
Aug 04 18:33:08.588428 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.588348    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerName="pull"
Aug 04 18:33:08.588428 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.588353    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerName="pull"
Aug 04 18:33:08.588428 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.588399    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5ebec37-b03b-4240-a6b7-d9fdc4ab3a63" containerName="extract"
Aug 04 18:33:08.624343 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.624297    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"]
Aug 04 18:33:08.624515 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.624448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"
Aug 04 18:33:08.628858 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.628836    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 04 18:33:08.629030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.628853    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-s666t\""
Aug 04 18:33:08.629269 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.629253    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:33:08.754768 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.754730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsgff\" (UniqueName: \"kubernetes.io/projected/85ee2694-5cbe-49c4-8739-d5963e506899-kube-api-access-rsgff\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5tzf\" (UID: \"85ee2694-5cbe-49c4-8739-d5963e506899\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"
Aug 04 18:33:08.754951 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.754844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85ee2694-5cbe-49c4-8739-d5963e506899-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5tzf\" (UID: \"85ee2694-5cbe-49c4-8739-d5963e506899\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"
Aug 04 18:33:08.856094 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.856006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsgff\" (UniqueName: \"kubernetes.io/projected/85ee2694-5cbe-49c4-8739-d5963e506899-kube-api-access-rsgff\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5tzf\" (UID: \"85ee2694-5cbe-49c4-8739-d5963e506899\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"
Aug 04 18:33:08.856094 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.856077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85ee2694-5cbe-49c4-8739-d5963e506899-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5tzf\" (UID: \"85ee2694-5cbe-49c4-8739-d5963e506899\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"
Aug 04 18:33:08.856459 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.856439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85ee2694-5cbe-49c4-8739-d5963e506899-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5tzf\" (UID: \"85ee2694-5cbe-49c4-8739-d5963e506899\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"
Aug 04 18:33:08.867445 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.867418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsgff\" (UniqueName: \"kubernetes.io/projected/85ee2694-5cbe-49c4-8739-d5963e506899-kube-api-access-rsgff\") pod \"cert-manager-operator-controller-manager-55c444bf86-x5tzf\" (UID: \"85ee2694-5cbe-49c4-8739-d5963e506899\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"
Aug 04 18:33:08.934873 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:08.934843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"
Aug 04 18:33:09.103253 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:09.103226    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf"]
Aug 04 18:33:09.106174 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:33:09.106112    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ee2694_5cbe_49c4_8739_d5963e506899.slice/crio-0c0fc8c1d1d67181b8e431f452c7040bde907887560f5ccbf017fc775ff7856b WatchSource:0}: Error finding container 0c0fc8c1d1d67181b8e431f452c7040bde907887560f5ccbf017fc775ff7856b: Status 404 returned error can't find the container with id 0c0fc8c1d1d67181b8e431f452c7040bde907887560f5ccbf017fc775ff7856b
Aug 04 18:33:09.419556 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:09.419480    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:33:09.419556 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:09.419489    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:33:09.431212 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:09.431186    2565 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 18:33:09.961829 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:09.961771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf" event={"ID":"85ee2694-5cbe-49c4-8739-d5963e506899","Type":"ContainerStarted","Data":"0c0fc8c1d1d67181b8e431f452c7040bde907887560f5ccbf017fc775ff7856b"}
Aug 04 18:33:11.972850 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:11.972814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf" event={"ID":"85ee2694-5cbe-49c4-8739-d5963e506899","Type":"ContainerStarted","Data":"244110c18f13781584d710a7fe5d73169db929c5797c84c79fd25e12cd6a0045"}
Aug 04 18:33:11.998732 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:11.998646    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-x5tzf" podStartSLOduration=1.859468733 podStartE2EDuration="3.998628648s" totalImagesPullingTime="2.139159915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:33:11.996508753 +0000 UTC m=+302.964399310" watchObservedRunningTime="2026-08-04 18:33:11.998628648 +0000 UTC m=+302.966519193"
Aug 04 18:33:13.142877 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.142841    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"]
Aug 04 18:33:13.166667 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.166642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"]
Aug 04 18:33:13.166857 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.166737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.169756 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.169734    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 18:33:13.169888 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.169799    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 18:33:13.170805 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.170770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wqrm6\""
Aug 04 18:33:13.297988 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.297953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49vj\" (UniqueName: \"kubernetes.io/projected/e93344ca-865e-4ed1-98d5-e109da481c23-kube-api-access-n49vj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.297988 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.297991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.298180 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.298078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.348181 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.348152    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fd6vv"]
Aug 04 18:33:13.374448 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.374421    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fd6vv"]
Aug 04 18:33:13.374556 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.374456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:13.376983 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.376957    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 04 18:33:13.377102 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.376995    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 04 18:33:13.377102 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.377000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4mcvb\""
Aug 04 18:33:13.398904 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.398846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49vj\" (UniqueName: \"kubernetes.io/projected/e93344ca-865e-4ed1-98d5-e109da481c23-kube-api-access-n49vj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.398904 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.398878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.399054 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.398940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.399235 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.399219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.399283 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.399250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.408322 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.408298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49vj\" (UniqueName: \"kubernetes.io/projected/e93344ca-865e-4ed1-98d5-e109da481c23-kube-api-access-n49vj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.475923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.475897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:13.500353 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.500320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0947accb-0155-4b5c-8c2d-9b7b99a6b4ce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fd6vv\" (UID: \"0947accb-0155-4b5c-8c2d-9b7b99a6b4ce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:13.500353 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.500355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5m8k\" (UniqueName: \"kubernetes.io/projected/0947accb-0155-4b5c-8c2d-9b7b99a6b4ce-kube-api-access-b5m8k\") pod \"cert-manager-webhook-6486ffd997-fd6vv\" (UID: \"0947accb-0155-4b5c-8c2d-9b7b99a6b4ce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:13.601471 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.601435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0947accb-0155-4b5c-8c2d-9b7b99a6b4ce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fd6vv\" (UID: \"0947accb-0155-4b5c-8c2d-9b7b99a6b4ce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:13.601639 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.601487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5m8k\" (UniqueName: \"kubernetes.io/projected/0947accb-0155-4b5c-8c2d-9b7b99a6b4ce-kube-api-access-b5m8k\") pod \"cert-manager-webhook-6486ffd997-fd6vv\" (UID: \"0947accb-0155-4b5c-8c2d-9b7b99a6b4ce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:13.611171 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.611137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0947accb-0155-4b5c-8c2d-9b7b99a6b4ce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fd6vv\" (UID: \"0947accb-0155-4b5c-8c2d-9b7b99a6b4ce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:13.611636 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.611619    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5m8k\" (UniqueName: \"kubernetes.io/projected/0947accb-0155-4b5c-8c2d-9b7b99a6b4ce-kube-api-access-b5m8k\") pod \"cert-manager-webhook-6486ffd997-fd6vv\" (UID: \"0947accb-0155-4b5c-8c2d-9b7b99a6b4ce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:13.631497 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.631467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"]
Aug 04 18:33:13.634243 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:33:13.634217    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93344ca_865e_4ed1_98d5_e109da481c23.slice/crio-43c716a1a9245d59eb2138f76b668899d6960e280a47254e901b480de25a8f62 WatchSource:0}: Error finding container 43c716a1a9245d59eb2138f76b668899d6960e280a47254e901b480de25a8f62: Status 404 returned error can't find the container with id 43c716a1a9245d59eb2138f76b668899d6960e280a47254e901b480de25a8f62
Aug 04 18:33:13.695536 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.695512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:13.866246 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.866212    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fd6vv"]
Aug 04 18:33:13.869145 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:33:13.869120    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0947accb_0155_4b5c_8c2d_9b7b99a6b4ce.slice/crio-606b436b8e9764cae5bd13eb5a53b6439c84db10cd87c54b72cc34a1870d0304 WatchSource:0}: Error finding container 606b436b8e9764cae5bd13eb5a53b6439c84db10cd87c54b72cc34a1870d0304: Status 404 returned error can't find the container with id 606b436b8e9764cae5bd13eb5a53b6439c84db10cd87c54b72cc34a1870d0304
Aug 04 18:33:13.871327 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.871309    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:33:13.982110 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.982028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv" event={"ID":"0947accb-0155-4b5c-8c2d-9b7b99a6b4ce","Type":"ContainerStarted","Data":"606b436b8e9764cae5bd13eb5a53b6439c84db10cd87c54b72cc34a1870d0304"}
Aug 04 18:33:13.983371 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.983344    2565 generic.go:356] "Generic (PLEG): container finished" podID="e93344ca-865e-4ed1-98d5-e109da481c23" containerID="201c0ab9e1f6852e5576b9595568a50da6813636f4b3ae01e67ab96df2780f0d" exitCode=0
Aug 04 18:33:13.983505 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.983397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj" event={"ID":"e93344ca-865e-4ed1-98d5-e109da481c23","Type":"ContainerDied","Data":"201c0ab9e1f6852e5576b9595568a50da6813636f4b3ae01e67ab96df2780f0d"}
Aug 04 18:33:13.983505 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:13.983436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj" event={"ID":"e93344ca-865e-4ed1-98d5-e109da481c23","Type":"ContainerStarted","Data":"43c716a1a9245d59eb2138f76b668899d6960e280a47254e901b480de25a8f62"}
Aug 04 18:33:15.032518 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.032485    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-647b8"]
Aug 04 18:33:15.035189 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.035168    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8"
Aug 04 18:33:15.037737 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.037710    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4k2jk\""
Aug 04 18:33:15.046290 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.046265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-647b8"]
Aug 04 18:33:15.116730 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.116691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79e29f83-523a-4cc0-9dc8-3cafa6c59b20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-647b8\" (UID: \"79e29f83-523a-4cc0-9dc8-3cafa6c59b20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8"
Aug 04 18:33:15.116939 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.116879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdnn\" (UniqueName: \"kubernetes.io/projected/79e29f83-523a-4cc0-9dc8-3cafa6c59b20-kube-api-access-cpdnn\") pod \"cert-manager-cainjector-559cdd8c87-647b8\" (UID: \"79e29f83-523a-4cc0-9dc8-3cafa6c59b20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8"
Aug 04 18:33:15.217458 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.217417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79e29f83-523a-4cc0-9dc8-3cafa6c59b20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-647b8\" (UID: \"79e29f83-523a-4cc0-9dc8-3cafa6c59b20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8"
Aug 04 18:33:15.217650 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.217501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdnn\" (UniqueName: \"kubernetes.io/projected/79e29f83-523a-4cc0-9dc8-3cafa6c59b20-kube-api-access-cpdnn\") pod \"cert-manager-cainjector-559cdd8c87-647b8\" (UID: \"79e29f83-523a-4cc0-9dc8-3cafa6c59b20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8"
Aug 04 18:33:15.226324 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.226297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79e29f83-523a-4cc0-9dc8-3cafa6c59b20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-647b8\" (UID: \"79e29f83-523a-4cc0-9dc8-3cafa6c59b20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8"
Aug 04 18:33:15.226433 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.226345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdnn\" (UniqueName: \"kubernetes.io/projected/79e29f83-523a-4cc0-9dc8-3cafa6c59b20-kube-api-access-cpdnn\") pod \"cert-manager-cainjector-559cdd8c87-647b8\" (UID: \"79e29f83-523a-4cc0-9dc8-3cafa6c59b20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8"
Aug 04 18:33:15.349351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:15.349265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8"
Aug 04 18:33:16.224376 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:16.224340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-647b8"]
Aug 04 18:33:16.227989 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:33:16.227904    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79e29f83_523a_4cc0_9dc8_3cafa6c59b20.slice/crio-801985a713216c57dca73f16fa5aba793d93dad903ccb4a82b07cc64186558c2 WatchSource:0}: Error finding container 801985a713216c57dca73f16fa5aba793d93dad903ccb4a82b07cc64186558c2: Status 404 returned error can't find the container with id 801985a713216c57dca73f16fa5aba793d93dad903ccb4a82b07cc64186558c2
Aug 04 18:33:17.002282 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:17.002246    2565 generic.go:356] "Generic (PLEG): container finished" podID="e93344ca-865e-4ed1-98d5-e109da481c23" containerID="ae59362a163c73902994ecc2e3799bbf3ac0d08bb07118a72c7c08636e985001" exitCode=0
Aug 04 18:33:17.002468 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:17.002326    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj" event={"ID":"e93344ca-865e-4ed1-98d5-e109da481c23","Type":"ContainerDied","Data":"ae59362a163c73902994ecc2e3799bbf3ac0d08bb07118a72c7c08636e985001"}
Aug 04 18:33:17.003695 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:17.003667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8" event={"ID":"79e29f83-523a-4cc0-9dc8-3cafa6c59b20","Type":"ContainerStarted","Data":"801985a713216c57dca73f16fa5aba793d93dad903ccb4a82b07cc64186558c2"}
Aug 04 18:33:18.009632 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:18.009594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv" event={"ID":"0947accb-0155-4b5c-8c2d-9b7b99a6b4ce","Type":"ContainerStarted","Data":"cdc04f02523b2957441814e0c278e74f11835a21f4c783b09163f82d53ac50e3"}
Aug 04 18:33:18.010089 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:18.009802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:18.011560 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:18.011537    2565 generic.go:356] "Generic (PLEG): container finished" podID="e93344ca-865e-4ed1-98d5-e109da481c23" containerID="2ee51bf618ffd312523644b9b16a21ab0f54cfd7870fa42c140fb45db315b4ff" exitCode=0
Aug 04 18:33:18.011695 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:18.011611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj" event={"ID":"e93344ca-865e-4ed1-98d5-e109da481c23","Type":"ContainerDied","Data":"2ee51bf618ffd312523644b9b16a21ab0f54cfd7870fa42c140fb45db315b4ff"}
Aug 04 18:33:18.012963 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:18.012944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8" event={"ID":"79e29f83-523a-4cc0-9dc8-3cafa6c59b20","Type":"ContainerStarted","Data":"55f140d8ccc3687d4724d094083ed26891dc65dd9969281ba7768dea37e2ec20"}
Aug 04 18:33:18.034828 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:18.034759    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv" podStartSLOduration=1.497322595 podStartE2EDuration="5.03474079s" totalImagesPullingTime="3.537418195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:33:18.0335703 +0000 UTC m=+309.001460849" watchObservedRunningTime="2026-08-04 18:33:18.03474079 +0000 UTC m=+309.002631334"
Aug 04 18:33:18.087261 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:18.087209    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-647b8" podStartSLOduration=1.908313677 podStartE2EDuration="3.087192283s" totalImagesPullingTime="1.178878606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:33:18.086871006 +0000 UTC m=+309.054761552" watchObservedRunningTime="2026-08-04 18:33:18.087192283 +0000 UTC m=+309.055082829"
Aug 04 18:33:19.141830 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.141805    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:19.253799 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.253751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-bundle\") pod \"e93344ca-865e-4ed1-98d5-e109da481c23\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") "
Aug 04 18:33:19.253952 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.253876    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-util\") pod \"e93344ca-865e-4ed1-98d5-e109da481c23\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") "
Aug 04 18:33:19.253952 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.253939    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n49vj\" (UniqueName: \"kubernetes.io/projected/e93344ca-865e-4ed1-98d5-e109da481c23-kube-api-access-n49vj\") pod \"e93344ca-865e-4ed1-98d5-e109da481c23\" (UID: \"e93344ca-865e-4ed1-98d5-e109da481c23\") "
Aug 04 18:33:19.254222 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.254194    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-bundle" (OuterVolumeSpecName: "bundle") pod "e93344ca-865e-4ed1-98d5-e109da481c23" (UID: "e93344ca-865e-4ed1-98d5-e109da481c23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:19.255968 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.255949    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e93344ca-865e-4ed1-98d5-e109da481c23-kube-api-access-n49vj" (OuterVolumeSpecName: "kube-api-access-n49vj") pod "e93344ca-865e-4ed1-98d5-e109da481c23" (UID: "e93344ca-865e-4ed1-98d5-e109da481c23"). InnerVolumeSpecName "kube-api-access-n49vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:19.353467 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.353392    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-util" (OuterVolumeSpecName: "util") pod "e93344ca-865e-4ed1-98d5-e109da481c23" (UID: "e93344ca-865e-4ed1-98d5-e109da481c23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:19.355426 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.355405    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-util\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:19.355490 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.355430    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n49vj\" (UniqueName: \"kubernetes.io/projected/e93344ca-865e-4ed1-98d5-e109da481c23-kube-api-access-n49vj\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:19.355490 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:19.355444    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93344ca-865e-4ed1-98d5-e109da481c23-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:20.023136 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:20.023099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj" event={"ID":"e93344ca-865e-4ed1-98d5-e109da481c23","Type":"ContainerDied","Data":"43c716a1a9245d59eb2138f76b668899d6960e280a47254e901b480de25a8f62"}
Aug 04 18:33:20.023303 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:20.023153    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43c716a1a9245d59eb2138f76b668899d6960e280a47254e901b480de25a8f62"
Aug 04 18:33:20.023303 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:20.023122    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmxwj"
Aug 04 18:33:24.020392 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:24.020367    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fd6vv"
Aug 04 18:33:33.314453 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.314413    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"]
Aug 04 18:33:33.314951 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.314933    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93344ca-865e-4ed1-98d5-e109da481c23" containerName="util"
Aug 04 18:33:33.315023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.314953    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93344ca-865e-4ed1-98d5-e109da481c23" containerName="util"
Aug 04 18:33:33.315023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.314976    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93344ca-865e-4ed1-98d5-e109da481c23" containerName="pull"
Aug 04 18:33:33.315023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.314984    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93344ca-865e-4ed1-98d5-e109da481c23" containerName="pull"
Aug 04 18:33:33.315023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.315020    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93344ca-865e-4ed1-98d5-e109da481c23" containerName="extract"
Aug 04 18:33:33.315233 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.315030    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93344ca-865e-4ed1-98d5-e109da481c23" containerName="extract"
Aug 04 18:33:33.315233 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.315117    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e93344ca-865e-4ed1-98d5-e109da481c23" containerName="extract"
Aug 04 18:33:33.318030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.318010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.320745 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.320720    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 18:33:33.320886 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.320725    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 18:33:33.321658 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.321600    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wqrm6\""
Aug 04 18:33:33.327426 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.327405    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"]
Aug 04 18:33:33.477609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.477576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.477609 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.477619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdcnk\" (UniqueName: \"kubernetes.io/projected/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-kube-api-access-kdcnk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.477849 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.477725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.578575 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.578504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.578575 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.578535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.578575 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.578560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdcnk\" (UniqueName: \"kubernetes.io/projected/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-kube-api-access-kdcnk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.578868 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.578849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.578915 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.578898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.587858 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.587833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdcnk\" (UniqueName: \"kubernetes.io/projected/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-kube-api-access-kdcnk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.628524 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.628497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:33.767135 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:33.767105    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"]
Aug 04 18:33:33.770646 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:33:33.770620    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccd64a7_b1cb_4c67_ae6a_e2c0aeec7a13.slice/crio-6b1defe82fc2ad9e435f5128bd081024a7615545bdb80113c757ca7cd58777a0 WatchSource:0}: Error finding container 6b1defe82fc2ad9e435f5128bd081024a7615545bdb80113c757ca7cd58777a0: Status 404 returned error can't find the container with id 6b1defe82fc2ad9e435f5128bd081024a7615545bdb80113c757ca7cd58777a0
Aug 04 18:33:34.089735 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:34.089690    2565 generic.go:356] "Generic (PLEG): container finished" podID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerID="3bf86dd64a555750f53ebe6abbb58baf5c16864d0b9ee6e820e243bbd8959dbc" exitCode=0
Aug 04 18:33:34.090074 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:34.089757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965" event={"ID":"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13","Type":"ContainerDied","Data":"3bf86dd64a555750f53ebe6abbb58baf5c16864d0b9ee6e820e243bbd8959dbc"}
Aug 04 18:33:34.090074 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:34.089826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965" event={"ID":"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13","Type":"ContainerStarted","Data":"6b1defe82fc2ad9e435f5128bd081024a7615545bdb80113c757ca7cd58777a0"}
Aug 04 18:33:35.096597 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:35.096567    2565 generic.go:356] "Generic (PLEG): container finished" podID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerID="4c600d0d0fd8ef14fb1e06ccb4cf726a07a5ecdd334f931797f78bd476a4b3fd" exitCode=0
Aug 04 18:33:35.097007 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:35.096625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965" event={"ID":"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13","Type":"ContainerDied","Data":"4c600d0d0fd8ef14fb1e06ccb4cf726a07a5ecdd334f931797f78bd476a4b3fd"}
Aug 04 18:33:36.103713 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:36.103678    2565 generic.go:356] "Generic (PLEG): container finished" podID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerID="ae603cca0115ced0d3de6c8f3548721cf12ec798146026b1bcec4da123e406ac" exitCode=0
Aug 04 18:33:36.104103 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:36.103813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965" event={"ID":"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13","Type":"ContainerDied","Data":"ae603cca0115ced0d3de6c8f3548721cf12ec798146026b1bcec4da123e406ac"}
Aug 04 18:33:37.234878 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.234854    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:37.409310 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.409225    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-bundle\") pod \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") "
Aug 04 18:33:37.409310 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.409273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-util\") pod \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") "
Aug 04 18:33:37.409310 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.409310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdcnk\" (UniqueName: \"kubernetes.io/projected/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-kube-api-access-kdcnk\") pod \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\" (UID: \"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13\") "
Aug 04 18:33:37.410120 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.410090    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-bundle" (OuterVolumeSpecName: "bundle") pod "9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" (UID: "9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:37.411373 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.411346    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-kube-api-access-kdcnk" (OuterVolumeSpecName: "kube-api-access-kdcnk") pod "9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" (UID: "9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13"). InnerVolumeSpecName "kube-api-access-kdcnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:37.415242 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.415222    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-util" (OuterVolumeSpecName: "util") pod "9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" (UID: "9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:33:37.509900 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.509863    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.509900 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.509893    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-util\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.509900 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:37.509907    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdcnk\" (UniqueName: \"kubernetes.io/projected/9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13-kube-api-access-kdcnk\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:33:38.114980 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:38.114942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965" event={"ID":"9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13","Type":"ContainerDied","Data":"6b1defe82fc2ad9e435f5128bd081024a7615545bdb80113c757ca7cd58777a0"}
Aug 04 18:33:38.114980 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:38.114984    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8c965"
Aug 04 18:33:38.115191 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:38.114986    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b1defe82fc2ad9e435f5128bd081024a7615545bdb80113c757ca7cd58777a0"
Aug 04 18:33:46.570426 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.570391    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"]
Aug 04 18:33:46.570865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.570721    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerName="util"
Aug 04 18:33:46.570865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.570731    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerName="util"
Aug 04 18:33:46.570865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.570739    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerName="extract"
Aug 04 18:33:46.570865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.570745    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerName="extract"
Aug 04 18:33:46.570865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.570763    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerName="pull"
Aug 04 18:33:46.570865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.570768    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerName="pull"
Aug 04 18:33:46.570865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.570843    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccd64a7-b1cb-4c67-ae6a-e2c0aeec7a13" containerName="extract"
Aug 04 18:33:46.573627 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.573611    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.579837 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.579814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 18:33:46.579967 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.579858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 18:33:46.580150 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.580134    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v6z2v\""
Aug 04 18:33:46.580568 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.580381    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 18:33:46.586275 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.586255    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 18:33:46.593294 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.593273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb9ef714-ac26-4115-b67e-9082f6cba7e8-tmp\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.593388 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.593333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb9ef714-ac26-4115-b67e-9082f6cba7e8-manifests\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.593388 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.593357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb9ef714-ac26-4115-b67e-9082f6cba7e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.593483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.593411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb9ef714-ac26-4115-b67e-9082f6cba7e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.593483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.593429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xtfm\" (UniqueName: \"kubernetes.io/projected/cb9ef714-ac26-4115-b67e-9082f6cba7e8-kube-api-access-9xtfm\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.611706 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.611681    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"]
Aug 04 18:33:46.695030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.694987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb9ef714-ac26-4115-b67e-9082f6cba7e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.695030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.695032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xtfm\" (UniqueName: \"kubernetes.io/projected/cb9ef714-ac26-4115-b67e-9082f6cba7e8-kube-api-access-9xtfm\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.695293 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.695120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb9ef714-ac26-4115-b67e-9082f6cba7e8-tmp\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.695293 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.695170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb9ef714-ac26-4115-b67e-9082f6cba7e8-manifests\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.695405 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.695322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb9ef714-ac26-4115-b67e-9082f6cba7e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.695650 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.695625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb9ef714-ac26-4115-b67e-9082f6cba7e8-manifests\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.697446 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.697418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb9ef714-ac26-4115-b67e-9082f6cba7e8-tmp\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.697724 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.697707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb9ef714-ac26-4115-b67e-9082f6cba7e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.697807 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.697759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb9ef714-ac26-4115-b67e-9082f6cba7e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.708677 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.708648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xtfm\" (UniqueName: \"kubernetes.io/projected/cb9ef714-ac26-4115-b67e-9082f6cba7e8-kube-api-access-9xtfm\") pod \"opendatahub-operator-controller-manager-5556d6485b-pmtlk\" (UID: \"cb9ef714-ac26-4115-b67e-9082f6cba7e8\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:46.884715 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:46.884630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:47.042674 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:33:47.042649    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9ef714_ac26_4115_b67e_9082f6cba7e8.slice/crio-7ae6b6d408ad81bfad6ab2cd01642e61742108471beb593c3dba8349f73a0598 WatchSource:0}: Error finding container 7ae6b6d408ad81bfad6ab2cd01642e61742108471beb593c3dba8349f73a0598: Status 404 returned error can't find the container with id 7ae6b6d408ad81bfad6ab2cd01642e61742108471beb593c3dba8349f73a0598
Aug 04 18:33:47.053028 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:47.053004    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"]
Aug 04 18:33:47.162437 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:47.162355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk" event={"ID":"cb9ef714-ac26-4115-b67e-9082f6cba7e8","Type":"ContainerStarted","Data":"7ae6b6d408ad81bfad6ab2cd01642e61742108471beb593c3dba8349f73a0598"}
Aug 04 18:33:50.182533 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:50.182496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk" event={"ID":"cb9ef714-ac26-4115-b67e-9082f6cba7e8","Type":"ContainerStarted","Data":"7693db38804a32e0eda280d1758995a33d8065c8d50631f49b8e06e714cee41b"}
Aug 04 18:33:51.189488 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:51.189450    2565 generic.go:356] "Generic (PLEG): container finished" podID="cb9ef714-ac26-4115-b67e-9082f6cba7e8" containerID="7693db38804a32e0eda280d1758995a33d8065c8d50631f49b8e06e714cee41b" exitCode=0
Aug 04 18:33:51.189884 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:51.189538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk" event={"ID":"cb9ef714-ac26-4115-b67e-9082f6cba7e8","Type":"ContainerDied","Data":"7693db38804a32e0eda280d1758995a33d8065c8d50631f49b8e06e714cee41b"}
Aug 04 18:33:52.197331 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:52.197217    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk" event={"ID":"cb9ef714-ac26-4115-b67e-9082f6cba7e8","Type":"ContainerStarted","Data":"607bc88a1b2ed797d2ef9c58f036cdfde0415a67124c760471788f85f74e307c"}
Aug 04 18:33:52.197812 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:52.197347    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:33:52.248038 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:33:52.247985    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk" podStartSLOduration=1.6804075630000002 podStartE2EDuration="6.247969541s" totalImagesPullingTime="3.544929433s" totalInitContainerRuntime="1.022632545s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:33:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:33:52.247493285 +0000 UTC m=+343.215383833" watchObservedRunningTime="2026-08-04 18:33:52.247969541 +0000 UTC m=+343.215860085"
Aug 04 18:34:03.205625 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.205414    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-pmtlk"
Aug 04 18:34:03.488795 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.488745    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"]
Aug 04 18:34:03.491956 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.491941    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.499035 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.499008    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 18:34:03.499910 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.499886    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:34:03.499989 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.499913    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 18:34:03.499989 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.499896    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 18:34:03.500103 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.499892    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 18:34:03.509327 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.509306    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-j99f5\""
Aug 04 18:34:03.531201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.531173    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"]
Aug 04 18:34:03.548333 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.548285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/af0d9701-e737-4987-9131-f5909b71d70d-metrics-cert\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.548491 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.548352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dnpn\" (UniqueName: \"kubernetes.io/projected/af0d9701-e737-4987-9131-f5909b71d70d-kube-api-access-5dnpn\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.548491 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.548423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/af0d9701-e737-4987-9131-f5909b71d70d-manager-config\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.548491 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.548466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af0d9701-e737-4987-9131-f5909b71d70d-cert\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.649881 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.649847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/af0d9701-e737-4987-9131-f5909b71d70d-metrics-cert\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.649881 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.649882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnpn\" (UniqueName: \"kubernetes.io/projected/af0d9701-e737-4987-9131-f5909b71d70d-kube-api-access-5dnpn\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.650135 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.649936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/af0d9701-e737-4987-9131-f5909b71d70d-manager-config\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.650135 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.649975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af0d9701-e737-4987-9131-f5909b71d70d-cert\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.650646 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.650620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/af0d9701-e737-4987-9131-f5909b71d70d-manager-config\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.652286 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.652264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af0d9701-e737-4987-9131-f5909b71d70d-cert\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.652370 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.652328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/af0d9701-e737-4987-9131-f5909b71d70d-metrics-cert\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.659906 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.659884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dnpn\" (UniqueName: \"kubernetes.io/projected/af0d9701-e737-4987-9131-f5909b71d70d-kube-api-access-5dnpn\") pod \"lws-controller-manager-6f7c986d68-xxgzw\" (UID: \"af0d9701-e737-4987-9131-f5909b71d70d\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.801168 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.801075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:03.943983 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:03.943953    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"]
Aug 04 18:34:03.947324 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:34:03.947297    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0d9701_e737_4987_9131_f5909b71d70d.slice/crio-b141ae279866497286bdaa27da617378e8f299a132ebfe1c607a50d0e2ca9649 WatchSource:0}: Error finding container b141ae279866497286bdaa27da617378e8f299a132ebfe1c607a50d0e2ca9649: Status 404 returned error can't find the container with id b141ae279866497286bdaa27da617378e8f299a132ebfe1c607a50d0e2ca9649
Aug 04 18:34:04.259482 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:04.259446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw" event={"ID":"af0d9701-e737-4987-9131-f5909b71d70d","Type":"ContainerStarted","Data":"b141ae279866497286bdaa27da617378e8f299a132ebfe1c607a50d0e2ca9649"}
Aug 04 18:34:06.271406 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:06.271359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw" event={"ID":"af0d9701-e737-4987-9131-f5909b71d70d","Type":"ContainerStarted","Data":"40c145357cb31153beefc0fcf5435ff21657928091acd5188c7418977cadf1c4"}
Aug 04 18:34:06.271896 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:06.271464    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:34:06.307502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:06.307453    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw" podStartSLOduration=1.609668852 podStartE2EDuration="3.307436988s" totalImagesPullingTime="1.697768136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:06.306486096 +0000 UTC m=+357.274376633" watchObservedRunningTime="2026-08-04 18:34:06.307436988 +0000 UTC m=+357.275327534"
Aug 04 18:34:07.388838 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.388801    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"]
Aug 04 18:34:07.394083 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.394057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:07.397689 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.397662    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 18:34:07.398198 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.398176    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 18:34:07.398198 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.398188    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 18:34:07.399004 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.398978    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cvgpz\""
Aug 04 18:34:07.399190 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.399170    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 18:34:07.418214 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.418189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"]
Aug 04 18:34:07.484556 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.484529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99e61928-ec71-4779-bbe1-5404c752c7d2-tmp\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:07.484744 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.484568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqmc7\" (UniqueName: \"kubernetes.io/projected/99e61928-ec71-4779-bbe1-5404c752c7d2-kube-api-access-rqmc7\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:07.484744 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.484609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99e61928-ec71-4779-bbe1-5404c752c7d2-tls-certs\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:07.586148 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.586120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99e61928-ec71-4779-bbe1-5404c752c7d2-tmp\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:07.586351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.586162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqmc7\" (UniqueName: \"kubernetes.io/projected/99e61928-ec71-4779-bbe1-5404c752c7d2-kube-api-access-rqmc7\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:07.586351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.586300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99e61928-ec71-4779-bbe1-5404c752c7d2-tls-certs\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:07.586494 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:34:07.586472    2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Aug 04 18:34:07.586575 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:34:07.586563    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e61928-ec71-4779-bbe1-5404c752c7d2-tls-certs podName:99e61928-ec71-4779-bbe1-5404c752c7d2 nodeName:}" failed. No retries permitted until 2026-08-04 18:34:08.086528744 +0000 UTC m=+359.054419281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/99e61928-ec71-4779-bbe1-5404c752c7d2-tls-certs") pod "kube-auth-proxy-65f654896c-4g4fs" (UID: "99e61928-ec71-4779-bbe1-5404c752c7d2") : secret "kube-auth-proxy-tls" not found
Aug 04 18:34:07.588543 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.588513    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99e61928-ec71-4779-bbe1-5404c752c7d2-tmp\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:07.609377 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:07.609341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqmc7\" (UniqueName: \"kubernetes.io/projected/99e61928-ec71-4779-bbe1-5404c752c7d2-kube-api-access-rqmc7\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:08.091287 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:08.091249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99e61928-ec71-4779-bbe1-5404c752c7d2-tls-certs\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:08.093765 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:08.093739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99e61928-ec71-4779-bbe1-5404c752c7d2-tls-certs\") pod \"kube-auth-proxy-65f654896c-4g4fs\" (UID: \"99e61928-ec71-4779-bbe1-5404c752c7d2\") " pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:08.306141 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:08.306110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"
Aug 04 18:34:08.526071 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:34:08.526036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e61928_ec71_4779_bbe1_5404c752c7d2.slice/crio-d604b0425724a3b7af4875c383c34c824d9f55f088f2ba5e517f8eb6126e6919 WatchSource:0}: Error finding container d604b0425724a3b7af4875c383c34c824d9f55f088f2ba5e517f8eb6126e6919: Status 404 returned error can't find the container with id d604b0425724a3b7af4875c383c34c824d9f55f088f2ba5e517f8eb6126e6919
Aug 04 18:34:08.542956 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:08.542928    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65f654896c-4g4fs"]
Aug 04 18:34:09.290685 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:09.290645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs" event={"ID":"99e61928-ec71-4779-bbe1-5404c752c7d2","Type":"ContainerStarted","Data":"d604b0425724a3b7af4875c383c34c824d9f55f088f2ba5e517f8eb6126e6919"}
Aug 04 18:34:11.824796 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:11.824761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 18:34:12.311937 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:12.311900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs" event={"ID":"99e61928-ec71-4779-bbe1-5404c752c7d2","Type":"ContainerStarted","Data":"b6974f6ceae16206f5a8254eafeaa51948a1aaae8481e24ff36636d8362437b9"}
Aug 04 18:34:12.336744 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:12.336684    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65f654896c-4g4fs" podStartSLOduration=2.04293939 podStartE2EDuration="5.336667593s" totalImagesPullingTime="3.293728203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:12.334349974 +0000 UTC m=+363.302240520" watchObservedRunningTime="2026-08-04 18:34:12.336667593 +0000 UTC m=+363.304558149"
Aug 04 18:34:17.279259 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:34:17.279229    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-xxgzw"
Aug 04 18:35:13.439927 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.439892    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"]
Aug 04 18:35:13.443663 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.443643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.447005 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.446982    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 18:35:13.447857 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.447842    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wqrm6\""
Aug 04 18:35:13.447937 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.447848    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 18:35:13.452510 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.452489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"]
Aug 04 18:35:13.468599 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.468567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.468726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.468675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wc8f\" (UniqueName: \"kubernetes.io/projected/41bffc8b-b15e-46dd-be89-a32074a7dc7e-kube-api-access-6wc8f\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.468726 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.468699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.534764 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.534729    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"]
Aug 04 18:35:13.537391 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.537374    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.549816 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.549767    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"]
Aug 04 18:35:13.569993 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.569966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.570120 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.570006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.570120 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.570032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.570216 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.570127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvp2b\" (UniqueName: \"kubernetes.io/projected/7a9283db-4293-400b-8c94-6464d77504fe-kube-api-access-kvp2b\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.570216 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.570174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wc8f\" (UniqueName: \"kubernetes.io/projected/41bffc8b-b15e-46dd-be89-a32074a7dc7e-kube-api-access-6wc8f\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.570216 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.570198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.570399 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.570379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.570570 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.570554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.579174 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.579149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wc8f\" (UniqueName: \"kubernetes.io/projected/41bffc8b-b15e-46dd-be89-a32074a7dc7e-kube-api-access-6wc8f\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.627177 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.627141    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"]
Aug 04 18:35:13.630135 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.630110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.641255 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.641229    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"]
Aug 04 18:35:13.671329 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.671299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.671329 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.671333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.671510 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.671364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.671554 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.671502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvp2b\" (UniqueName: \"kubernetes.io/projected/7a9283db-4293-400b-8c94-6464d77504fe-kube-api-access-kvp2b\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.671621 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.671605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.671674 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.671629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2884\" (UniqueName: \"kubernetes.io/projected/4053d6bb-4089-4e47-9e72-a4bb3791a006-kube-api-access-x2884\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.671723 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.671709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.671813 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.671723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.681415 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.681393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvp2b\" (UniqueName: \"kubernetes.io/projected/7a9283db-4293-400b-8c94-6464d77504fe-kube-api-access-kvp2b\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.735333 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.735309    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"]
Aug 04 18:35:13.738007 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.737993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.750138 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.750114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"]
Aug 04 18:35:13.754697 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.754678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:13.772105 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.772078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.772262 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.772116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.772262 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.772177    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dxx7\" (UniqueName: \"kubernetes.io/projected/dc78cb6d-9551-4b88-811c-2a599694243d-kube-api-access-2dxx7\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.772262 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.772200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.772441 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.772331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.772441 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.772368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2884\" (UniqueName: \"kubernetes.io/projected/4053d6bb-4089-4e47-9e72-a4bb3791a006-kube-api-access-x2884\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.772533 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.772493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.772811 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.772763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.788251 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.788232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2884\" (UniqueName: \"kubernetes.io/projected/4053d6bb-4089-4e47-9e72-a4bb3791a006-kube-api-access-x2884\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:13.847282 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.847203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:13.873742 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.873629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.873742 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.873725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dxx7\" (UniqueName: \"kubernetes.io/projected/dc78cb6d-9551-4b88-811c-2a599694243d-kube-api-access-2dxx7\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.874499 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.873762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.874499 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.874199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.874499 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.874427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.888188 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.888159    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dxx7\" (UniqueName: \"kubernetes.io/projected/dc78cb6d-9551-4b88-811c-2a599694243d-kube-api-access-2dxx7\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:13.918337 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.918250    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"]
Aug 04 18:35:13.924346 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:35:13.924310    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41bffc8b_b15e_46dd_be89_a32074a7dc7e.slice/crio-a75cdbc933117742b8526e847cd1010a0c73199f3fe15ee15e7b10abba9e2825 WatchSource:0}: Error finding container a75cdbc933117742b8526e847cd1010a0c73199f3fe15ee15e7b10abba9e2825: Status 404 returned error can't find the container with id a75cdbc933117742b8526e847cd1010a0c73199f3fe15ee15e7b10abba9e2825
Aug 04 18:35:13.940172 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:13.940141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:14.010895 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.010087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"]
Aug 04 18:35:14.015198 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:35:14.015164    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9283db_4293_400b_8c94_6464d77504fe.slice/crio-a7b3e7ce75ed6eaaa74dbf23461bad3a25484a15c7be1d0d4bb17777b140fe96 WatchSource:0}: Error finding container a7b3e7ce75ed6eaaa74dbf23461bad3a25484a15c7be1d0d4bb17777b140fe96: Status 404 returned error can't find the container with id a7b3e7ce75ed6eaaa74dbf23461bad3a25484a15c7be1d0d4bb17777b140fe96
Aug 04 18:35:14.047470 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.047443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:14.116676 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.116376    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"]
Aug 04 18:35:14.118078 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:35:14.118052    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4053d6bb_4089_4e47_9e72_a4bb3791a006.slice/crio-dfe75f73f2985f70f2476f3d270a333843b264c497f0d2288f604596a23be0ac WatchSource:0}: Error finding container dfe75f73f2985f70f2476f3d270a333843b264c497f0d2288f604596a23be0ac: Status 404 returned error can't find the container with id dfe75f73f2985f70f2476f3d270a333843b264c497f0d2288f604596a23be0ac
Aug 04 18:35:14.208926 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.208903    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"]
Aug 04 18:35:14.290586 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:35:14.290522    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc78cb6d_9551_4b88_811c_2a599694243d.slice/crio-44dc37b73f758637334966c7e7719838d8338a30d4ced99883f615c7acf01ce0 WatchSource:0}: Error finding container 44dc37b73f758637334966c7e7719838d8338a30d4ced99883f615c7acf01ce0: Status 404 returned error can't find the container with id 44dc37b73f758637334966c7e7719838d8338a30d4ced99883f615c7acf01ce0
Aug 04 18:35:14.633173 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.633090    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc78cb6d-9551-4b88-811c-2a599694243d" containerID="e3ea9ce93cf84f755f9b09b09e679bf905f7e23bc31f553dcda59eff27ee9a84" exitCode=0
Aug 04 18:35:14.633602 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.633186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r" event={"ID":"dc78cb6d-9551-4b88-811c-2a599694243d","Type":"ContainerDied","Data":"e3ea9ce93cf84f755f9b09b09e679bf905f7e23bc31f553dcda59eff27ee9a84"}
Aug 04 18:35:14.633602 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.633252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r" event={"ID":"dc78cb6d-9551-4b88-811c-2a599694243d","Type":"ContainerStarted","Data":"44dc37b73f758637334966c7e7719838d8338a30d4ced99883f615c7acf01ce0"}
Aug 04 18:35:14.634841 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.634817    2565 generic.go:356] "Generic (PLEG): container finished" podID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerID="4969576c201550597a3044aa10479e3114380c8c060b858a335220c8a8bebd2a" exitCode=0
Aug 04 18:35:14.634930 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.634854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m" event={"ID":"41bffc8b-b15e-46dd-be89-a32074a7dc7e","Type":"ContainerDied","Data":"4969576c201550597a3044aa10479e3114380c8c060b858a335220c8a8bebd2a"}
Aug 04 18:35:14.634930 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.634899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m" event={"ID":"41bffc8b-b15e-46dd-be89-a32074a7dc7e","Type":"ContainerStarted","Data":"a75cdbc933117742b8526e847cd1010a0c73199f3fe15ee15e7b10abba9e2825"}
Aug 04 18:35:14.636465 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.636447    2565 generic.go:356] "Generic (PLEG): container finished" podID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerID="fa913919728c734b26c277fa890a3a8a700e95c82e804816fc90d30b4eafd246" exitCode=0
Aug 04 18:35:14.636543 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.636513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c" event={"ID":"4053d6bb-4089-4e47-9e72-a4bb3791a006","Type":"ContainerDied","Data":"fa913919728c734b26c277fa890a3a8a700e95c82e804816fc90d30b4eafd246"}
Aug 04 18:35:14.636543 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.636538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c" event={"ID":"4053d6bb-4089-4e47-9e72-a4bb3791a006","Type":"ContainerStarted","Data":"dfe75f73f2985f70f2476f3d270a333843b264c497f0d2288f604596a23be0ac"}
Aug 04 18:35:14.638326 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.638305    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a9283db-4293-400b-8c94-6464d77504fe" containerID="21298cad9860e67910aeb22e15490cdfdcee2904749f814389c2c8e9082e35f3" exitCode=0
Aug 04 18:35:14.638394 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.638338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56" event={"ID":"7a9283db-4293-400b-8c94-6464d77504fe","Type":"ContainerDied","Data":"21298cad9860e67910aeb22e15490cdfdcee2904749f814389c2c8e9082e35f3"}
Aug 04 18:35:14.638394 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:14.638373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56" event={"ID":"7a9283db-4293-400b-8c94-6464d77504fe","Type":"ContainerStarted","Data":"a7b3e7ce75ed6eaaa74dbf23461bad3a25484a15c7be1d0d4bb17777b140fe96"}
Aug 04 18:35:15.646057 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:15.646030    2565 generic.go:356] "Generic (PLEG): container finished" podID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerID="edcfde06a53c3854ae37da00a8da033c3f6c7e5765e89ded7d2cdecc0a45d429" exitCode=0
Aug 04 18:35:15.646329 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:15.646110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m" event={"ID":"41bffc8b-b15e-46dd-be89-a32074a7dc7e","Type":"ContainerDied","Data":"edcfde06a53c3854ae37da00a8da033c3f6c7e5765e89ded7d2cdecc0a45d429"}
Aug 04 18:35:16.655070 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:16.655043    2565 generic.go:356] "Generic (PLEG): container finished" podID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerID="a7c17be0c62fac4acd529e4e3542044bf341cde584948c1348b518bdbb5da28a" exitCode=0
Aug 04 18:35:16.655419 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:16.655135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c" event={"ID":"4053d6bb-4089-4e47-9e72-a4bb3791a006","Type":"ContainerDied","Data":"a7c17be0c62fac4acd529e4e3542044bf341cde584948c1348b518bdbb5da28a"}
Aug 04 18:35:16.657036 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:16.657015    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a9283db-4293-400b-8c94-6464d77504fe" containerID="f874f3ed4d269f45d18c788777278b6bc3cf9e7fc8e9a192185fb30cf6888295" exitCode=0
Aug 04 18:35:16.657165 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:16.657090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56" event={"ID":"7a9283db-4293-400b-8c94-6464d77504fe","Type":"ContainerDied","Data":"f874f3ed4d269f45d18c788777278b6bc3cf9e7fc8e9a192185fb30cf6888295"}
Aug 04 18:35:16.659359 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:16.659337    2565 generic.go:356] "Generic (PLEG): container finished" podID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerID="24f715dff8bdefee93a6eb681aea85d831298d999715b243cc6065af8182b50a" exitCode=0
Aug 04 18:35:16.659453 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:16.659378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m" event={"ID":"41bffc8b-b15e-46dd-be89-a32074a7dc7e","Type":"ContainerDied","Data":"24f715dff8bdefee93a6eb681aea85d831298d999715b243cc6065af8182b50a"}
Aug 04 18:35:17.666713 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.666681    2565 generic.go:356] "Generic (PLEG): container finished" podID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerID="96097176b08f56e8e7ccbb5650e82d1d475c0f3918175ce148f60ef8c65168ac" exitCode=0
Aug 04 18:35:17.667137 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.666766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c" event={"ID":"4053d6bb-4089-4e47-9e72-a4bb3791a006","Type":"ContainerDied","Data":"96097176b08f56e8e7ccbb5650e82d1d475c0f3918175ce148f60ef8c65168ac"}
Aug 04 18:35:17.668737 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.668713    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a9283db-4293-400b-8c94-6464d77504fe" containerID="a852b4b3be2a718cfd251948d175cb2ec21b785f0ad683f09046d543bcc23d06" exitCode=0
Aug 04 18:35:17.668865 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.668811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56" event={"ID":"7a9283db-4293-400b-8c94-6464d77504fe","Type":"ContainerDied","Data":"a852b4b3be2a718cfd251948d175cb2ec21b785f0ad683f09046d543bcc23d06"}
Aug 04 18:35:17.671366 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.671039    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc78cb6d-9551-4b88-811c-2a599694243d" containerID="d4b483fbe4f3ed6001dd2cd461ef7e3c06c72e581efd39f278e26d88bb1238e2" exitCode=0
Aug 04 18:35:17.671366 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.671342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r" event={"ID":"dc78cb6d-9551-4b88-811c-2a599694243d","Type":"ContainerDied","Data":"d4b483fbe4f3ed6001dd2cd461ef7e3c06c72e581efd39f278e26d88bb1238e2"}
Aug 04 18:35:17.814498 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.814474    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:17.914535 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.914442    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wc8f\" (UniqueName: \"kubernetes.io/projected/41bffc8b-b15e-46dd-be89-a32074a7dc7e-kube-api-access-6wc8f\") pod \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") "
Aug 04 18:35:17.914535 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.914499    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-bundle\") pod \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") "
Aug 04 18:35:17.914770 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.914585    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-util\") pod \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\" (UID: \"41bffc8b-b15e-46dd-be89-a32074a7dc7e\") "
Aug 04 18:35:17.915131 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.915104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-bundle" (OuterVolumeSpecName: "bundle") pod "41bffc8b-b15e-46dd-be89-a32074a7dc7e" (UID: "41bffc8b-b15e-46dd-be89-a32074a7dc7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:17.916633 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.916609    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41bffc8b-b15e-46dd-be89-a32074a7dc7e-kube-api-access-6wc8f" (OuterVolumeSpecName: "kube-api-access-6wc8f") pod "41bffc8b-b15e-46dd-be89-a32074a7dc7e" (UID: "41bffc8b-b15e-46dd-be89-a32074a7dc7e"). InnerVolumeSpecName "kube-api-access-6wc8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:17.919664 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:17.919642    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-util" (OuterVolumeSpecName: "util") pod "41bffc8b-b15e-46dd-be89-a32074a7dc7e" (UID: "41bffc8b-b15e-46dd-be89-a32074a7dc7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:18.016121 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.016090    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-util\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:18.016121 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.016115    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wc8f\" (UniqueName: \"kubernetes.io/projected/41bffc8b-b15e-46dd-be89-a32074a7dc7e-kube-api-access-6wc8f\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:18.016121 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.016125    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41bffc8b-b15e-46dd-be89-a32074a7dc7e-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:18.678292 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.678256    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc78cb6d-9551-4b88-811c-2a599694243d" containerID="92a5933f509d42cd4e2d5879240a64bc705720e202ff9a71b18b32d19fb7be44" exitCode=0
Aug 04 18:35:18.678727 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.678346    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r" event={"ID":"dc78cb6d-9551-4b88-811c-2a599694243d","Type":"ContainerDied","Data":"92a5933f509d42cd4e2d5879240a64bc705720e202ff9a71b18b32d19fb7be44"}
Aug 04 18:35:18.680208 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.680185    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m"
Aug 04 18:35:18.680345 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.680208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870539q88m" event={"ID":"41bffc8b-b15e-46dd-be89-a32074a7dc7e","Type":"ContainerDied","Data":"a75cdbc933117742b8526e847cd1010a0c73199f3fe15ee15e7b10abba9e2825"}
Aug 04 18:35:18.680345 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.680248    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a75cdbc933117742b8526e847cd1010a0c73199f3fe15ee15e7b10abba9e2825"
Aug 04 18:35:18.842207 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.842182    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:18.844686 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.844667    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:18.923912 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.923837    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-bundle\") pod \"7a9283db-4293-400b-8c94-6464d77504fe\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") "
Aug 04 18:35:18.923912 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.923877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-util\") pod \"4053d6bb-4089-4e47-9e72-a4bb3791a006\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") "
Aug 04 18:35:18.924136 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.923923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2884\" (UniqueName: \"kubernetes.io/projected/4053d6bb-4089-4e47-9e72-a4bb3791a006-kube-api-access-x2884\") pod \"4053d6bb-4089-4e47-9e72-a4bb3791a006\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") "
Aug 04 18:35:18.924136 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.923954    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvp2b\" (UniqueName: \"kubernetes.io/projected/7a9283db-4293-400b-8c94-6464d77504fe-kube-api-access-kvp2b\") pod \"7a9283db-4293-400b-8c94-6464d77504fe\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") "
Aug 04 18:35:18.924136 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.923983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-bundle\") pod \"4053d6bb-4089-4e47-9e72-a4bb3791a006\" (UID: \"4053d6bb-4089-4e47-9e72-a4bb3791a006\") "
Aug 04 18:35:18.924698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.924312    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-util\") pod \"7a9283db-4293-400b-8c94-6464d77504fe\" (UID: \"7a9283db-4293-400b-8c94-6464d77504fe\") "
Aug 04 18:35:18.924698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.924433    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-bundle" (OuterVolumeSpecName: "bundle") pod "4053d6bb-4089-4e47-9e72-a4bb3791a006" (UID: "4053d6bb-4089-4e47-9e72-a4bb3791a006"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:18.924698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.924671    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:18.924975 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.924949    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-bundle" (OuterVolumeSpecName: "bundle") pod "7a9283db-4293-400b-8c94-6464d77504fe" (UID: "7a9283db-4293-400b-8c94-6464d77504fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:18.926481 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.926461    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4053d6bb-4089-4e47-9e72-a4bb3791a006-kube-api-access-x2884" (OuterVolumeSpecName: "kube-api-access-x2884") pod "4053d6bb-4089-4e47-9e72-a4bb3791a006" (UID: "4053d6bb-4089-4e47-9e72-a4bb3791a006"). InnerVolumeSpecName "kube-api-access-x2884". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:18.926670 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.926646    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a9283db-4293-400b-8c94-6464d77504fe-kube-api-access-kvp2b" (OuterVolumeSpecName: "kube-api-access-kvp2b") pod "7a9283db-4293-400b-8c94-6464d77504fe" (UID: "7a9283db-4293-400b-8c94-6464d77504fe"). InnerVolumeSpecName "kube-api-access-kvp2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:18.930348 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.930324    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-util" (OuterVolumeSpecName: "util") pod "7a9283db-4293-400b-8c94-6464d77504fe" (UID: "7a9283db-4293-400b-8c94-6464d77504fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:18.930448 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:18.930426    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-util" (OuterVolumeSpecName: "util") pod "4053d6bb-4089-4e47-9e72-a4bb3791a006" (UID: "4053d6bb-4089-4e47-9e72-a4bb3791a006"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:19.025928 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.025899    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2884\" (UniqueName: \"kubernetes.io/projected/4053d6bb-4089-4e47-9e72-a4bb3791a006-kube-api-access-x2884\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:19.025928 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.025925    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvp2b\" (UniqueName: \"kubernetes.io/projected/7a9283db-4293-400b-8c94-6464d77504fe-kube-api-access-kvp2b\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:19.026113 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.025936    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-util\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:19.026113 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.025949    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a9283db-4293-400b-8c94-6464d77504fe-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:19.026113 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.025959    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4053d6bb-4089-4e47-9e72-a4bb3791a006-util\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:19.687534 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.687506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c" event={"ID":"4053d6bb-4089-4e47-9e72-a4bb3791a006","Type":"ContainerDied","Data":"dfe75f73f2985f70f2476f3d270a333843b264c497f0d2288f604596a23be0ac"}
Aug 04 18:35:19.687953 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.687556    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfe75f73f2985f70f2476f3d270a333843b264c497f0d2288f604596a23be0ac"
Aug 04 18:35:19.687953 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.687514    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl7x9c"
Aug 04 18:35:19.689497 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.689462    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56"
Aug 04 18:35:19.689627 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.689512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cbwc56" event={"ID":"7a9283db-4293-400b-8c94-6464d77504fe","Type":"ContainerDied","Data":"a7b3e7ce75ed6eaaa74dbf23461bad3a25484a15c7be1d0d4bb17777b140fe96"}
Aug 04 18:35:19.689627 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.689548    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7b3e7ce75ed6eaaa74dbf23461bad3a25484a15c7be1d0d4bb17777b140fe96"
Aug 04 18:35:19.827811 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.827786    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:19.935106 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.935030    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-bundle\") pod \"dc78cb6d-9551-4b88-811c-2a599694243d\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") "
Aug 04 18:35:19.935106 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.935083    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-util\") pod \"dc78cb6d-9551-4b88-811c-2a599694243d\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") "
Aug 04 18:35:19.935290 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.935109    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dxx7\" (UniqueName: \"kubernetes.io/projected/dc78cb6d-9551-4b88-811c-2a599694243d-kube-api-access-2dxx7\") pod \"dc78cb6d-9551-4b88-811c-2a599694243d\" (UID: \"dc78cb6d-9551-4b88-811c-2a599694243d\") "
Aug 04 18:35:19.935448 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.935422    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-bundle" (OuterVolumeSpecName: "bundle") pod "dc78cb6d-9551-4b88-811c-2a599694243d" (UID: "dc78cb6d-9551-4b88-811c-2a599694243d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:19.937225 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.937206    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc78cb6d-9551-4b88-811c-2a599694243d-kube-api-access-2dxx7" (OuterVolumeSpecName: "kube-api-access-2dxx7") pod "dc78cb6d-9551-4b88-811c-2a599694243d" (UID: "dc78cb6d-9551-4b88-811c-2a599694243d"). InnerVolumeSpecName "kube-api-access-2dxx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:19.939746 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:19.939714    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-util" (OuterVolumeSpecName: "util") pod "dc78cb6d-9551-4b88-811c-2a599694243d" (UID: "dc78cb6d-9551-4b88-811c-2a599694243d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:35:20.036264 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:20.036227    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:20.036264 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:20.036258    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc78cb6d-9551-4b88-811c-2a599694243d-util\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:20.036264 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:20.036271    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dxx7\" (UniqueName: \"kubernetes.io/projected/dc78cb6d-9551-4b88-811c-2a599694243d-kube-api-access-2dxx7\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:35:20.701766 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:20.701733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r" event={"ID":"dc78cb6d-9551-4b88-811c-2a599694243d","Type":"ContainerDied","Data":"44dc37b73f758637334966c7e7719838d8338a30d4ced99883f615c7acf01ce0"}
Aug 04 18:35:20.701766 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:20.701760    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0mlh4r"
Aug 04 18:35:20.702221 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:20.701830    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44dc37b73f758637334966c7e7719838d8338a30d4ced99883f615c7acf01ce0"
Aug 04 18:35:46.593809 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.593711    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"]
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594073    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc78cb6d-9551-4b88-811c-2a599694243d" containerName="util"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594085    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc78cb6d-9551-4b88-811c-2a599694243d" containerName="util"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594095    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9283db-4293-400b-8c94-6464d77504fe" containerName="util"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594101    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9283db-4293-400b-8c94-6464d77504fe" containerName="util"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594109    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerName="extract"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594115    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerName="extract"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594122    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc78cb6d-9551-4b88-811c-2a599694243d" containerName="pull"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594127    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc78cb6d-9551-4b88-811c-2a599694243d" containerName="pull"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594135    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9283db-4293-400b-8c94-6464d77504fe" containerName="extract"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594140    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9283db-4293-400b-8c94-6464d77504fe" containerName="extract"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594150    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerName="pull"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594155    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerName="pull"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594167    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerName="util"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594172    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerName="util"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594178    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerName="pull"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594183    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerName="pull"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594189    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc78cb6d-9551-4b88-811c-2a599694243d" containerName="extract"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594194    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc78cb6d-9551-4b88-811c-2a599694243d" containerName="extract"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594200    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerName="util"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594205    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerName="util"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594210    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9283db-4293-400b-8c94-6464d77504fe" containerName="pull"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594216    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9283db-4293-400b-8c94-6464d77504fe" containerName="pull"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594222    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerName="extract"
Aug 04 18:35:46.594237 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594226    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerName="extract"
Aug 04 18:35:46.595021 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594301    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc78cb6d-9551-4b88-811c-2a599694243d" containerName="extract"
Aug 04 18:35:46.595021 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594307    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="41bffc8b-b15e-46dd-be89-a32074a7dc7e" containerName="extract"
Aug 04 18:35:46.595021 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594315    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4053d6bb-4089-4e47-9e72-a4bb3791a006" containerName="extract"
Aug 04 18:35:46.595021 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.594324    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9283db-4293-400b-8c94-6464d77504fe" containerName="extract"
Aug 04 18:35:46.597183 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.597162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.599655 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.599635    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 18:35:46.599734 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.599635    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 04 18:35:46.600158 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.600142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 18:35:46.600336 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.600323    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 04 18:35:46.602508 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.602490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zvb7z\""
Aug 04 18:35:46.613792 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.613741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"]
Aug 04 18:35:46.776243 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.776209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t295v\" (UniqueName: \"kubernetes.io/projected/41fa2f49-7874-4f27-acbf-038a01f95225-kube-api-access-t295v\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.776406 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.776262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/41fa2f49-7874-4f27-acbf-038a01f95225-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.776406 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.776311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41fa2f49-7874-4f27-acbf-038a01f95225-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.877396 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.877317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/41fa2f49-7874-4f27-acbf-038a01f95225-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.877396 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.877363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41fa2f49-7874-4f27-acbf-038a01f95225-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.877592 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.877430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t295v\" (UniqueName: \"kubernetes.io/projected/41fa2f49-7874-4f27-acbf-038a01f95225-kube-api-access-t295v\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.878146 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.878115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41fa2f49-7874-4f27-acbf-038a01f95225-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.879674 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.879650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/41fa2f49-7874-4f27-acbf-038a01f95225-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.887598 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.887566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t295v\" (UniqueName: \"kubernetes.io/projected/41fa2f49-7874-4f27-acbf-038a01f95225-kube-api-access-t295v\") pod \"kuadrant-console-plugin-598f86468b-f4r2s\" (UID: \"41fa2f49-7874-4f27-acbf-038a01f95225\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:46.906559 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:46.906535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"
Aug 04 18:35:47.042560 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:47.042532    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s"]
Aug 04 18:35:47.043409 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:35:47.043380    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41fa2f49_7874_4f27_acbf_038a01f95225.slice/crio-923170a9d0e20ef944a4a9228c93b6a457c2ed14a16d42880b9d04c6cec34eec WatchSource:0}: Error finding container 923170a9d0e20ef944a4a9228c93b6a457c2ed14a16d42880b9d04c6cec34eec: Status 404 returned error can't find the container with id 923170a9d0e20ef944a4a9228c93b6a457c2ed14a16d42880b9d04c6cec34eec
Aug 04 18:35:47.850316 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:47.850273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s" event={"ID":"41fa2f49-7874-4f27-acbf-038a01f95225","Type":"ContainerStarted","Data":"923170a9d0e20ef944a4a9228c93b6a457c2ed14a16d42880b9d04c6cec34eec"}
Aug 04 18:35:52.881515 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:52.881475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s" event={"ID":"41fa2f49-7874-4f27-acbf-038a01f95225","Type":"ContainerStarted","Data":"a16bebb89e0bc03ab6cdf9041cff2137ec8b127f6aef4f30b0bbd2d0460b5863"}
Aug 04 18:35:52.899870 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:35:52.899826    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-f4r2s" podStartSLOduration=1.916680152 podStartE2EDuration="6.899811927s" totalImagesPullingTime="4.983131775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:35:52.898279936 +0000 UTC m=+463.866170496" watchObservedRunningTime="2026-08-04 18:35:52.899811927 +0000 UTC m=+463.867702473"
Aug 04 18:36:30.167633 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.167603    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:36:30.186407 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.186377    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:36:30.186554 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.186478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:30.192429 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.192406    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 18:36:30.261254 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.261217    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:36:30.371453 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.371417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lnth\" (UniqueName: \"kubernetes.io/projected/d777d0ba-eb37-4c80-b6a4-0e743b4aecd6-kube-api-access-9lnth\") pod \"limitador-limitador-85d9db4d5d-bhfzj\" (UID: \"d777d0ba-eb37-4c80-b6a4-0e743b4aecd6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:30.371611 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.371462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d777d0ba-eb37-4c80-b6a4-0e743b4aecd6-config-file\") pod \"limitador-limitador-85d9db4d5d-bhfzj\" (UID: \"d777d0ba-eb37-4c80-b6a4-0e743b4aecd6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:30.472381 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.472311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lnth\" (UniqueName: \"kubernetes.io/projected/d777d0ba-eb37-4c80-b6a4-0e743b4aecd6-kube-api-access-9lnth\") pod \"limitador-limitador-85d9db4d5d-bhfzj\" (UID: \"d777d0ba-eb37-4c80-b6a4-0e743b4aecd6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:30.472381 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.472344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d777d0ba-eb37-4c80-b6a4-0e743b4aecd6-config-file\") pod \"limitador-limitador-85d9db4d5d-bhfzj\" (UID: \"d777d0ba-eb37-4c80-b6a4-0e743b4aecd6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:30.472974 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.472957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d777d0ba-eb37-4c80-b6a4-0e743b4aecd6-config-file\") pod \"limitador-limitador-85d9db4d5d-bhfzj\" (UID: \"d777d0ba-eb37-4c80-b6a4-0e743b4aecd6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:30.480676 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.480655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lnth\" (UniqueName: \"kubernetes.io/projected/d777d0ba-eb37-4c80-b6a4-0e743b4aecd6-kube-api-access-9lnth\") pod \"limitador-limitador-85d9db4d5d-bhfzj\" (UID: \"d777d0ba-eb37-4c80-b6a4-0e743b4aecd6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:30.496582 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.496562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:30.637729 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.637703    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:36:30.639052 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:36:30.639029    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd777d0ba_eb37_4c80_b6a4_0e743b4aecd6.slice/crio-941708511ae148a6c3f283858d46556120cb60bf09b82e2f4c0c4308e279326a WatchSource:0}: Error finding container 941708511ae148a6c3f283858d46556120cb60bf09b82e2f4c0c4308e279326a: Status 404 returned error can't find the container with id 941708511ae148a6c3f283858d46556120cb60bf09b82e2f4c0c4308e279326a
Aug 04 18:36:30.643500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.643481    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-l7c92"]
Aug 04 18:36:30.648225 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.648208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-l7c92"
Aug 04 18:36:30.650651 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.650633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tccw9\""
Aug 04 18:36:30.661249 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.661221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-l7c92"]
Aug 04 18:36:30.774847 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.774821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdl8w\" (UniqueName: \"kubernetes.io/projected/d859c03c-3618-43ad-912a-7d4ffce2f3d6-kube-api-access-hdl8w\") pod \"authorino-b54df94b4-l7c92\" (UID: \"d859c03c-3618-43ad-912a-7d4ffce2f3d6\") " pod="kuadrant-system/authorino-b54df94b4-l7c92"
Aug 04 18:36:30.821198 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.821165    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-sk7mk"]
Aug 04 18:36:30.824619 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.824596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-sk7mk"
Aug 04 18:36:30.835795 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.835751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-sk7mk"]
Aug 04 18:36:30.875588 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.875563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdl8w\" (UniqueName: \"kubernetes.io/projected/d859c03c-3618-43ad-912a-7d4ffce2f3d6-kube-api-access-hdl8w\") pod \"authorino-b54df94b4-l7c92\" (UID: \"d859c03c-3618-43ad-912a-7d4ffce2f3d6\") " pod="kuadrant-system/authorino-b54df94b4-l7c92"
Aug 04 18:36:30.887517 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.887490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdl8w\" (UniqueName: \"kubernetes.io/projected/d859c03c-3618-43ad-912a-7d4ffce2f3d6-kube-api-access-hdl8w\") pod \"authorino-b54df94b4-l7c92\" (UID: \"d859c03c-3618-43ad-912a-7d4ffce2f3d6\") " pod="kuadrant-system/authorino-b54df94b4-l7c92"
Aug 04 18:36:30.958018 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.957989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-l7c92"
Aug 04 18:36:30.976927 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:30.976904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqrrk\" (UniqueName: \"kubernetes.io/projected/c536c94a-6ed5-463d-ba28-fe7f8c22b1f3-kube-api-access-kqrrk\") pod \"authorino-c548b5d7d-sk7mk\" (UID: \"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3\") " pod="kuadrant-system/authorino-c548b5d7d-sk7mk"
Aug 04 18:36:31.078406 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:31.078376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqrrk\" (UniqueName: \"kubernetes.io/projected/c536c94a-6ed5-463d-ba28-fe7f8c22b1f3-kube-api-access-kqrrk\") pod \"authorino-c548b5d7d-sk7mk\" (UID: \"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3\") " pod="kuadrant-system/authorino-c548b5d7d-sk7mk"
Aug 04 18:36:31.085291 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:31.085235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj" event={"ID":"d777d0ba-eb37-4c80-b6a4-0e743b4aecd6","Type":"ContainerStarted","Data":"941708511ae148a6c3f283858d46556120cb60bf09b82e2f4c0c4308e279326a"}
Aug 04 18:36:31.087925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:31.087904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-l7c92"]
Aug 04 18:36:31.089671 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:36:31.089644    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd859c03c_3618_43ad_912a_7d4ffce2f3d6.slice/crio-f0e5a01c6bdacfcae139c46af5ca38ed5b4911ca40f7a9228b361dfcd498170a WatchSource:0}: Error finding container f0e5a01c6bdacfcae139c46af5ca38ed5b4911ca40f7a9228b361dfcd498170a: Status 404 returned error can't find the container with id f0e5a01c6bdacfcae139c46af5ca38ed5b4911ca40f7a9228b361dfcd498170a
Aug 04 18:36:31.090902 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:31.090884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqrrk\" (UniqueName: \"kubernetes.io/projected/c536c94a-6ed5-463d-ba28-fe7f8c22b1f3-kube-api-access-kqrrk\") pod \"authorino-c548b5d7d-sk7mk\" (UID: \"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3\") " pod="kuadrant-system/authorino-c548b5d7d-sk7mk"
Aug 04 18:36:31.134831 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:31.134808    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-sk7mk"
Aug 04 18:36:31.268343 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:31.268320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-sk7mk"]
Aug 04 18:36:31.269929 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:36:31.269903    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc536c94a_6ed5_463d_ba28_fe7f8c22b1f3.slice/crio-f91f2bf44f955560b08a8fa3b8bcacc4d50104370669849f510ae5d8589f401f WatchSource:0}: Error finding container f91f2bf44f955560b08a8fa3b8bcacc4d50104370669849f510ae5d8589f401f: Status 404 returned error can't find the container with id f91f2bf44f955560b08a8fa3b8bcacc4d50104370669849f510ae5d8589f401f
Aug 04 18:36:32.099153 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:32.099114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-sk7mk" event={"ID":"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3","Type":"ContainerStarted","Data":"f91f2bf44f955560b08a8fa3b8bcacc4d50104370669849f510ae5d8589f401f"}
Aug 04 18:36:32.100931 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:32.100902    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-l7c92" event={"ID":"d859c03c-3618-43ad-912a-7d4ffce2f3d6","Type":"ContainerStarted","Data":"f0e5a01c6bdacfcae139c46af5ca38ed5b4911ca40f7a9228b361dfcd498170a"}
Aug 04 18:36:34.115022 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:34.114974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-sk7mk" event={"ID":"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3","Type":"ContainerStarted","Data":"03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840"}
Aug 04 18:36:34.116504 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:34.116478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-l7c92" event={"ID":"d859c03c-3618-43ad-912a-7d4ffce2f3d6","Type":"ContainerStarted","Data":"34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103"}
Aug 04 18:36:34.118190 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:34.118163    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj" event={"ID":"d777d0ba-eb37-4c80-b6a4-0e743b4aecd6","Type":"ContainerStarted","Data":"57252e9ef367030c747957e5d27ccba96fcce2da3bf00079e61270a5c962f513"}
Aug 04 18:36:34.118286 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:34.118210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:36:34.133119 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:34.133079    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-sk7mk" podStartSLOduration=1.419133692 podStartE2EDuration="4.133064837s" totalImagesPullingTime="2.713931145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:34.130331997 +0000 UTC m=+505.098222556" watchObservedRunningTime="2026-08-04 18:36:34.133064837 +0000 UTC m=+505.100955401"
Aug 04 18:36:34.166327 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:34.166178    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-l7c92" podStartSLOduration=1.283672783 podStartE2EDuration="4.166158025s" totalImagesPullingTime="2.882485242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:34.155807152 +0000 UTC m=+505.123697700" watchObservedRunningTime="2026-08-04 18:36:34.166158025 +0000 UTC m=+505.134048572"
Aug 04 18:36:34.169966 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:34.169927    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-l7c92"]
Aug 04 18:36:34.184232 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:34.184175    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj" podStartSLOduration=0.851746306 podStartE2EDuration="4.184155264s" totalImagesPullingTime="3.332408958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:34.18337729 +0000 UTC m=+505.151267837" watchObservedRunningTime="2026-08-04 18:36:34.184155264 +0000 UTC m=+505.152045812"
Aug 04 18:36:36.128426 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:36.128386    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-l7c92" podUID="d859c03c-3618-43ad-912a-7d4ffce2f3d6" containerName="authorino" containerID="cri-o://34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103" gracePeriod=30
Aug 04 18:36:36.376943 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:36.376921    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-l7c92"
Aug 04 18:36:36.424632 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:36.424565    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdl8w\" (UniqueName: \"kubernetes.io/projected/d859c03c-3618-43ad-912a-7d4ffce2f3d6-kube-api-access-hdl8w\") pod \"d859c03c-3618-43ad-912a-7d4ffce2f3d6\" (UID: \"d859c03c-3618-43ad-912a-7d4ffce2f3d6\") "
Aug 04 18:36:36.426704 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:36.426667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d859c03c-3618-43ad-912a-7d4ffce2f3d6-kube-api-access-hdl8w" (OuterVolumeSpecName: "kube-api-access-hdl8w") pod "d859c03c-3618-43ad-912a-7d4ffce2f3d6" (UID: "d859c03c-3618-43ad-912a-7d4ffce2f3d6"). InnerVolumeSpecName "kube-api-access-hdl8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:36:36.525522 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:36.525483    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdl8w\" (UniqueName: \"kubernetes.io/projected/d859c03c-3618-43ad-912a-7d4ffce2f3d6-kube-api-access-hdl8w\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:36:37.135043 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.135012    2565 generic.go:356] "Generic (PLEG): container finished" podID="d859c03c-3618-43ad-912a-7d4ffce2f3d6" containerID="34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103" exitCode=0
Aug 04 18:36:37.135464 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.135049    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-l7c92"
Aug 04 18:36:37.135464 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.135102    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-l7c92" event={"ID":"d859c03c-3618-43ad-912a-7d4ffce2f3d6","Type":"ContainerDied","Data":"34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103"}
Aug 04 18:36:37.135464 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.135139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-l7c92" event={"ID":"d859c03c-3618-43ad-912a-7d4ffce2f3d6","Type":"ContainerDied","Data":"f0e5a01c6bdacfcae139c46af5ca38ed5b4911ca40f7a9228b361dfcd498170a"}
Aug 04 18:36:37.135464 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.135157    2565 scope.go:117] "RemoveContainer" containerID="34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103"
Aug 04 18:36:37.144189 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.144171    2565 scope.go:117] "RemoveContainer" containerID="34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103"
Aug 04 18:36:37.144430 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:36:37.144415    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103\": container with ID starting with 34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103 not found: ID does not exist" containerID="34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103"
Aug 04 18:36:37.144474 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.144438    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103"} err="failed to get container status \"34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103\": rpc error: code = NotFound desc = could not find container \"34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103\": container with ID starting with 34b47baa664321f495b1165e2804328aa312d0d8290e43524640132df0c0e103 not found: ID does not exist"
Aug 04 18:36:37.157168 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.157145    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-l7c92"]
Aug 04 18:36:37.160765 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.160745    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-l7c92"]
Aug 04 18:36:37.571177 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:37.571146    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d859c03c-3618-43ad-912a-7d4ffce2f3d6" path="/var/lib/kubelet/pods/d859c03c-3618-43ad-912a-7d4ffce2f3d6/volumes"
Aug 04 18:36:45.124278 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:36:45.124244    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"
Aug 04 18:37:03.744321 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.744238    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j9shc"]
Aug 04 18:37:03.744727 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.744667    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d859c03c-3618-43ad-912a-7d4ffce2f3d6" containerName="authorino"
Aug 04 18:37:03.744727 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.744682    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d859c03c-3618-43ad-912a-7d4ffce2f3d6" containerName="authorino"
Aug 04 18:37:03.744845 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.744760    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d859c03c-3618-43ad-912a-7d4ffce2f3d6" containerName="authorino"
Aug 04 18:37:03.747619 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.747603    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-j9shc"
Aug 04 18:37:03.755444 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.755423    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j9shc"]
Aug 04 18:37:03.861183 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.861149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt6lp\" (UniqueName: \"kubernetes.io/projected/00e4f1bf-61b2-41d7-8588-816570ade1e8-kube-api-access-rt6lp\") pod \"authorino-5dc7ccb5f-j9shc\" (UID: \"00e4f1bf-61b2-41d7-8588-816570ade1e8\") " pod="kuadrant-system/authorino-5dc7ccb5f-j9shc"
Aug 04 18:37:03.886687 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.886653    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j9shc"]
Aug 04 18:37:03.886977 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:37:03.886956    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rt6lp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-j9shc" podUID="00e4f1bf-61b2-41d7-8588-816570ade1e8"
Aug 04 18:37:03.916926 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.916894    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-sx7rf"]
Aug 04 18:37:03.920271 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.920249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:03.923501 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.923481    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 04 18:37:03.929479 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.929453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-sx7rf"]
Aug 04 18:37:03.962014 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.961992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt6lp\" (UniqueName: \"kubernetes.io/projected/00e4f1bf-61b2-41d7-8588-816570ade1e8-kube-api-access-rt6lp\") pod \"authorino-5dc7ccb5f-j9shc\" (UID: \"00e4f1bf-61b2-41d7-8588-816570ade1e8\") " pod="kuadrant-system/authorino-5dc7ccb5f-j9shc"
Aug 04 18:37:03.973822 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.973796    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-sx7rf"]
Aug 04 18:37:03.974066 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:37:03.974048    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7m5zx tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-7m5zx tls-cert]: context canceled" pod="kuadrant-system/authorino-687bd45585-sx7rf" podUID="a173b6e0-8c3f-490b-ab8a-f5664886ca11"
Aug 04 18:37:03.975209 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:03.975183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt6lp\" (UniqueName: \"kubernetes.io/projected/00e4f1bf-61b2-41d7-8588-816570ade1e8-kube-api-access-rt6lp\") pod \"authorino-5dc7ccb5f-j9shc\" (UID: \"00e4f1bf-61b2-41d7-8588-816570ade1e8\") " pod="kuadrant-system/authorino-5dc7ccb5f-j9shc"
Aug 04 18:37:04.004919 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.004841    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9c4db445d-tx9pm"]
Aug 04 18:37:04.008299 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.008276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:37:04.017201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.017178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9c4db445d-tx9pm"]
Aug 04 18:37:04.063286 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.063260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-tls-cert\") pod \"authorino-9c4db445d-tx9pm\" (UID: \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\") " pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:37:04.063427 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.063304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqq92\" (UniqueName: \"kubernetes.io/projected/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-kube-api-access-kqq92\") pod \"authorino-9c4db445d-tx9pm\" (UID: \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\") " pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:37:04.063427 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.063386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a173b6e0-8c3f-490b-ab8a-f5664886ca11-tls-cert\") pod \"authorino-687bd45585-sx7rf\" (UID: \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\") " pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:04.063517 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.063453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5zx\" (UniqueName: \"kubernetes.io/projected/a173b6e0-8c3f-490b-ab8a-f5664886ca11-kube-api-access-7m5zx\") pod \"authorino-687bd45585-sx7rf\" (UID: \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\") " pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:04.164540 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.164510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-tls-cert\") pod \"authorino-9c4db445d-tx9pm\" (UID: \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\") " pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:37:04.164691 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.164550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqq92\" (UniqueName: \"kubernetes.io/projected/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-kube-api-access-kqq92\") pod \"authorino-9c4db445d-tx9pm\" (UID: \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\") " pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:37:04.164691 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.164604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a173b6e0-8c3f-490b-ab8a-f5664886ca11-tls-cert\") pod \"authorino-687bd45585-sx7rf\" (UID: \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\") " pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:04.164691 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.164672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5zx\" (UniqueName: \"kubernetes.io/projected/a173b6e0-8c3f-490b-ab8a-f5664886ca11-kube-api-access-7m5zx\") pod \"authorino-687bd45585-sx7rf\" (UID: \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\") " pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:04.167113 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.167090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a173b6e0-8c3f-490b-ab8a-f5664886ca11-tls-cert\") pod \"authorino-687bd45585-sx7rf\" (UID: \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\") " pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:04.167201 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.167090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-tls-cert\") pod \"authorino-9c4db445d-tx9pm\" (UID: \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\") " pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:37:04.172921 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.172902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5zx\" (UniqueName: \"kubernetes.io/projected/a173b6e0-8c3f-490b-ab8a-f5664886ca11-kube-api-access-7m5zx\") pod \"authorino-687bd45585-sx7rf\" (UID: \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\") " pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:04.173143 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.173123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqq92\" (UniqueName: \"kubernetes.io/projected/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-kube-api-access-kqq92\") pod \"authorino-9c4db445d-tx9pm\" (UID: \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\") " pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:37:04.292916 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.292835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:04.293053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.292835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-j9shc"
Aug 04 18:37:04.300192 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.300172    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:04.303326 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.303308    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-j9shc"
Aug 04 18:37:04.319258 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.319233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:37:04.365880 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.365852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt6lp\" (UniqueName: \"kubernetes.io/projected/00e4f1bf-61b2-41d7-8588-816570ade1e8-kube-api-access-rt6lp\") pod \"00e4f1bf-61b2-41d7-8588-816570ade1e8\" (UID: \"00e4f1bf-61b2-41d7-8588-816570ade1e8\") "
Aug 04 18:37:04.366040 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.366001    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a173b6e0-8c3f-490b-ab8a-f5664886ca11-tls-cert\") pod \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\" (UID: \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\") "
Aug 04 18:37:04.366115 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.366049    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m5zx\" (UniqueName: \"kubernetes.io/projected/a173b6e0-8c3f-490b-ab8a-f5664886ca11-kube-api-access-7m5zx\") pod \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\" (UID: \"a173b6e0-8c3f-490b-ab8a-f5664886ca11\") "
Aug 04 18:37:04.369068 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.369012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e4f1bf-61b2-41d7-8588-816570ade1e8-kube-api-access-rt6lp" (OuterVolumeSpecName: "kube-api-access-rt6lp") pod "00e4f1bf-61b2-41d7-8588-816570ade1e8" (UID: "00e4f1bf-61b2-41d7-8588-816570ade1e8"). InnerVolumeSpecName "kube-api-access-rt6lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:37:04.369068 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.369012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a173b6e0-8c3f-490b-ab8a-f5664886ca11-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a173b6e0-8c3f-490b-ab8a-f5664886ca11" (UID: "a173b6e0-8c3f-490b-ab8a-f5664886ca11"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:37:04.369648 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.369619    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a173b6e0-8c3f-490b-ab8a-f5664886ca11-kube-api-access-7m5zx" (OuterVolumeSpecName: "kube-api-access-7m5zx") pod "a173b6e0-8c3f-490b-ab8a-f5664886ca11" (UID: "a173b6e0-8c3f-490b-ab8a-f5664886ca11"). InnerVolumeSpecName "kube-api-access-7m5zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:37:04.448190 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.448164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9c4db445d-tx9pm"]
Aug 04 18:37:04.449908 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:37:04.449882    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f9fd262_4dc8_45ff_b308_a7a4b4c9f69a.slice/crio-255c206803d56b2a11981aa0e4e4928a9e6df37858e48c2e13d9fcd4c64a345c WatchSource:0}: Error finding container 255c206803d56b2a11981aa0e4e4928a9e6df37858e48c2e13d9fcd4c64a345c: Status 404 returned error can't find the container with id 255c206803d56b2a11981aa0e4e4928a9e6df37858e48c2e13d9fcd4c64a345c
Aug 04 18:37:04.467526 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.467505    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt6lp\" (UniqueName: \"kubernetes.io/projected/00e4f1bf-61b2-41d7-8588-816570ade1e8-kube-api-access-rt6lp\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:37:04.467622 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.467528    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a173b6e0-8c3f-490b-ab8a-f5664886ca11-tls-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:37:04.467622 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:04.467540    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m5zx\" (UniqueName: \"kubernetes.io/projected/a173b6e0-8c3f-490b-ab8a-f5664886ca11-kube-api-access-7m5zx\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:37:05.300924 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.300886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c4db445d-tx9pm" event={"ID":"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a","Type":"ContainerStarted","Data":"d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e"}
Aug 04 18:37:05.301351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.300933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c4db445d-tx9pm" event={"ID":"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a","Type":"ContainerStarted","Data":"255c206803d56b2a11981aa0e4e4928a9e6df37858e48c2e13d9fcd4c64a345c"}
Aug 04 18:37:05.301351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.300936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-sx7rf"
Aug 04 18:37:05.301351 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.301120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-j9shc"
Aug 04 18:37:05.320917 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.320871    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9c4db445d-tx9pm" podStartSLOduration=1.595341946 podStartE2EDuration="2.320853402s" totalImagesPullingTime="725.511456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:37:05.318518219 +0000 UTC m=+536.286408766" watchObservedRunningTime="2026-08-04 18:37:05.320853402 +0000 UTC m=+536.288743948"
Aug 04 18:37:05.352791 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.352742    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j9shc"]
Aug 04 18:37:05.360142 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.360111    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-sk7mk"]
Aug 04 18:37:05.360324 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.360299    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-sk7mk" podUID="c536c94a-6ed5-463d-ba28-fe7f8c22b1f3" containerName="authorino" containerID="cri-o://03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840" gracePeriod=30
Aug 04 18:37:05.363177 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.363145    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j9shc"]
Aug 04 18:37:05.386469 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.386444    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-sx7rf"]
Aug 04 18:37:05.390205 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.390180    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-sx7rf"]
Aug 04 18:37:05.570496 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.570469    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e4f1bf-61b2-41d7-8588-816570ade1e8" path="/var/lib/kubelet/pods/00e4f1bf-61b2-41d7-8588-816570ade1e8/volumes"
Aug 04 18:37:05.570733 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.570722    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a173b6e0-8c3f-490b-ab8a-f5664886ca11" path="/var/lib/kubelet/pods/a173b6e0-8c3f-490b-ab8a-f5664886ca11/volumes"
Aug 04 18:37:05.597019 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.596991    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-sk7mk"
Aug 04 18:37:05.678803 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.678738    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqrrk\" (UniqueName: \"kubernetes.io/projected/c536c94a-6ed5-463d-ba28-fe7f8c22b1f3-kube-api-access-kqrrk\") pod \"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3\" (UID: \"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3\") "
Aug 04 18:37:05.680735 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.680715    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c536c94a-6ed5-463d-ba28-fe7f8c22b1f3-kube-api-access-kqrrk" (OuterVolumeSpecName: "kube-api-access-kqrrk") pod "c536c94a-6ed5-463d-ba28-fe7f8c22b1f3" (UID: "c536c94a-6ed5-463d-ba28-fe7f8c22b1f3"). InnerVolumeSpecName "kube-api-access-kqrrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:37:05.780197 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:05.780126    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqrrk\" (UniqueName: \"kubernetes.io/projected/c536c94a-6ed5-463d-ba28-fe7f8c22b1f3-kube-api-access-kqrrk\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:37:06.307826 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.307771    2565 generic.go:356] "Generic (PLEG): container finished" podID="c536c94a-6ed5-463d-ba28-fe7f8c22b1f3" containerID="03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840" exitCode=0
Aug 04 18:37:06.308221 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.307845    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-sk7mk"
Aug 04 18:37:06.308221 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.307868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-sk7mk" event={"ID":"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3","Type":"ContainerDied","Data":"03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840"}
Aug 04 18:37:06.308221 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.307914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-sk7mk" event={"ID":"c536c94a-6ed5-463d-ba28-fe7f8c22b1f3","Type":"ContainerDied","Data":"f91f2bf44f955560b08a8fa3b8bcacc4d50104370669849f510ae5d8589f401f"}
Aug 04 18:37:06.308221 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.307930    2565 scope.go:117] "RemoveContainer" containerID="03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840"
Aug 04 18:37:06.316730 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.316714    2565 scope.go:117] "RemoveContainer" containerID="03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840"
Aug 04 18:37:06.317000 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:37:06.316983    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840\": container with ID starting with 03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840 not found: ID does not exist" containerID="03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840"
Aug 04 18:37:06.317054 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.317007    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840"} err="failed to get container status \"03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840\": rpc error: code = NotFound desc = could not find container \"03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840\": container with ID starting with 03016dba5a9d456087af476b469d6dfc21d63189204841171296bcffc0bf0840 not found: ID does not exist"
Aug 04 18:37:06.329544 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.329524    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-sk7mk"]
Aug 04 18:37:06.332811 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:06.332785    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-sk7mk"]
Aug 04 18:37:07.570824 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:07.570769    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c536c94a-6ed5-463d-ba28-fe7f8c22b1f3" path="/var/lib/kubelet/pods/c536c94a-6ed5-463d-ba28-fe7f8c22b1f3/volumes"
Aug 04 18:37:44.712935 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:37:44.712899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:38:03.478900 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:38:03.478862    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:38:08.275706 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:38:08.275667    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:38:09.465735 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:38:09.465708    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:38:09.466759 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:38:09.466741    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:38:33.471243 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:38:33.471167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:38:44.788319 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:38:44.788284    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:38:54.678053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:38:54.678014    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:39:06.995130 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:06.995092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:39:51.536129 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.536093    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-797987f455-r98w2"]
Aug 04 18:39:51.536551 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.536531    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c536c94a-6ed5-463d-ba28-fe7f8c22b1f3" containerName="authorino"
Aug 04 18:39:51.536551 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.536546    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c536c94a-6ed5-463d-ba28-fe7f8c22b1f3" containerName="authorino"
Aug 04 18:39:51.536651 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.536631    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c536c94a-6ed5-463d-ba28-fe7f8c22b1f3" containerName="authorino"
Aug 04 18:39:51.539761 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.539743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-797987f455-r98w2"
Aug 04 18:39:51.550174 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.550143    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-797987f455-r98w2"]
Aug 04 18:39:51.553988 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.553970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvqbj\" (UniqueName: \"kubernetes.io/projected/8f05f902-7e8f-4e49-8fd8-41f6754e7a9c-kube-api-access-cvqbj\") pod \"authorino-797987f455-r98w2\" (UID: \"8f05f902-7e8f-4e49-8fd8-41f6754e7a9c\") " pod="kuadrant-system/authorino-797987f455-r98w2"
Aug 04 18:39:51.554095 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.553997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f05f902-7e8f-4e49-8fd8-41f6754e7a9c-tls-cert\") pod \"authorino-797987f455-r98w2\" (UID: \"8f05f902-7e8f-4e49-8fd8-41f6754e7a9c\") " pod="kuadrant-system/authorino-797987f455-r98w2"
Aug 04 18:39:51.654743 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.654710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvqbj\" (UniqueName: \"kubernetes.io/projected/8f05f902-7e8f-4e49-8fd8-41f6754e7a9c-kube-api-access-cvqbj\") pod \"authorino-797987f455-r98w2\" (UID: \"8f05f902-7e8f-4e49-8fd8-41f6754e7a9c\") " pod="kuadrant-system/authorino-797987f455-r98w2"
Aug 04 18:39:51.654925 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.654746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f05f902-7e8f-4e49-8fd8-41f6754e7a9c-tls-cert\") pod \"authorino-797987f455-r98w2\" (UID: \"8f05f902-7e8f-4e49-8fd8-41f6754e7a9c\") " pod="kuadrant-system/authorino-797987f455-r98w2"
Aug 04 18:39:51.657162 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.657140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f05f902-7e8f-4e49-8fd8-41f6754e7a9c-tls-cert\") pod \"authorino-797987f455-r98w2\" (UID: \"8f05f902-7e8f-4e49-8fd8-41f6754e7a9c\") " pod="kuadrant-system/authorino-797987f455-r98w2"
Aug 04 18:39:51.666891 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.666850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvqbj\" (UniqueName: \"kubernetes.io/projected/8f05f902-7e8f-4e49-8fd8-41f6754e7a9c-kube-api-access-cvqbj\") pod \"authorino-797987f455-r98w2\" (UID: \"8f05f902-7e8f-4e49-8fd8-41f6754e7a9c\") " pod="kuadrant-system/authorino-797987f455-r98w2"
Aug 04 18:39:51.849218 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.849143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-797987f455-r98w2"
Aug 04 18:39:51.988241 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.988212    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-797987f455-r98w2"]
Aug 04 18:39:51.990260 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:39:51.990200    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f05f902_7e8f_4e49_8fd8_41f6754e7a9c.slice/crio-81086b9d0ce101f1b53be9c06faa05be6bf52e712c6d479ba261ddaa563761fa WatchSource:0}: Error finding container 81086b9d0ce101f1b53be9c06faa05be6bf52e712c6d479ba261ddaa563761fa: Status 404 returned error can't find the container with id 81086b9d0ce101f1b53be9c06faa05be6bf52e712c6d479ba261ddaa563761fa
Aug 04 18:39:51.993826 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:51.993805    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:39:52.201808 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:52.201714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-797987f455-r98w2" event={"ID":"8f05f902-7e8f-4e49-8fd8-41f6754e7a9c","Type":"ContainerStarted","Data":"81086b9d0ce101f1b53be9c06faa05be6bf52e712c6d479ba261ddaa563761fa"}
Aug 04 18:39:54.217113 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.217076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-797987f455-r98w2" event={"ID":"8f05f902-7e8f-4e49-8fd8-41f6754e7a9c","Type":"ContainerStarted","Data":"f19c77ce228cad4b6435b8f1b80968af12b130e2fecd06f7e60d18d3cbf23cb6"}
Aug 04 18:39:54.243528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.243475    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-797987f455-r98w2" podStartSLOduration=2.090304988 podStartE2EDuration="3.243457351s" totalImagesPullingTime="1.153152363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:39:54.241806743 +0000 UTC m=+705.209697291" watchObservedRunningTime="2026-08-04 18:39:54.243457351 +0000 UTC m=+705.211347888"
Aug 04 18:39:54.284321 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.284284    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9c4db445d-tx9pm"]
Aug 04 18:39:54.284500 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.284468    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-9c4db445d-tx9pm" podUID="8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a" containerName="authorino" containerID="cri-o://d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e" gracePeriod=30
Aug 04 18:39:54.541711 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.541687    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:39:54.584719 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.584678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-tls-cert\") pod \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\" (UID: \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\") "
Aug 04 18:39:54.584932 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.584748    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqq92\" (UniqueName: \"kubernetes.io/projected/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-kube-api-access-kqq92\") pod \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\" (UID: \"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a\") "
Aug 04 18:39:54.586929 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.586889    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-kube-api-access-kqq92" (OuterVolumeSpecName: "kube-api-access-kqq92") pod "8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a" (UID: "8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a"). InnerVolumeSpecName "kube-api-access-kqq92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:39:54.595395 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.595365    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a" (UID: "8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:39:54.686276 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.686235    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-tls-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:39:54.686276 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:54.686266    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqq92\" (UniqueName: \"kubernetes.io/projected/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a-kube-api-access-kqq92\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:39:55.223648 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.223610    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a" containerID="d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e" exitCode=0
Aug 04 18:39:55.223648 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.223655    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c4db445d-tx9pm"
Aug 04 18:39:55.224308 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.223694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c4db445d-tx9pm" event={"ID":"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a","Type":"ContainerDied","Data":"d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e"}
Aug 04 18:39:55.224308 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.223740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c4db445d-tx9pm" event={"ID":"8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a","Type":"ContainerDied","Data":"255c206803d56b2a11981aa0e4e4928a9e6df37858e48c2e13d9fcd4c64a345c"}
Aug 04 18:39:55.224308 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.223764    2565 scope.go:117] "RemoveContainer" containerID="d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e"
Aug 04 18:39:55.233387 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.233370    2565 scope.go:117] "RemoveContainer" containerID="d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e"
Aug 04 18:39:55.233649 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:39:55.233632    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e\": container with ID starting with d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e not found: ID does not exist" containerID="d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e"
Aug 04 18:39:55.233701 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.233658    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e"} err="failed to get container status \"d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e\": rpc error: code = NotFound desc = could not find container \"d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e\": container with ID starting with d439e7133580ba03de23e750895db1f298cd3bd45a0b217d9067658fc6e7b60e not found: ID does not exist"
Aug 04 18:39:55.248470 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.248444    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9c4db445d-tx9pm"]
Aug 04 18:39:55.252075 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.252053    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9c4db445d-tx9pm"]
Aug 04 18:39:55.323585 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.323559    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c6dccd5b-8lcqb"]
Aug 04 18:39:55.324055 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.324038    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a" containerName="authorino"
Aug 04 18:39:55.324055 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.324054    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a" containerName="authorino"
Aug 04 18:39:55.324186 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.324124    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a" containerName="authorino"
Aug 04 18:39:55.328429 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.328412    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.339487 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.339465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c6dccd5b-8lcqb"]
Aug 04 18:39:55.393828 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.393801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhxq5\" (UniqueName: \"kubernetes.io/projected/9e9b08c1-58b7-47eb-802a-1263ebfdded1-kube-api-access-dhxq5\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.393828 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.393830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-config\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.394003 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.393846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-service-ca\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.394003 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.393868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-trusted-ca-bundle\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.394003 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.393948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-serving-cert\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.394003 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.393974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-oauth-serving-cert\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.394003 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.393991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-oauth-config\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.494823 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.494794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhxq5\" (UniqueName: \"kubernetes.io/projected/9e9b08c1-58b7-47eb-802a-1263ebfdded1-kube-api-access-dhxq5\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.494961 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.494829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-config\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.494961 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.494845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-service-ca\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.495033 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.494973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-trusted-ca-bundle\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.495075 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.495047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-serving-cert\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.495131 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.495074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-oauth-serving-cert\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.495131 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.495106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-oauth-config\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.495610 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.495583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-config\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.495718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.495583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-service-ca\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.495789 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.495730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-oauth-serving-cert\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.495789 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.495767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9b08c1-58b7-47eb-802a-1263ebfdded1-trusted-ca-bundle\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.497499 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.497469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-oauth-config\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.497586 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.497480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e9b08c1-58b7-47eb-802a-1263ebfdded1-console-serving-cert\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.503842 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.503823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhxq5\" (UniqueName: \"kubernetes.io/projected/9e9b08c1-58b7-47eb-802a-1263ebfdded1-kube-api-access-dhxq5\") pod \"console-54c6dccd5b-8lcqb\" (UID: \"9e9b08c1-58b7-47eb-802a-1263ebfdded1\") " pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.570762 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.570734    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a" path="/var/lib/kubelet/pods/8f9fd262-4dc8-45ff-b308-a7a4b4c9f69a/volumes"
Aug 04 18:39:55.638933 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.638905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:39:55.775577 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:55.775554    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c6dccd5b-8lcqb"]
Aug 04 18:39:55.776799 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:39:55.776749    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9b08c1_58b7_47eb_802a_1263ebfdded1.slice/crio-4d54c71f376972e3168a7eda29a7c5ab770b1bf8b4e121f75f08c07f44287a88 WatchSource:0}: Error finding container 4d54c71f376972e3168a7eda29a7c5ab770b1bf8b4e121f75f08c07f44287a88: Status 404 returned error can't find the container with id 4d54c71f376972e3168a7eda29a7c5ab770b1bf8b4e121f75f08c07f44287a88
Aug 04 18:39:56.230750 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:56.230644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c6dccd5b-8lcqb" event={"ID":"9e9b08c1-58b7-47eb-802a-1263ebfdded1","Type":"ContainerStarted","Data":"7a40e4b881d44c57f42f81455b4541d4f049d74c9dbc578085c9e87e18952558"}
Aug 04 18:39:56.230750 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:39:56.230704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c6dccd5b-8lcqb" event={"ID":"9e9b08c1-58b7-47eb-802a-1263ebfdded1","Type":"ContainerStarted","Data":"4d54c71f376972e3168a7eda29a7c5ab770b1bf8b4e121f75f08c07f44287a88"}
Aug 04 18:40:05.639347 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:05.639271    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:40:05.639347 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:05.639336    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:40:05.644166 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:05.644141    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:40:05.666532 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:05.666491    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54c6dccd5b-8lcqb" podStartSLOduration=10.666476751 podStartE2EDuration="10.666476751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:39:56.258106486 +0000 UTC m=+707.225997032" watchObservedRunningTime="2026-08-04 18:40:05.666476751 +0000 UTC m=+716.634367296"
Aug 04 18:40:06.292544 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:06.292518    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c6dccd5b-8lcqb"
Aug 04 18:40:06.343167 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:06.343132    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f745cc79-lp8m5"]
Aug 04 18:40:22.293049 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:22.293013    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:40:31.363612 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.363563    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76f745cc79-lp8m5" podUID="1b064a1a-9c55-4ce8-affe-455aefd9e7e2" containerName="console" containerID="cri-o://0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84" gracePeriod=15
Aug 04 18:40:31.619785 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.619717    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:40:31.631204 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631184    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-service-ca\") pod \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") "
Aug 04 18:40:31.631286 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631237    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-serving-cert\") pod \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") "
Aug 04 18:40:31.631286 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631256    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-config\") pod \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") "
Aug 04 18:40:31.631408 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631386    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-oauth-serving-cert\") pod \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") "
Aug 04 18:40:31.631468 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631435    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcx9l\" (UniqueName: \"kubernetes.io/projected/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-kube-api-access-zcx9l\") pod \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") "
Aug 04 18:40:31.631524 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-trusted-ca-bundle\") pod \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") "
Aug 04 18:40:31.631580 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631527    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-service-ca" (OuterVolumeSpecName: "service-ca") pod "1b064a1a-9c55-4ce8-affe-455aefd9e7e2" (UID: "1b064a1a-9c55-4ce8-affe-455aefd9e7e2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:40:31.631580 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631536    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-config" (OuterVolumeSpecName: "console-config") pod "1b064a1a-9c55-4ce8-affe-455aefd9e7e2" (UID: "1b064a1a-9c55-4ce8-affe-455aefd9e7e2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:40:31.631702 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631584    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-oauth-config\") pod \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\" (UID: \"1b064a1a-9c55-4ce8-affe-455aefd9e7e2\") "
Aug 04 18:40:31.631827 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631802    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1b064a1a-9c55-4ce8-affe-455aefd9e7e2" (UID: "1b064a1a-9c55-4ce8-affe-455aefd9e7e2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:40:31.631962 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631880    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1b064a1a-9c55-4ce8-affe-455aefd9e7e2" (UID: "1b064a1a-9c55-4ce8-affe-455aefd9e7e2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:40:31.631962 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631930    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:40:31.631962 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631948    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-config\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:40:31.632137 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.631969    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-oauth-serving-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:40:31.633388 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.633365    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1b064a1a-9c55-4ce8-affe-455aefd9e7e2" (UID: "1b064a1a-9c55-4ce8-affe-455aefd9e7e2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:40:31.633583 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.633564    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1b064a1a-9c55-4ce8-affe-455aefd9e7e2" (UID: "1b064a1a-9c55-4ce8-affe-455aefd9e7e2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:40:31.633651 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.633636    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-kube-api-access-zcx9l" (OuterVolumeSpecName: "kube-api-access-zcx9l") pod "1b064a1a-9c55-4ce8-affe-455aefd9e7e2" (UID: "1b064a1a-9c55-4ce8-affe-455aefd9e7e2"). InnerVolumeSpecName "kube-api-access-zcx9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:40:31.732466 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.732433    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-oauth-config\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:40:31.732466 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.732459    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-console-serving-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:40:31.732466 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.732469    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcx9l\" (UniqueName: \"kubernetes.io/projected/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-kube-api-access-zcx9l\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:40:31.732466 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.732478    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b064a1a-9c55-4ce8-affe-455aefd9e7e2-trusted-ca-bundle\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:40:31.989528 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:31.989499    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:40:32.430038 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.429947    2565 generic.go:356] "Generic (PLEG): container finished" podID="1b064a1a-9c55-4ce8-affe-455aefd9e7e2" containerID="0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84" exitCode=0
Aug 04 18:40:32.430038 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.429996    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f745cc79-lp8m5"
Aug 04 18:40:32.430514 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.430035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f745cc79-lp8m5" event={"ID":"1b064a1a-9c55-4ce8-affe-455aefd9e7e2","Type":"ContainerDied","Data":"0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84"}
Aug 04 18:40:32.430514 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.430089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f745cc79-lp8m5" event={"ID":"1b064a1a-9c55-4ce8-affe-455aefd9e7e2","Type":"ContainerDied","Data":"32c2ad9e96141da78d9a1e23e73674b763af05055a58ee957e236f1a0b9b86d5"}
Aug 04 18:40:32.430514 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.430111    2565 scope.go:117] "RemoveContainer" containerID="0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84"
Aug 04 18:40:32.439582 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.439567    2565 scope.go:117] "RemoveContainer" containerID="0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84"
Aug 04 18:40:32.439906 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:40:32.439889    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84\": container with ID starting with 0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84 not found: ID does not exist" containerID="0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84"
Aug 04 18:40:32.439954 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.439915    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84"} err="failed to get container status \"0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84\": rpc error: code = NotFound desc = could not find container \"0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84\": container with ID starting with 0c9b92adf6ca200422b36dd0207276031fc5999a2f202d2c139bc74f7067ee84 not found: ID does not exist"
Aug 04 18:40:32.452226 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.452205    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f745cc79-lp8m5"]
Aug 04 18:40:32.456544 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:32.456523    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76f745cc79-lp8m5"]
Aug 04 18:40:33.570659 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:33.570624    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b064a1a-9c55-4ce8-affe-455aefd9e7e2" path="/var/lib/kubelet/pods/1b064a1a-9c55-4ce8-affe-455aefd9e7e2/volumes"
Aug 04 18:40:43.298546 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:40:43.298515    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:42:23.282794 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:42:23.282738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:42:33.386262 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:42:33.386223    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:43:09.505615 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:43:09.505523    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:43:09.507568 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:43:09.507548    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:43:31.494109 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:43:31.494070    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:43:38.986974 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:43:38.986935    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:43:53.977140 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:43:53.977099    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:43:59.883312 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:43:59.883271    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:44:09.480451 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:44:09.480416    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:44:17.488215 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:44:17.488174    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:44:29.980184 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:44:29.980145    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:44:34.871662 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:44:34.871572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:44:42.294888 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:44:42.294853    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:44:52.179008 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:44:52.178970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:44:58.086283 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:44:58.086238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:45:00.145964 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.145921    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz"]
Aug 04 18:45:00.146544 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.146525    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b064a1a-9c55-4ce8-affe-455aefd9e7e2" containerName="console"
Aug 04 18:45:00.146604 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.146547    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b064a1a-9c55-4ce8-affe-455aefd9e7e2" containerName="console"
Aug 04 18:45:00.146642 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.146631    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b064a1a-9c55-4ce8-affe-455aefd9e7e2" containerName="console"
Aug 04 18:45:00.149734 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.149717    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz"
Aug 04 18:45:00.152596 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.152569    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 18:45:00.159280 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.159260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz"
Aug 04 18:45:00.172566 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.172542    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz"]
Aug 04 18:45:00.302757 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.302733    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz"]
Aug 04 18:45:00.304348 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:45:00.304320    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9593a7b2_a774_4dec_855e_db33e206de14.slice/crio-3e19aba4f9736381f0b0f757477fed53456401f400d806c057c0a89249391ce7 WatchSource:0}: Error finding container 3e19aba4f9736381f0b0f757477fed53456401f400d806c057c0a89249391ce7: Status 404 returned error can't find the container with id 3e19aba4f9736381f0b0f757477fed53456401f400d806c057c0a89249391ce7
Aug 04 18:45:00.306316 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.306300    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:45:00.896687 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:00.896652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz" event={"ID":"9593a7b2-a774-4dec-855e-db33e206de14","Type":"ContainerStarted","Data":"3e19aba4f9736381f0b0f757477fed53456401f400d806c057c0a89249391ce7"}
Aug 04 18:45:02.909263 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:02.909226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz" event={"ID":"9593a7b2-a774-4dec-855e-db33e206de14","Type":"ContainerStarted","Data":"e8c84b32d40b804aad340153c1d09739b09bbf0ab65c7e7c6cd4c84b1ebb66fb"}
Aug 04 18:45:02.927144 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:02.927097    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz" podStartSLOduration=0.816316721 podStartE2EDuration="2.927083508s" totalImagesPullingTime="2.110766787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:02.925410925 +0000 UTC m=+1013.893301474" watchObservedRunningTime="2026-08-04 18:45:02.927083508 +0000 UTC m=+1013.894974056"
Aug 04 18:45:03.916398 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:03.916357    2565 generic.go:356] "Generic (PLEG): container finished" podID="9593a7b2-a774-4dec-855e-db33e206de14" containerID="e8c84b32d40b804aad340153c1d09739b09bbf0ab65c7e7c6cd4c84b1ebb66fb" exitCode=0
Aug 04 18:45:03.916880 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:03.916419    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz" event={"ID":"9593a7b2-a774-4dec-855e-db33e206de14","Type":"ContainerDied","Data":"e8c84b32d40b804aad340153c1d09739b09bbf0ab65c7e7c6cd4c84b1ebb66fb"}
Aug 04 18:45:05.063682 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:05.063655    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz"
Aug 04 18:45:05.937391 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:05.937293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz" event={"ID":"9593a7b2-a774-4dec-855e-db33e206de14","Type":"ContainerDied","Data":"3e19aba4f9736381f0b0f757477fed53456401f400d806c057c0a89249391ce7"}
Aug 04 18:45:05.937391 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:05.937312    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-pjqcz"
Aug 04 18:45:05.937391 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:05.937376    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e19aba4f9736381f0b0f757477fed53456401f400d806c057c0a89249391ce7"
Aug 04 18:45:08.081686 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:08.081649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:45:19.084042 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:19.084007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:45:42.377720 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:42.377683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:45:52.786786 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:52.782407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:45:57.487557 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:45:57.487521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:46:05.878514 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:46:05.878429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:46:12.987264 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:46:12.987221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:46:18.092218 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:46:18.092179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:46:23.789058 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:46:23.789019    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:46:31.090739 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:46:31.090702    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:46:45.176563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:46:45.176529    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:46:50.184566 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:46:50.184521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:47:01.126608 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:47:01.126568    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:47:06.222898 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:47:06.222861    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:47:12.493478 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:47:12.493440    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:47:21.321860 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:47:21.321822    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:47:26.105666 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:47:26.105628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:47:37.001472 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:47:37.001371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:48:09.548924 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:48:09.548897    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:48:09.552534 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:48:09.552512    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:49:52.174602 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:49:52.174567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:49:57.352651 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:49:57.352607    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:50:23.677614 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:50:23.677580    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:50:32.593306 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:50:32.593224    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:50:39.592057 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:50:39.592017    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:50:47.576486 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:50:47.576453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:50:53.683546 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:50:53.683506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:51:02.887308 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:51:02.887266    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:51:09.435691 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:51:09.435651    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:51:18.288901 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:51:18.288861    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:51:23.288132 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:51:23.288093    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:51:33.477126 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:51:33.477088    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:51:40.072834 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:51:40.072794    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:51:49.292749 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:51:49.292707    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:52:11.672757 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:52:11.672668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:52:19.300216 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:52:19.300179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:52:45.899238 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:52:45.899187    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:53:01.398673 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:53:01.398637    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:53:09.589614 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:53:09.589588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:53:09.593464 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:53:09.593440    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:53:39.118132 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:53:39.118084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:53:51.094835 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:53:51.094793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:53:55.186332 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:53:55.186296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:54:04.379375 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:54:04.379337    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:54:11.097566 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:54:11.097533    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:54:18.693292 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:54:18.693253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:54:24.809099 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:54:24.809061    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:54:33.186402 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:54:33.186367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:54:45.887917 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:54:45.887881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:54:52.896405 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:54:52.896370    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:55:10.526799 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:55:10.526713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:55:15.398585 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:55:15.398553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:55:29.209855 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:55:29.209821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:55:34.382676 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:55:34.382636    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:55:40.911066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:55:40.911036    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:55:47.241160 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:55:47.241121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:55:54.194675 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:55:54.194642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:56:03.698622 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:56:03.698586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:56:11.194469 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:56:11.194427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:56:20.786032 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:56:20.785992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:56:30.675376 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:56:30.675279    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:56:36.029713 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:56:36.029671    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:56:50.782152 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:56:50.782104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:56:56.784582 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:56:56.784545    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:57:03.485039 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:03.484990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:57:14.597000 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:14.596957    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:57:23.784938 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:23.784894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:57:32.985718 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:32.985672    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:57:36.923376 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:36.923331    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"]
Aug 04 18:57:36.923948 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:36.923927    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9593a7b2-a774-4dec-855e-db33e206de14" containerName="cleanup"
Aug 04 18:57:36.924041 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:36.923951    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9593a7b2-a774-4dec-855e-db33e206de14" containerName="cleanup"
Aug 04 18:57:36.924098 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:36.924081    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9593a7b2-a774-4dec-855e-db33e206de14" containerName="cleanup"
Aug 04 18:57:36.926704 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:36.926680    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:36.929456 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:36.929420    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 18:57:36.929761 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:36.929745    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-93cfcc2b-openshift-default-dockercfg-nmgjl\""
Aug 04 18:57:36.961166 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:36.961130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"]
Aug 04 18:57:37.030923 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.030884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-socket\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.031136 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.030946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-data\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.031136 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.031004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-certs\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.031136 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.031078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdct\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-kube-api-access-vcdct\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.031277 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.031137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-envoy\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.031277 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.031157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istiod-ca-cert\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.031277 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.031199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-podinfo\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.031277 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.031269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-token\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.031429 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.031298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-credential-socket\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.132739 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.132698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-socket\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.132739 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.132745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-data\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133036 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.132805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-certs\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133036 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.132845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdct\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-kube-api-access-vcdct\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133036 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.132879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-envoy\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133036 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istiod-ca-cert\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133261 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-podinfo\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133261 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-token\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133261 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-credential-socket\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133261 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-data\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133486 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-certs\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133486 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-socket\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133602 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-credential-socket\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.133843 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.133825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istiod-ca-cert\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.135247 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.135220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-envoy\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.135493 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.135475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-podinfo\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.141612 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.141593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-token\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.141945 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.141921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdct\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-kube-api-access-vcdct\") pod \"e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") " pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.237657 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.237623    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:37.394089 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.394056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"]
Aug 04 18:57:37.396650 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:57:37.396610    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2fde0cf_a261_480d_8cb1_3ea264eb5d18.slice/crio-11a087924139a196fde2eb25fc02d1b5878bff9f6b81c641fe9326be370d926d WatchSource:0}: Error finding container 11a087924139a196fde2eb25fc02d1b5878bff9f6b81c641fe9326be370d926d: Status 404 returned error can't find the container with id 11a087924139a196fde2eb25fc02d1b5878bff9f6b81c641fe9326be370d926d
Aug 04 18:57:37.398670 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:37.398652    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:57:38.188770 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:38.188730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" event={"ID":"e2fde0cf-a261-480d-8cb1-3ea264eb5d18","Type":"ContainerStarted","Data":"11a087924139a196fde2eb25fc02d1b5878bff9f6b81c641fe9326be370d926d"}
Aug 04 18:57:42.466992 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:42.466945    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:57:42.467268 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:42.467030    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:57:42.467268 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:42.467059    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:57:43.233037 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:43.232912    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" event={"ID":"e2fde0cf-a261-480d-8cb1-3ea264eb5d18","Type":"ContainerStarted","Data":"1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6"}
Aug 04 18:57:43.238668 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:43.238633    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:43.244180 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:43.244145    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:43.259068 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:43.259010    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" podStartSLOduration=2.191223649 podStartE2EDuration="7.258993175s" totalImagesPullingTime="5.067769526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:57:43.256413072 +0000 UTC m=+1774.224303618" watchObservedRunningTime="2026-08-04 18:57:43.258993175 +0000 UTC m=+1774.226883721"
Aug 04 18:57:44.238223 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:44.238195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:44.239427 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:44.239401    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:57:49.385627 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:49.385591    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:57:59.630163 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:59.630120    2565 patch_prober.go:28] interesting pod/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:33944->10.134.0.50:15021: read: connection reset by peer" start-of-body=
Aug 04 18:57:59.630563 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:57:59.630211    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:33944->10.134.0.50:15021: read: connection reset by peer"
Aug 04 18:58:00.343121 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:00.343084    2565 generic.go:356] "Generic (PLEG): container finished" podID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerID="1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6" exitCode=0
Aug 04 18:58:00.343315 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:00.343155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" event={"ID":"e2fde0cf-a261-480d-8cb1-3ea264eb5d18","Type":"ContainerDied","Data":"1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6"}
Aug 04 18:58:00.343568 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:00.343555    2565 scope.go:117] "RemoveContainer" containerID="1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6"
Aug 04 18:58:00.345604 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:00.345571    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:58:00.345690 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:00.345662    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:58:00.345727 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:00.345693    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:58:01.358819 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:01.358722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" event={"ID":"e2fde0cf-a261-480d-8cb1-3ea264eb5d18","Type":"ContainerStarted","Data":"9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23"}
Aug 04 18:58:02.238858 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:02.238821    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:58:02.239113 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:02.239090    2565 patch_prober.go:28] interesting pod/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 18:58:02.239167 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:02.239147    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 18:58:03.238516 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:03.238475    2565 patch_prober.go:28] interesting pod/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 18:58:03.238951 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:03.238534    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 18:58:04.238884 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:04.238845    2565 patch_prober.go:28] interesting pod/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 18:58:04.239295 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:04.238905    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 18:58:05.238859 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:05.238820    2565 patch_prober.go:28] interesting pod/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 18:58:05.239053 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:05.238875    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 18:58:06.238281 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:06.238239    2565 patch_prober.go:28] interesting pod/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 18:58:06.238481 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:06.238305    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 18:58:07.242049 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:07.242014    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:58:07.242457 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:07.242382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:58:07.243180 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:07.243158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:58:09.638653 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:09.638616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:58:09.644028 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:09.643987    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 18:58:10.142155 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.142120    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"]
Aug 04 18:58:10.148322 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.148290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"
Aug 04 18:58:10.151430 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.151407    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:58:10.151549 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.151528    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 18:58:10.161552 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.161524    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"]
Aug 04 18:58:10.173022 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.172993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1c831-7b0c-48a0-8b77-9317cb374f3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq\" (UID: \"5aa1c831-7b0c-48a0-8b77-9317cb374f3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"
Aug 04 18:58:10.274017 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.273976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1c831-7b0c-48a0-8b77-9317cb374f3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq\" (UID: \"5aa1c831-7b0c-48a0-8b77-9317cb374f3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"
Aug 04 18:58:10.274688 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.274659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1c831-7b0c-48a0-8b77-9317cb374f3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq\" (UID: \"5aa1c831-7b0c-48a0-8b77-9317cb374f3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"
Aug 04 18:58:10.460023 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.459930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"
Aug 04 18:58:10.808961 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:10.808933    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"]
Aug 04 18:58:10.810584 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:58:10.810552    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa1c831_7b0c_48a0_8b77_9317cb374f3c.slice/crio-33a1bcf37a79a89bebd10f4adfa0fdf63e94c62976dcb7e2f26bef7240d392bf WatchSource:0}: Error finding container 33a1bcf37a79a89bebd10f4adfa0fdf63e94c62976dcb7e2f26bef7240d392bf: Status 404 returned error can't find the container with id 33a1bcf37a79a89bebd10f4adfa0fdf63e94c62976dcb7e2f26bef7240d392bf
Aug 04 18:58:11.422415 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:11.422255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq" event={"ID":"5aa1c831-7b0c-48a0-8b77-9317cb374f3c","Type":"ContainerStarted","Data":"741c39d6fa5238752a679bc8e9e0dbb8c5bf954dcd2732a9e9d322dc6dab691b"}
Aug 04 18:58:11.422415 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:11.422384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq" event={"ID":"5aa1c831-7b0c-48a0-8b77-9317cb374f3c","Type":"ContainerStarted","Data":"33a1bcf37a79a89bebd10f4adfa0fdf63e94c62976dcb7e2f26bef7240d392bf"}
Aug 04 18:58:11.448881 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:11.448740    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq" podStartSLOduration=1.4486999329999999 podStartE2EDuration="1.448699933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:58:11.445313056 +0000 UTC m=+1802.413203618" watchObservedRunningTime="2026-08-04 18:58:11.448699933 +0000 UTC m=+1802.416590580"
Aug 04 18:58:12.429947 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:12.429913    2565 generic.go:356] "Generic (PLEG): container finished" podID="5aa1c831-7b0c-48a0-8b77-9317cb374f3c" containerID="741c39d6fa5238752a679bc8e9e0dbb8c5bf954dcd2732a9e9d322dc6dab691b" exitCode=0
Aug 04 18:58:12.430357 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:12.429997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq" event={"ID":"5aa1c831-7b0c-48a0-8b77-9317cb374f3c","Type":"ContainerDied","Data":"741c39d6fa5238752a679bc8e9e0dbb8c5bf954dcd2732a9e9d322dc6dab691b"}
Aug 04 18:58:13.572871 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:13.572845    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"
Aug 04 18:58:13.606019 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:13.605985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1c831-7b0c-48a0-8b77-9317cb374f3c-maas-api-service-ca\") pod \"5aa1c831-7b0c-48a0-8b77-9317cb374f3c\" (UID: \"5aa1c831-7b0c-48a0-8b77-9317cb374f3c\") "
Aug 04 18:58:13.606357 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:13.606337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa1c831-7b0c-48a0-8b77-9317cb374f3c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5aa1c831-7b0c-48a0-8b77-9317cb374f3c" (UID: "5aa1c831-7b0c-48a0-8b77-9317cb374f3c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:58:13.707352 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:13.707256    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1c831-7b0c-48a0-8b77-9317cb374f3c-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:14.442119 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:14.442088    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"
Aug 04 18:58:14.442307 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:14.442117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq" event={"ID":"5aa1c831-7b0c-48a0-8b77-9317cb374f3c","Type":"ContainerDied","Data":"33a1bcf37a79a89bebd10f4adfa0fdf63e94c62976dcb7e2f26bef7240d392bf"}
Aug 04 18:58:14.442307 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:14.442168    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33a1bcf37a79a89bebd10f4adfa0fdf63e94c62976dcb7e2f26bef7240d392bf"
Aug 04 18:58:16.549835 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:16.549771    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"]
Aug 04 18:58:16.558408 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:16.558378    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93cfcc2b-646fq"]
Aug 04 18:58:16.726894 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:16.726862    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"]
Aug 04 18:58:16.727087 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:16.727065    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy" containerID="cri-o://9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23" gracePeriod=30
Aug 04 18:58:17.570762 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:17.570708    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aa1c831-7b0c-48a0-8b77-9317cb374f3c" path="/var/lib/kubelet/pods/5aa1c831-7b0c-48a0-8b77-9317cb374f3c/volumes"
Aug 04 18:58:19.475250 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:19.475215    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:58:21.983153 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:21.983124    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:58:22.091123 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091015    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcdct\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-kube-api-access-vcdct\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091123 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-podinfo\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091123 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091079    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istiod-ca-cert\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091123 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-data\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091123 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091128    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-socket\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091512 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091248    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-certs\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091512 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-envoy\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091512 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091324    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-token\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091512 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091347    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-credential-socket\") pod \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\" (UID: \"e2fde0cf-a261-480d-8cb1-3ea264eb5d18\") "
Aug 04 18:58:22.091512 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091455    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:58:22.091512 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091464    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:58:22.091863 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091549    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:58:22.091863 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091666    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:58:22.091863 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091712    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:58:22.092029 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091892    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.092029 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091919    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.092029 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091932    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.092029 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091944    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.092029 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.091959    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.093620 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.093585    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-kube-api-access-vcdct" (OuterVolumeSpecName: "kube-api-access-vcdct") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "kube-api-access-vcdct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:58:22.093762 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.093628    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 18:58:22.093762 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.093641    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:58:22.093762 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.093656    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2fde0cf-a261-480d-8cb1-3ea264eb5d18" (UID: "e2fde0cf-a261-480d-8cb1-3ea264eb5d18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:58:22.193006 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.192971    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcdct\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-kube-api-access-vcdct\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.193006 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.193002    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.193006 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.193012    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.193006 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.193021    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2fde0cf-a261-480d-8cb1-3ea264eb5d18-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:22.491421 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.491388    2565 generic.go:356] "Generic (PLEG): container finished" podID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerID="9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23" exitCode=0
Aug 04 18:58:22.491698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.491448    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"
Aug 04 18:58:22.491698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.491462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" event={"ID":"e2fde0cf-a261-480d-8cb1-3ea264eb5d18","Type":"ContainerDied","Data":"9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23"}
Aug 04 18:58:22.491698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.491506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8" event={"ID":"e2fde0cf-a261-480d-8cb1-3ea264eb5d18","Type":"ContainerDied","Data":"11a087924139a196fde2eb25fc02d1b5878bff9f6b81c641fe9326be370d926d"}
Aug 04 18:58:22.491698 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.491529    2565 scope.go:117] "RemoveContainer" containerID="9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23"
Aug 04 18:58:22.501568 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.501543    2565 scope.go:117] "RemoveContainer" containerID="1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6"
Aug 04 18:58:22.510906 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.510883    2565 scope.go:117] "RemoveContainer" containerID="9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23"
Aug 04 18:58:22.511392 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:58:22.511358    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23\": container with ID starting with 9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23 not found: ID does not exist" containerID="9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23"
Aug 04 18:58:22.511501 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.511402    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23"} err="failed to get container status \"9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23\": rpc error: code = NotFound desc = could not find container \"9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23\": container with ID starting with 9f3eda57a9306d1bd092dedebc03bbf0cb3d65dbf0d5777b53f87cfe35da9e23 not found: ID does not exist"
Aug 04 18:58:22.511501 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.511423    2565 scope.go:117] "RemoveContainer" containerID="1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6"
Aug 04 18:58:22.511727 ip-10-0-137-145 kubenswrapper[2565]: E0804 18:58:22.511705    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6\": container with ID starting with 1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6 not found: ID does not exist" containerID="1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6"
Aug 04 18:58:22.511817 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.511736    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6"} err="failed to get container status \"1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6\": rpc error: code = NotFound desc = could not find container \"1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6\": container with ID starting with 1e0ca89b98e434db395839211d7a1c3cb30d6ba52883b09f399fb7605d9b17b6 not found: ID does not exist"
Aug 04 18:58:22.513614 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.513593    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"]
Aug 04 18:58:22.520617 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:22.520586    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8"]
Aug 04 18:58:23.571362 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:23.571330    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" path="/var/lib/kubelet/pods/e2fde0cf-a261-480d-8cb1-3ea264eb5d18/volumes"
Aug 04 18:58:26.791238 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:26.791197    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:58:45.175995 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.175957    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"]
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176359    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy"
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176370    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy"
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176379    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa1c831-7b0c-48a0-8b77-9317cb374f3c" containerName="revoke-keys"
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176385    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa1c831-7b0c-48a0-8b77-9317cb374f3c" containerName="revoke-keys"
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176394    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy"
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176400    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy"
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176458    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa1c831-7b0c-48a0-8b77-9317cb374f3c" containerName="revoke-keys"
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176467    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy"
Aug 04 18:58:45.176502 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.176494    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2fde0cf-a261-480d-8cb1-3ea264eb5d18" containerName="istio-proxy"
Aug 04 18:58:45.178986 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.178971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"
Aug 04 18:58:45.183107 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.183077    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:58:45.184414 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.184398    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 18:58:45.202245 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.202161    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"]
Aug 04 18:58:45.209002 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.208963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/714f3ad4-3ad5-4f24-a699-c3810b04e5a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk\" (UID: \"714f3ad4-3ad5-4f24-a699-c3810b04e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"
Aug 04 18:58:45.309746 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.309697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/714f3ad4-3ad5-4f24-a699-c3810b04e5a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk\" (UID: \"714f3ad4-3ad5-4f24-a699-c3810b04e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"
Aug 04 18:58:45.310377 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.310356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/714f3ad4-3ad5-4f24-a699-c3810b04e5a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk\" (UID: \"714f3ad4-3ad5-4f24-a699-c3810b04e5a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"
Aug 04 18:58:45.492365 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.492334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"
Aug 04 18:58:45.637944 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:45.637914    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"]
Aug 04 18:58:45.640133 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:58:45.640095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714f3ad4_3ad5_4f24_a699_c3810b04e5a0.slice/crio-424e1fabda68b32451807f65973f9feda3bf25087c4b256c2d0b5ca3334bb66d WatchSource:0}: Error finding container 424e1fabda68b32451807f65973f9feda3bf25087c4b256c2d0b5ca3334bb66d: Status 404 returned error can't find the container with id 424e1fabda68b32451807f65973f9feda3bf25087c4b256c2d0b5ca3334bb66d
Aug 04 18:58:46.627681 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:46.627649    2565 generic.go:356] "Generic (PLEG): container finished" podID="714f3ad4-3ad5-4f24-a699-c3810b04e5a0" containerID="1184695fa42bdaede7e6b1d55a1c2d0ab3deb2c57906cf78bd714aa60d819ea1" exitCode=0
Aug 04 18:58:46.628084 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:46.627731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk" event={"ID":"714f3ad4-3ad5-4f24-a699-c3810b04e5a0","Type":"ContainerDied","Data":"1184695fa42bdaede7e6b1d55a1c2d0ab3deb2c57906cf78bd714aa60d819ea1"}
Aug 04 18:58:46.628084 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:46.627804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk" event={"ID":"714f3ad4-3ad5-4f24-a699-c3810b04e5a0","Type":"ContainerStarted","Data":"424e1fabda68b32451807f65973f9feda3bf25087c4b256c2d0b5ca3334bb66d"}
Aug 04 18:58:47.772447 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:47.772416    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"
Aug 04 18:58:47.834494 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:47.834450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/714f3ad4-3ad5-4f24-a699-c3810b04e5a0-maas-api-service-ca\") pod \"714f3ad4-3ad5-4f24-a699-c3810b04e5a0\" (UID: \"714f3ad4-3ad5-4f24-a699-c3810b04e5a0\") "
Aug 04 18:58:47.834920 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:47.834900    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/714f3ad4-3ad5-4f24-a699-c3810b04e5a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "714f3ad4-3ad5-4f24-a699-c3810b04e5a0" (UID: "714f3ad4-3ad5-4f24-a699-c3810b04e5a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:58:47.936197 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:47.936097    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/714f3ad4-3ad5-4f24-a699-c3810b04e5a0-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:58:48.640087 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:48.640058    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"
Aug 04 18:58:48.640087 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:48.640081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk" event={"ID":"714f3ad4-3ad5-4f24-a699-c3810b04e5a0","Type":"ContainerDied","Data":"424e1fabda68b32451807f65973f9feda3bf25087c4b256c2d0b5ca3334bb66d"}
Aug 04 18:58:48.640313 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:48.640125    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="424e1fabda68b32451807f65973f9feda3bf25087c4b256c2d0b5ca3334bb66d"
Aug 04 18:58:52.074473 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:52.074438    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"]
Aug 04 18:58:52.077525 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:52.077499    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2646b40b-44wwk"]
Aug 04 18:58:53.571024 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:53.570992    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="714f3ad4-3ad5-4f24-a699-c3810b04e5a0" path="/var/lib/kubelet/pods/714f3ad4-3ad5-4f24-a699-c3810b04e5a0/volumes"
Aug 04 18:58:55.093275 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:58:55.093232    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:59:04.389957 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:04.389906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:59:21.035747 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.035706    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"]
Aug 04 18:59:21.036368 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.036123    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="714f3ad4-3ad5-4f24-a699-c3810b04e5a0" containerName="revoke-keys"
Aug 04 18:59:21.036368 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.036135    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="714f3ad4-3ad5-4f24-a699-c3810b04e5a0" containerName="revoke-keys"
Aug 04 18:59:21.036368 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.036214    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="714f3ad4-3ad5-4f24-a699-c3810b04e5a0" containerName="revoke-keys"
Aug 04 18:59:21.038409 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.038393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"
Aug 04 18:59:21.041933 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.041911    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 18:59:21.042316 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.042295    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:59:21.055838 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.055807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"]
Aug 04 18:59:21.156809 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.156755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51eac00-2f0b-4823-9af9-6ab91fab375e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl\" (UID: \"c51eac00-2f0b-4823-9af9-6ab91fab375e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"
Aug 04 18:59:21.258169 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.258122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51eac00-2f0b-4823-9af9-6ab91fab375e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl\" (UID: \"c51eac00-2f0b-4823-9af9-6ab91fab375e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"
Aug 04 18:59:21.258815 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.258758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51eac00-2f0b-4823-9af9-6ab91fab375e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl\" (UID: \"c51eac00-2f0b-4823-9af9-6ab91fab375e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"
Aug 04 18:59:21.349353 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.349258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"
Aug 04 18:59:21.490771 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.490740    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"]
Aug 04 18:59:21.828390 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.828350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl" event={"ID":"c51eac00-2f0b-4823-9af9-6ab91fab375e","Type":"ContainerStarted","Data":"4068becd98898398d8515b0a142d466b43b56fd5f57da2d0faf5f7cc70240977"}
Aug 04 18:59:21.828593 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.828408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl" event={"ID":"c51eac00-2f0b-4823-9af9-6ab91fab375e","Type":"ContainerStarted","Data":"06b6c25dcc2b20f222cc3b486dc64d85999b21924d65c57188ef32db74ab18c9"}
Aug 04 18:59:21.846616 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:21.846556    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl" podStartSLOduration=0.8465366 podStartE2EDuration="846.5366ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:59:21.844856655 +0000 UTC m=+1872.812747202" watchObservedRunningTime="2026-08-04 18:59:21.8465366 +0000 UTC m=+1872.814427147"
Aug 04 18:59:22.835305 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:22.835267    2565 generic.go:356] "Generic (PLEG): container finished" podID="c51eac00-2f0b-4823-9af9-6ab91fab375e" containerID="4068becd98898398d8515b0a142d466b43b56fd5f57da2d0faf5f7cc70240977" exitCode=0
Aug 04 18:59:22.835702 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:22.835348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl" event={"ID":"c51eac00-2f0b-4823-9af9-6ab91fab375e","Type":"ContainerDied","Data":"4068becd98898398d8515b0a142d466b43b56fd5f57da2d0faf5f7cc70240977"}
Aug 04 18:59:23.974636 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:23.974611    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"
Aug 04 18:59:24.087255 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:24.087214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51eac00-2f0b-4823-9af9-6ab91fab375e-maas-api-service-ca\") pod \"c51eac00-2f0b-4823-9af9-6ab91fab375e\" (UID: \"c51eac00-2f0b-4823-9af9-6ab91fab375e\") "
Aug 04 18:59:24.087575 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:24.087552    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c51eac00-2f0b-4823-9af9-6ab91fab375e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c51eac00-2f0b-4823-9af9-6ab91fab375e" (UID: "c51eac00-2f0b-4823-9af9-6ab91fab375e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:59:24.188581 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:24.188475    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51eac00-2f0b-4823-9af9-6ab91fab375e-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 18:59:24.847506 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:24.847474    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"
Aug 04 18:59:24.847506 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:24.847502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl" event={"ID":"c51eac00-2f0b-4823-9af9-6ab91fab375e","Type":"ContainerDied","Data":"06b6c25dcc2b20f222cc3b486dc64d85999b21924d65c57188ef32db74ab18c9"}
Aug 04 18:59:24.847736 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:24.847550    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06b6c25dcc2b20f222cc3b486dc64d85999b21924d65c57188ef32db74ab18c9"
Aug 04 18:59:27.324591 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:27.324548    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"]
Aug 04 18:59:27.327997 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:27.327966    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41669ddd-9cjkl"]
Aug 04 18:59:27.571215 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:27.571177    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c51eac00-2f0b-4823-9af9-6ab91fab375e" path="/var/lib/kubelet/pods/c51eac00-2f0b-4823-9af9-6ab91fab375e/volumes"
Aug 04 18:59:29.206204 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.206164    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"]
Aug 04 18:59:29.206868 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.206846    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51eac00-2f0b-4823-9af9-6ab91fab375e" containerName="revoke-keys"
Aug 04 18:59:29.206926 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.206870    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51eac00-2f0b-4823-9af9-6ab91fab375e" containerName="revoke-keys"
Aug 04 18:59:29.206995 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.206984    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51eac00-2f0b-4823-9af9-6ab91fab375e" containerName="revoke-keys"
Aug 04 18:59:29.209566 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.209550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.212590 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.212569    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-43a78dca-openshift-default-dockercfg-rh92w\""
Aug 04 18:59:29.212972 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.212953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 18:59:29.225328 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.225287    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"]
Aug 04 18:59:29.231562 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-envoy\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.231798 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istiod-ca-cert\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.231798 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-certs\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.231798 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-token\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.231798 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231747    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-socket\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.231798 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr2xv\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-kube-api-access-nr2xv\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.232225 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-credential-socket\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.232225 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-data\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.232225 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.231867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-podinfo\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.332763 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.332709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-envoy\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.332763 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.332767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istiod-ca-cert\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.332836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-certs\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.332915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-token\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.332987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-socket\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr2xv\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-kube-api-access-nr2xv\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333066 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-credential-socket\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333344 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-data\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333344 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-podinfo\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333344 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-certs\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333631 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-credential-socket\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333631 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-socket\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333742 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istiod-ca-cert\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.333833 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.333812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-data\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.335603 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.335573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-envoy\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.336030 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.336006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-podinfo\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.344231 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.344200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr2xv\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-kube-api-access-nr2xv\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.345224 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.345202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-token\") pod \"e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") " pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.520382 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.520345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:29.671215 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.671181    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"]
Aug 04 18:59:29.672672 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:59:29.672639    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38de1f3e_8edd_481b_898d_4a0e719c4e3b.slice/crio-97db4ce5d50ea816d0d70c921daf4c48c5d581d666f7ca459fd5d9e569941d28 WatchSource:0}: Error finding container 97db4ce5d50ea816d0d70c921daf4c48c5d581d666f7ca459fd5d9e569941d28: Status 404 returned error can't find the container with id 97db4ce5d50ea816d0d70c921daf4c48c5d581d666f7ca459fd5d9e569941d28
Aug 04 18:59:29.674987 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.674945    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:59:29.675071 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.675035    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:59:29.675111 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.675073    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:59:29.881673 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.881569    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" event={"ID":"38de1f3e-8edd-481b-898d-4a0e719c4e3b","Type":"ContainerStarted","Data":"fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316"}
Aug 04 18:59:29.881673 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.881632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" event={"ID":"38de1f3e-8edd-481b-898d-4a0e719c4e3b","Type":"ContainerStarted","Data":"97db4ce5d50ea816d0d70c921daf4c48c5d581d666f7ca459fd5d9e569941d28"}
Aug 04 18:59:29.922874 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:29.918726    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" podStartSLOduration=0.918701854 podStartE2EDuration="918.701854ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:59:29.913170923 +0000 UTC m=+1880.881061469" watchObservedRunningTime="2026-08-04 18:59:29.918701854 +0000 UTC m=+1880.886592402"
Aug 04 18:59:30.203508 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:30.203398    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:59:30.520692 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:30.520653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:30.525854 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:30.525830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:30.887969 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:30.887844    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:30.888770 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:30.888749    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:38.381162 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:38.381109    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 18:59:44.983334 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:44.983298    2565 generic.go:356] "Generic (PLEG): container finished" podID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerID="fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316" exitCode=0
Aug 04 18:59:44.983838 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:44.983376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" event={"ID":"38de1f3e-8edd-481b-898d-4a0e719c4e3b","Type":"ContainerDied","Data":"fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316"}
Aug 04 18:59:44.983898 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:44.983838    2565 scope.go:117] "RemoveContainer" containerID="fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316"
Aug 04 18:59:44.986304 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:44.986254    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:59:44.986546 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:44.986523    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:59:44.986707 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:44.986688    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 18:59:45.888070 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:45.887951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:46.008007 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:46.007964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" event={"ID":"38de1f3e-8edd-481b-898d-4a0e719c4e3b","Type":"ContainerStarted","Data":"568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca"}
Aug 04 18:59:46.520956 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:46.520918    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:46.522166 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:46.522136    2565 patch_prober.go:28] interesting pod/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 18:59:46.522302 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:46.522197    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 18:59:47.520737 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:47.520702    2565 patch_prober.go:28] interesting pod/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 18:59:47.521167 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:47.520769    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 18:59:48.521827 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:48.521758    2565 patch_prober.go:28] interesting pod/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 18:59:48.522246 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:48.521847    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 18:59:49.521769 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:49.521728    2565 patch_prober.go:28] interesting pod/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 18:59:49.521979 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:49.521828    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 18:59:50.521421 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:50.521375    2565 patch_prober.go:28] interesting pod/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 18:59:50.521611 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:50.521452    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 18:59:51.525390 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:51.525356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:51.525842 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:51.525750    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:51.526483 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:51.526463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 18:59:56.139273 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.139237    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"]
Aug 04 18:59:56.142102 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.142082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"
Aug 04 18:59:56.145377 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.145349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 18:59:56.145527 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.145384    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:59:56.155037 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.155006    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"]
Aug 04 18:59:56.314382 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.314337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b3346d-6ada-4374-a2ee-e9fea15755b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk\" (UID: \"92b3346d-6ada-4374-a2ee-e9fea15755b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"
Aug 04 18:59:56.415929 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.415815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b3346d-6ada-4374-a2ee-e9fea15755b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk\" (UID: \"92b3346d-6ada-4374-a2ee-e9fea15755b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"
Aug 04 18:59:56.416601 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.416580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b3346d-6ada-4374-a2ee-e9fea15755b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk\" (UID: \"92b3346d-6ada-4374-a2ee-e9fea15755b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"
Aug 04 18:59:56.454546 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.454506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"
Aug 04 18:59:56.593964 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:56.593934    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"]
Aug 04 18:59:56.595398 ip-10-0-137-145 kubenswrapper[2565]: W0804 18:59:56.595370    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b3346d_6ada_4374_a2ee_e9fea15755b4.slice/crio-6349dbbcd8e4b9f8ec92e623888d4a342b89fd5287cc4d7fb1cecd0d703b0340 WatchSource:0}: Error finding container 6349dbbcd8e4b9f8ec92e623888d4a342b89fd5287cc4d7fb1cecd0d703b0340: Status 404 returned error can't find the container with id 6349dbbcd8e4b9f8ec92e623888d4a342b89fd5287cc4d7fb1cecd0d703b0340
Aug 04 18:59:57.077042 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:57.076942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk" event={"ID":"92b3346d-6ada-4374-a2ee-e9fea15755b4","Type":"ContainerStarted","Data":"75d83a65a568091b388cb34033fce8af6c46abdff351f128f68b58aa34270e50"}
Aug 04 18:59:57.077042 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:57.076998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk" event={"ID":"92b3346d-6ada-4374-a2ee-e9fea15755b4","Type":"ContainerStarted","Data":"6349dbbcd8e4b9f8ec92e623888d4a342b89fd5287cc4d7fb1cecd0d703b0340"}
Aug 04 18:59:57.093520 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:57.093447    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk" podStartSLOduration=1.0934299 podStartE2EDuration="1.0934299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:59:57.092683309 +0000 UTC m=+1908.060573857" watchObservedRunningTime="2026-08-04 18:59:57.0934299 +0000 UTC m=+1908.061320447"
Aug 04 18:59:58.084592 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:58.084555    2565 generic.go:356] "Generic (PLEG): container finished" podID="92b3346d-6ada-4374-a2ee-e9fea15755b4" containerID="75d83a65a568091b388cb34033fce8af6c46abdff351f128f68b58aa34270e50" exitCode=0
Aug 04 18:59:58.085086 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:58.084645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk" event={"ID":"92b3346d-6ada-4374-a2ee-e9fea15755b4","Type":"ContainerDied","Data":"75d83a65a568091b388cb34033fce8af6c46abdff351f128f68b58aa34270e50"}
Aug 04 18:59:59.229914 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:59.229887    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"
Aug 04 18:59:59.242889 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:59.242862    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b3346d-6ada-4374-a2ee-e9fea15755b4-maas-api-service-ca\") pod \"92b3346d-6ada-4374-a2ee-e9fea15755b4\" (UID: \"92b3346d-6ada-4374-a2ee-e9fea15755b4\") "
Aug 04 18:59:59.243253 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:59.243233    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b3346d-6ada-4374-a2ee-e9fea15755b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92b3346d-6ada-4374-a2ee-e9fea15755b4" (UID: "92b3346d-6ada-4374-a2ee-e9fea15755b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:59:59.343910 ip-10-0-137-145 kubenswrapper[2565]: I0804 18:59:59.343815    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b3346d-6ada-4374-a2ee-e9fea15755b4-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:00.096845 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.096813    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"
Aug 04 19:00:00.097050 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.096847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk" event={"ID":"92b3346d-6ada-4374-a2ee-e9fea15755b4","Type":"ContainerDied","Data":"6349dbbcd8e4b9f8ec92e623888d4a342b89fd5287cc4d7fb1cecd0d703b0340"}
Aug 04 19:00:00.097050 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.096936    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6349dbbcd8e4b9f8ec92e623888d4a342b89fd5287cc4d7fb1cecd0d703b0340"
Aug 04 19:00:00.136558 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.136515    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"]
Aug 04 19:00:00.137169 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.137148    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b3346d-6ada-4374-a2ee-e9fea15755b4" containerName="revoke-keys"
Aug 04 19:00:00.137223 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.137174    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b3346d-6ada-4374-a2ee-e9fea15755b4" containerName="revoke-keys"
Aug 04 19:00:00.137306 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.137294    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b3346d-6ada-4374-a2ee-e9fea15755b4" containerName="revoke-keys"
Aug 04 19:00:00.140007 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.139989    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27"]
Aug 04 19:00:00.140122 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.140105    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"
Aug 04 19:00:00.143132 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.143113    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27"
Aug 04 19:00:00.143303 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.143287    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:00:00.150723 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.150688    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27"]
Aug 04 19:00:00.153608 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.153586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"]
Aug 04 19:00:00.154834 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.154813    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"
Aug 04 19:00:00.163870 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.163850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27"
Aug 04 19:00:00.317684 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.317649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"]
Aug 04 19:00:00.320399 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:00:00.320362    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9f64f0_0d0d_43c0_be39_0b278b1a391a.slice/crio-3481e5df05b6e121c23fc8468e1a36655c8b56ca407bb71cc122cea38e951818 WatchSource:0}: Error finding container 3481e5df05b6e121c23fc8468e1a36655c8b56ca407bb71cc122cea38e951818: Status 404 returned error can't find the container with id 3481e5df05b6e121c23fc8468e1a36655c8b56ca407bb71cc122cea38e951818
Aug 04 19:00:00.361983 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:00.361803    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27"]
Aug 04 19:00:00.365072 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:00:00.365042    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ced7fc_5a62_4b7b_8204_b6f63c749052.slice/crio-a1c9a6d23020b701e5644237d9ab3da4f984760feace8120d920d7392b315835 WatchSource:0}: Error finding container a1c9a6d23020b701e5644237d9ab3da4f984760feace8120d920d7392b315835: Status 404 returned error can't find the container with id a1c9a6d23020b701e5644237d9ab3da4f984760feace8120d920d7392b315835
Aug 04 19:00:01.106068 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:01.106030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk" event={"ID":"dc9f64f0-0d0d-43c0-be39-0b278b1a391a","Type":"ContainerStarted","Data":"aa329697e77acb8e4adb65e31719f9184e5f21e648147a3c4430d090fdb206dd"}
Aug 04 19:00:01.106281 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:01.106093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk" event={"ID":"dc9f64f0-0d0d-43c0-be39-0b278b1a391a","Type":"ContainerStarted","Data":"3481e5df05b6e121c23fc8468e1a36655c8b56ca407bb71cc122cea38e951818"}
Aug 04 19:00:01.107826 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:01.107771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27" event={"ID":"b6ced7fc-5a62-4b7b-8204-b6f63c749052","Type":"ContainerStarted","Data":"a01c337d390eb1b1256c6d7d89fda1e62e9de0fa2f240cad9a5331ccad054c83"}
Aug 04 19:00:01.107977 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:01.107840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27" event={"ID":"b6ced7fc-5a62-4b7b-8204-b6f63c749052","Type":"ContainerStarted","Data":"a1c9a6d23020b701e5644237d9ab3da4f984760feace8120d920d7392b315835"}
Aug 04 19:00:01.125462 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:01.125407    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk" podStartSLOduration=1.125381075 podStartE2EDuration="1.125381075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:00:01.123006614 +0000 UTC m=+1912.090897160" watchObservedRunningTime="2026-08-04 19:00:01.125381075 +0000 UTC m=+1912.093271620"
Aug 04 19:00:01.141313 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:01.141258    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27" podStartSLOduration=1.141245699 podStartE2EDuration="1.141245699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:00:01.139265595 +0000 UTC m=+1912.107156142" watchObservedRunningTime="2026-08-04 19:00:01.141245699 +0000 UTC m=+1912.109136245"
Aug 04 19:00:02.115314 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:02.115275    2565 generic.go:356] "Generic (PLEG): container finished" podID="b6ced7fc-5a62-4b7b-8204-b6f63c749052" containerID="a01c337d390eb1b1256c6d7d89fda1e62e9de0fa2f240cad9a5331ccad054c83" exitCode=0
Aug 04 19:00:02.115810 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:02.115370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27" event={"ID":"b6ced7fc-5a62-4b7b-8204-b6f63c749052","Type":"ContainerDied","Data":"a01c337d390eb1b1256c6d7d89fda1e62e9de0fa2f240cad9a5331ccad054c83"}
Aug 04 19:00:02.116924 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:02.116899    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc9f64f0-0d0d-43c0-be39-0b278b1a391a" containerID="aa329697e77acb8e4adb65e31719f9184e5f21e648147a3c4430d090fdb206dd" exitCode=0
Aug 04 19:00:02.117029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:02.116937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk" event={"ID":"dc9f64f0-0d0d-43c0-be39-0b278b1a391a","Type":"ContainerDied","Data":"aa329697e77acb8e4adb65e31719f9184e5f21e648147a3c4430d090fdb206dd"}
Aug 04 19:00:03.112857 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:03.112813    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"]
Aug 04 19:00:03.308914 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:03.308887    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27"
Aug 04 19:00:03.312313 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:03.312280    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"
Aug 04 19:00:03.327267 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:03.327141    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"]
Aug 04 19:00:03.333127 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:03.333094    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-43a78dca-jlqwk"]
Aug 04 19:00:03.457506 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:03.457389    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"]
Aug 04 19:00:03.457711 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:03.457681    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy" containerID="cri-o://568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca" gracePeriod=30
Aug 04 19:00:03.572387 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:03.572351    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b3346d-6ada-4374-a2ee-e9fea15755b4" path="/var/lib/kubelet/pods/92b3346d-6ada-4374-a2ee-e9fea15755b4/volumes"
Aug 04 19:00:04.137267 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:04.137198    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27"
Aug 04 19:00:04.137750 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:04.137199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-f4g27" event={"ID":"b6ced7fc-5a62-4b7b-8204-b6f63c749052","Type":"ContainerDied","Data":"a1c9a6d23020b701e5644237d9ab3da4f984760feace8120d920d7392b315835"}
Aug 04 19:00:04.137750 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:04.137407    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1c9a6d23020b701e5644237d9ab3da4f984760feace8120d920d7392b315835"
Aug 04 19:00:04.142079 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:04.141989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk" event={"ID":"dc9f64f0-0d0d-43c0-be39-0b278b1a391a","Type":"ContainerDied","Data":"3481e5df05b6e121c23fc8468e1a36655c8b56ca407bb71cc122cea38e951818"}
Aug 04 19:00:04.142424 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:04.142128    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3481e5df05b6e121c23fc8468e1a36655c8b56ca407bb71cc122cea38e951818"
Aug 04 19:00:04.142424 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:04.142276    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"
Aug 04 19:00:04.228439 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:04.228406    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"]
Aug 04 19:00:04.244676 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:04.244642    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-43a78dca-29764500-qxqjk"]
Aug 04 19:00:05.570920 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:05.570890    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9f64f0-0d0d-43c0-be39-0b278b1a391a" path="/var/lib/kubelet/pods/dc9f64f0-0d0d-43c0-be39-0b278b1a391a/volumes"
Aug 04 19:00:05.897853 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:05.897747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:00:06.529123 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:06.529081    2565 patch_prober.go:28] interesting pod/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 19:00:06.529297 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:06.529146    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 19:00:08.708820 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.708792    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 19:00:08.732412 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-token\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.732412 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732363    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-podinfo\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.732412 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732400    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr2xv\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-kube-api-access-nr2xv\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.732695 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732459    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-socket\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.732695 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732638    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-credential-socket\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.732695 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732681    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-data\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.732888 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732732    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-certs\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.732888 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732760    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:00:08.732888 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istiod-ca-cert\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.732888 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732848    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-envoy\") pod \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\" (UID: \"38de1f3e-8edd-481b-898d-4a0e719c4e3b\") "
Aug 04 19:00:08.733088 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732904    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:00:08.733088 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.732940    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:00:08.733088 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.733022    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:00:08.733272 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.733254    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:08.733272 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.733260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:00:08.733383 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.733272    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:08.733383 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.733306    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:08.733383 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.733322    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:08.734722 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.734695    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 19:00:08.734874 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.734795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:00:08.734874 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.734794    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-kube-api-access-nr2xv" (OuterVolumeSpecName: "kube-api-access-nr2xv") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "kube-api-access-nr2xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:00:08.734997 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.734979    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38de1f3e-8edd-481b-898d-4a0e719c4e3b" (UID: "38de1f3e-8edd-481b-898d-4a0e719c4e3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:00:08.834618 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.834582    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:08.834618 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.834612    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr2xv\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-kube-api-access-nr2xv\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:08.834618 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.834622    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:08.834618 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.834630    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:08.834933 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:08.834638    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38de1f3e-8edd-481b-898d-4a0e719c4e3b-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:00:09.177380 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.177343    2565 generic.go:356] "Generic (PLEG): container finished" podID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerID="568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca" exitCode=0
Aug 04 19:00:09.177598 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.177408    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"
Aug 04 19:00:09.177598 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.177425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" event={"ID":"38de1f3e-8edd-481b-898d-4a0e719c4e3b","Type":"ContainerDied","Data":"568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca"}
Aug 04 19:00:09.177598 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.177528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg" event={"ID":"38de1f3e-8edd-481b-898d-4a0e719c4e3b","Type":"ContainerDied","Data":"97db4ce5d50ea816d0d70c921daf4c48c5d581d666f7ca459fd5d9e569941d28"}
Aug 04 19:00:09.177598 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.177559    2565 scope.go:117] "RemoveContainer" containerID="568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca"
Aug 04 19:00:09.192731 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.192254    2565 scope.go:117] "RemoveContainer" containerID="fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316"
Aug 04 19:00:09.204450 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.204431    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"]
Aug 04 19:00:09.204527 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.204501    2565 scope.go:117] "RemoveContainer" containerID="568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca"
Aug 04 19:00:09.204933 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:00:09.204905    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca\": container with ID starting with 568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca not found: ID does not exist" containerID="568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca"
Aug 04 19:00:09.205100 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.204938    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca"} err="failed to get container status \"568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca\": rpc error: code = NotFound desc = could not find container \"568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca\": container with ID starting with 568d3796e140a053ab9abf58fe2de7439b249b7a352ddb4b4f50ad7a2abe4aca not found: ID does not exist"
Aug 04 19:00:09.205100 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.204961    2565 scope.go:117] "RemoveContainer" containerID="fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316"
Aug 04 19:00:09.205301 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:00:09.205277    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316\": container with ID starting with fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316 not found: ID does not exist" containerID="fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316"
Aug 04 19:00:09.205392 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.205356    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316"} err="failed to get container status \"fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316\": rpc error: code = NotFound desc = could not find container \"fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316\": container with ID starting with fc6edf12ead9131f1e6f476049e793cc9afcdb443f9204800cd5e103a9772316 not found: ID does not exist"
Aug 04 19:00:09.208716 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.208683    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg"]
Aug 04 19:00:09.571393 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:09.571356    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" path="/var/lib/kubelet/pods/38de1f3e-8edd-481b-898d-4a0e719c4e3b/volumes"
Aug 04 19:00:18.769568 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:00:18.769531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:01:52.278278 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:01:52.278234    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:02:02.074851 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:02.074815    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:02:07.590695 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.590656    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"]
Aug 04 19:02:07.591263 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591241    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy"
Aug 04 19:02:07.591357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591266    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy"
Aug 04 19:02:07.591357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591282    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9f64f0-0d0d-43c0-be39-0b278b1a391a" containerName="cleanup"
Aug 04 19:02:07.591357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591291    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9f64f0-0d0d-43c0-be39-0b278b1a391a" containerName="cleanup"
Aug 04 19:02:07.591357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591329    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy"
Aug 04 19:02:07.591357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591337    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy"
Aug 04 19:02:07.591357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591349    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ced7fc-5a62-4b7b-8204-b6f63c749052" containerName="cleanup"
Aug 04 19:02:07.591357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591358    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ced7fc-5a62-4b7b-8204-b6f63c749052" containerName="cleanup"
Aug 04 19:02:07.591693 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591472    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy"
Aug 04 19:02:07.591693 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591484    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ced7fc-5a62-4b7b-8204-b6f63c749052" containerName="cleanup"
Aug 04 19:02:07.591693 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.591496    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9f64f0-0d0d-43c0-be39-0b278b1a391a" containerName="cleanup"
Aug 04 19:02:07.593973 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.593952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.596621 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.596601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 19:02:07.599328 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.599310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2f0c212d-openshift-default-dockercfg-h8s66\""
Aug 04 19:02:07.629105 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.629069    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"]
Aug 04 19:02:07.668662 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.668621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp7jw\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-kube-api-access-tp7jw\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.668991 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.668714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572d80fe-18b1-4b02-b4b7-38dba47b424c-istiod-ca-cert\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.668991 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.668758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-data\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.668991 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.668880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-certs\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.668991 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.668936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-envoy\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.668991 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.668969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-socket\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.669269 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.669023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-token\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.669269 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.669103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-podinfo\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.669269 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.669149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-credential-socket\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770284 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-podinfo\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770284 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-credential-socket\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770550 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp7jw\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-kube-api-access-tp7jw\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770550 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572d80fe-18b1-4b02-b4b7-38dba47b424c-istiod-ca-cert\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770550 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-data\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770550 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-certs\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770550 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-envoy\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770550 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-socket\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770550 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-token\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770960 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-data\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.770960 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-credential-socket\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.771039 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.770975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-certs\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.771164 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.771137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-socket\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.771224 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.771167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572d80fe-18b1-4b02-b4b7-38dba47b424c-istiod-ca-cert\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.772869 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.772846    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-envoy\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.773197 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.773176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-podinfo\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.780706 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.780685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-token\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.780935 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.780912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp7jw\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-kube-api-access-tp7jw\") pod \"e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") " pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:07.904713 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:07.904620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:08.055384 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:08.055354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"]
Aug 04 19:02:08.057314 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:02:08.057287    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572d80fe_18b1_4b02_b4b7_38dba47b424c.slice/crio-d1b6e6274795dba62e00f7b870ef35c01b58c45eb0d44a930dcb112fca7173d5 WatchSource:0}: Error finding container d1b6e6274795dba62e00f7b870ef35c01b58c45eb0d44a930dcb112fca7173d5: Status 404 returned error can't find the container with id d1b6e6274795dba62e00f7b870ef35c01b58c45eb0d44a930dcb112fca7173d5
Aug 04 19:02:08.059530 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:08.059486    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:02:08.059620 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:08.059586    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:02:08.059660 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:08.059627    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:02:08.909237 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:08.909198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" event={"ID":"572d80fe-18b1-4b02-b4b7-38dba47b424c","Type":"ContainerStarted","Data":"9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0"}
Aug 04 19:02:08.909668 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:08.909261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" event={"ID":"572d80fe-18b1-4b02-b4b7-38dba47b424c","Type":"ContainerStarted","Data":"d1b6e6274795dba62e00f7b870ef35c01b58c45eb0d44a930dcb112fca7173d5"}
Aug 04 19:02:08.933029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:08.932970    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podStartSLOduration=1.93295473 podStartE2EDuration="1.93295473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:02:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:02:08.931372503 +0000 UTC m=+2039.899263076" watchObservedRunningTime="2026-08-04 19:02:08.93295473 +0000 UTC m=+2039.900845275"
Aug 04 19:02:09.905966 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:09.905853    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:09.913038 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:09.913004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:09.915755 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:09.915729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:09.916670 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:09.916651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:14.587990 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:14.587954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:02:24.917576 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:24.917529    2565 patch_prober.go:28] interesting pod/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 19:02:24.918103 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:24.917605    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 19:02:25.012634 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:25.012592    2565 generic.go:356] "Generic (PLEG): container finished" podID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerID="9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0" exitCode=0
Aug 04 19:02:25.012859 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:25.012668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" event={"ID":"572d80fe-18b1-4b02-b4b7-38dba47b424c","Type":"ContainerDied","Data":"9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0"}
Aug 04 19:02:25.013185 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:25.013167    2565 scope.go:117] "RemoveContainer" containerID="9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0"
Aug 04 19:02:25.014288 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:25.014256    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:02:25.014381 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:25.014338    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:02:25.014457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:25.014385    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:02:26.021467 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:26.021432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" event={"ID":"572d80fe-18b1-4b02-b4b7-38dba47b424c","Type":"ContainerStarted","Data":"363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985"}
Aug 04 19:02:26.905923 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:26.905881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:26.906416 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:26.906319    2565 patch_prober.go:28] interesting pod/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 19:02:26.906633 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:26.906604    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 19:02:27.906178 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:27.906134    2565 patch_prober.go:28] interesting pod/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 19:02:27.906856 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:27.906807    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 19:02:28.905661 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:28.905610    2565 patch_prober.go:28] interesting pod/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 19:02:28.905923 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:28.905689    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 19:02:29.906130 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:29.906082    2565 patch_prober.go:28] interesting pod/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 19:02:29.906663 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:29.906164    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 19:02:30.906114 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:30.906002    2565 patch_prober.go:28] interesting pod/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 19:02:30.906114 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:30.906074    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 19:02:31.909207 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:31.909175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:31.909602 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:31.909453    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:31.910164 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:31.910143    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:02:43.900601 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:43.900556    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"]
Aug 04 19:02:43.901133 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:43.901116    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="38de1f3e-8edd-481b-898d-4a0e719c4e3b" containerName="istio-proxy"
Aug 04 19:02:43.903375 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:43.903354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"
Aug 04 19:02:43.906876 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:43.906850    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:02:43.906876 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:43.906875    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:02:43.913533 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:43.913502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"]
Aug 04 19:02:43.939154 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:43.939097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1ad6328-dee5-4da9-b680-7cdf737912cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2\" (UID: \"b1ad6328-dee5-4da9-b680-7cdf737912cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"
Aug 04 19:02:44.040405 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:44.040277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1ad6328-dee5-4da9-b680-7cdf737912cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2\" (UID: \"b1ad6328-dee5-4da9-b680-7cdf737912cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"
Aug 04 19:02:44.041517 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:44.041463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1ad6328-dee5-4da9-b680-7cdf737912cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2\" (UID: \"b1ad6328-dee5-4da9-b680-7cdf737912cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"
Aug 04 19:02:44.215933 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:44.215835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"
Aug 04 19:02:44.360065 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:44.360039    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"]
Aug 04 19:02:44.361510 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:02:44.361473    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ad6328_dee5_4da9_b680_7cdf737912cf.slice/crio-91e2b3b5fb167845aca627bbea488366b6a1e086400ed2060b010e8aa12ab9ca WatchSource:0}: Error finding container 91e2b3b5fb167845aca627bbea488366b6a1e086400ed2060b010e8aa12ab9ca: Status 404 returned error can't find the container with id 91e2b3b5fb167845aca627bbea488366b6a1e086400ed2060b010e8aa12ab9ca
Aug 04 19:02:45.136851 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:45.136814    2565 generic.go:356] "Generic (PLEG): container finished" podID="b1ad6328-dee5-4da9-b680-7cdf737912cf" containerID="6f91892806ae3b2409dbd40b9ce2815bdd0184a81db25db4d2896e7bf30d5b4a" exitCode=0
Aug 04 19:02:45.137272 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:45.136909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2" event={"ID":"b1ad6328-dee5-4da9-b680-7cdf737912cf","Type":"ContainerDied","Data":"6f91892806ae3b2409dbd40b9ce2815bdd0184a81db25db4d2896e7bf30d5b4a"}
Aug 04 19:02:45.137272 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:45.137021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2" event={"ID":"b1ad6328-dee5-4da9-b680-7cdf737912cf","Type":"ContainerStarted","Data":"91e2b3b5fb167845aca627bbea488366b6a1e086400ed2060b010e8aa12ab9ca"}
Aug 04 19:02:46.282917 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:46.282890    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"
Aug 04 19:02:46.365700 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:46.365664    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1ad6328-dee5-4da9-b680-7cdf737912cf-maas-api-service-ca\") pod \"b1ad6328-dee5-4da9-b680-7cdf737912cf\" (UID: \"b1ad6328-dee5-4da9-b680-7cdf737912cf\") "
Aug 04 19:02:46.366110 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:46.366085    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ad6328-dee5-4da9-b680-7cdf737912cf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b1ad6328-dee5-4da9-b680-7cdf737912cf" (UID: "b1ad6328-dee5-4da9-b680-7cdf737912cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:02:46.466943 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:46.466838    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1ad6328-dee5-4da9-b680-7cdf737912cf-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:02:47.150151 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:47.150121    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"
Aug 04 19:02:47.150333 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:47.150161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2" event={"ID":"b1ad6328-dee5-4da9-b680-7cdf737912cf","Type":"ContainerDied","Data":"91e2b3b5fb167845aca627bbea488366b6a1e086400ed2060b010e8aa12ab9ca"}
Aug 04 19:02:47.150333 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:47.150206    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91e2b3b5fb167845aca627bbea488366b6a1e086400ed2060b010e8aa12ab9ca"
Aug 04 19:02:54.854748 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:54.854703    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"]
Aug 04 19:02:54.857069 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:54.857043    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2f0c212d-mw8f2"]
Aug 04 19:02:55.570484 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:55.570447    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1ad6328-dee5-4da9-b680-7cdf737912cf" path="/var/lib/kubelet/pods/b1ad6328-dee5-4da9-b680-7cdf737912cf/volumes"
Aug 04 19:02:56.492613 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:02:56.492576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:03:01.844563 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:01.844523    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"]
Aug 04 19:03:01.845024 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:01.844807    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy" containerID="cri-o://363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985" gracePeriod=30
Aug 04 19:03:01.912420 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:01.912377    2565 patch_prober.go:28] interesting pod/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 19:03:01.912589 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:01.912445    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 19:03:07.091106 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.091077    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:03:07.166505 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166417    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-credential-socket\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166505 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166469    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-socket\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166705 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166517    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572d80fe-18b1-4b02-b4b7-38dba47b424c-istiod-ca-cert\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166705 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-token\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166705 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166633    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-data\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166705 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-certs\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166705 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-podinfo\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166988 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166723    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-envoy\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166988 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166770    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp7jw\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-kube-api-access-tp7jw\") pod \"572d80fe-18b1-4b02-b4b7-38dba47b424c\" (UID: \"572d80fe-18b1-4b02-b4b7-38dba47b424c\") "
Aug 04 19:03:07.166988 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166753    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:07.166988 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:07.167196 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.166960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-data" (OuterVolumeSpecName: "istio-data") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:07.167196 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.167023    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:07.167196 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.167068    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572d80fe-18b1-4b02-b4b7-38dba47b424c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:03:07.167196 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.167156    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.167196 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.167176    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.167196 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.167191    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572d80fe-18b1-4b02-b4b7-38dba47b424c-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.167427 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.167203    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.167427 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.167216    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.169052 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.169020    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:07.169187 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.169144    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 19:03:07.169326 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.169303    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-kube-api-access-tp7jw" (OuterVolumeSpecName: "kube-api-access-tp7jw") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "kube-api-access-tp7jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:03:07.169436 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.169321    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-token" (OuterVolumeSpecName: "istio-token") pod "572d80fe-18b1-4b02-b4b7-38dba47b424c" (UID: "572d80fe-18b1-4b02-b4b7-38dba47b424c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:03:07.268574 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.268540    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.268574 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.268575    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp7jw\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-kube-api-access-tp7jw\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.268854 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.268590    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.268854 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.268600    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572d80fe-18b1-4b02-b4b7-38dba47b424c-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:03:07.271765 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.271737    2565 generic.go:356] "Generic (PLEG): container finished" podID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerID="363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985" exitCode=0
Aug 04 19:03:07.271908 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.271803    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"
Aug 04 19:03:07.271908 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.271821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" event={"ID":"572d80fe-18b1-4b02-b4b7-38dba47b424c","Type":"ContainerDied","Data":"363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985"}
Aug 04 19:03:07.271908 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.271905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9" event={"ID":"572d80fe-18b1-4b02-b4b7-38dba47b424c","Type":"ContainerDied","Data":"d1b6e6274795dba62e00f7b870ef35c01b58c45eb0d44a930dcb112fca7173d5"}
Aug 04 19:03:07.272010 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.271929    2565 scope.go:117] "RemoveContainer" containerID="363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985"
Aug 04 19:03:07.282502 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.282483    2565 scope.go:117] "RemoveContainer" containerID="9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0"
Aug 04 19:03:07.291657 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.291639    2565 scope.go:117] "RemoveContainer" containerID="363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985"
Aug 04 19:03:07.291982 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:03:07.291962    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985\": container with ID starting with 363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985 not found: ID does not exist" containerID="363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985"
Aug 04 19:03:07.292041 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.291992    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985"} err="failed to get container status \"363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985\": rpc error: code = NotFound desc = could not find container \"363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985\": container with ID starting with 363c99119840ee7d55c50e5273f7fd113c8c07fe44bb5fe6d0ffe4dd962a7985 not found: ID does not exist"
Aug 04 19:03:07.292041 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.292011    2565 scope.go:117] "RemoveContainer" containerID="9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0"
Aug 04 19:03:07.292286 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:03:07.292268    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0\": container with ID starting with 9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0 not found: ID does not exist" containerID="9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0"
Aug 04 19:03:07.292346 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.292291    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0"} err="failed to get container status \"9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0\": rpc error: code = NotFound desc = could not find container \"9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0\": container with ID starting with 9ac89e4cc8a2ec6128cee8f263732eb734be6bf22b954adac8f9dffa0cfc2df0 not found: ID does not exist"
Aug 04 19:03:07.299556 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.299529    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"]
Aug 04 19:03:07.304310 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.304287    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9"]
Aug 04 19:03:07.570886 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:07.570852    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" path="/var/lib/kubelet/pods/572d80fe-18b1-4b02-b4b7-38dba47b424c/volumes"
Aug 04 19:03:09.679695 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:09.679653    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:03:09.690407 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:09.690375    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:03:37.290432 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:03:37.290396    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:05:09.756115 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:05:09.756077    2565 scope.go:117] "RemoveContainer" containerID="741c39d6fa5238752a679bc8e9e0dbb8c5bf954dcd2732a9e9d322dc6dab691b"
Aug 04 19:05:09.765701 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:05:09.765681    2565 scope.go:117] "RemoveContainer" containerID="1184695fa42bdaede7e6b1d55a1c2d0ab3deb2c57906cf78bd714aa60d819ea1"
Aug 04 19:05:21.979210 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:05:21.979103    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:05:30.399614 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:05:30.399570    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:06:04.191053 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191013    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"]
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191420    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy"
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191430    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy"
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191440    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ad6328-dee5-4da9-b680-7cdf737912cf" containerName="revoke-keys"
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191447    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ad6328-dee5-4da9-b680-7cdf737912cf" containerName="revoke-keys"
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191458    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy"
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191464    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy"
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191533    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy"
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191540    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ad6328-dee5-4da9-b680-7cdf737912cf" containerName="revoke-keys"
Aug 04 19:06:04.191560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.191546    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="572d80fe-18b1-4b02-b4b7-38dba47b424c" containerName="istio-proxy"
Aug 04 19:06:04.193949 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.193932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.197516 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.197483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-59f3c9c8\"/\"e2e-lifecycle-model-59f3c9c8-kserve-self-signed-certs\""
Aug 04 19:06:04.197649 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.197484    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-59f3c9c8\"/\"openshift-service-ca.crt\""
Aug 04 19:06:04.197649 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.197533    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-59f3c9c8\"/\"kube-root-ca.crt\""
Aug 04 19:06:04.197649 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.197551    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-59f3c9c8\"/\"default-dockercfg-g4f7z\""
Aug 04 19:06:04.205597 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.205573    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"]
Aug 04 19:06:04.337010 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.336971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-model-cache\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.337010 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.337020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7591622-8f6b-4097-b81b-1afe85ee7a99-tls-certs\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.337266 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.337047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-tmp-dir\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.337266 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.337141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-home\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.337266 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.337174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-dshm\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.337266 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.337214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcpl6\" (UniqueName: \"kubernetes.io/projected/e7591622-8f6b-4097-b81b-1afe85ee7a99-kube-api-access-bcpl6\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.438445 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.438412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-dshm\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.438658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.438464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcpl6\" (UniqueName: \"kubernetes.io/projected/e7591622-8f6b-4097-b81b-1afe85ee7a99-kube-api-access-bcpl6\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.438658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.438501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-model-cache\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.438658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.438524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7591622-8f6b-4097-b81b-1afe85ee7a99-tls-certs\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.438658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.438541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-tmp-dir\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.438658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.438590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-home\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.439029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.438998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-model-cache\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.439029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.439024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-home\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.439184 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.439004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-tmp-dir\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.440885 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.440863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-dshm\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.441100 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.441062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7591622-8f6b-4097-b81b-1afe85ee7a99-tls-certs\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.448562 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.448534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcpl6\" (UniqueName: \"kubernetes.io/projected/e7591622-8f6b-4097-b81b-1afe85ee7a99-kube-api-access-bcpl6\") pod \"e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") " pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.504583 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.504538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:04.647484 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.647460    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"]
Aug 04 19:06:04.649918 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:06:04.649862    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7591622_8f6b_4097_b81b_1afe85ee7a99.slice/crio-22ed99585ef5a406b65d7d4a56e7c873e37ca11f6c8787e59fce131ce465050e WatchSource:0}: Error finding container 22ed99585ef5a406b65d7d4a56e7c873e37ca11f6c8787e59fce131ce465050e: Status 404 returned error can't find the container with id 22ed99585ef5a406b65d7d4a56e7c873e37ca11f6c8787e59fce131ce465050e
Aug 04 19:06:04.651701 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:04.651683    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 19:06:05.371754 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:05.371711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w" event={"ID":"e7591622-8f6b-4097-b81b-1afe85ee7a99","Type":"ContainerStarted","Data":"22ed99585ef5a406b65d7d4a56e7c873e37ca11f6c8787e59fce131ce465050e"}
Aug 04 19:06:06.379239 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:06.379187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w" event={"ID":"e7591622-8f6b-4097-b81b-1afe85ee7a99","Type":"ContainerStarted","Data":"49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13"}
Aug 04 19:06:06.400303 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:06.400243    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w" podStartSLOduration=1.377580827 podStartE2EDuration="2.400227044s" totalImagesPullingTime="1.022646217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:06:06.399425318 +0000 UTC m=+2277.367315867" watchObservedRunningTime="2026-08-04 19:06:06.400227044 +0000 UTC m=+2277.368117667"
Aug 04 19:06:06.681422 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:06.681319    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:06:09.804493 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:09.804460    2565 scope.go:117] "RemoveContainer" containerID="aa329697e77acb8e4adb65e31719f9184e5f21e648147a3c4430d090fdb206dd"
Aug 04 19:06:09.813238 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:09.813215    2565 scope.go:117] "RemoveContainer" containerID="75d83a65a568091b388cb34033fce8af6c46abdff351f128f68b58aa34270e50"
Aug 04 19:06:09.821656 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:09.821635    2565 scope.go:117] "RemoveContainer" containerID="4068becd98898398d8515b0a142d466b43b56fd5f57da2d0faf5f7cc70240977"
Aug 04 19:06:14.505574 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:14.505530    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:14.506117 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:14.505851    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:14.518728 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:14.518700    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:15.447688 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:15.447654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:06:30.778919 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:30.778879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:06:41.304434 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.304398    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"]
Aug 04 19:06:41.309065 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.309049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"
Aug 04 19:06:41.311729 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.311708    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:06:41.311935 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.311912    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:06:41.318166 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.318126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"]
Aug 04 19:06:41.421461 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.421419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn\" (UID: \"f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"
Aug 04 19:06:41.522279 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.522235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn\" (UID: \"f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"
Aug 04 19:06:41.522957 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.522937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn\" (UID: \"f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"
Aug 04 19:06:41.621340 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.621242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"
Aug 04 19:06:41.797054 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:41.797020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"]
Aug 04 19:06:41.798102 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:06:41.798066    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a993e8_7ef7_4ff6_a1af_afd7ea74e82e.slice/crio-81eba8d1fa76e1a262708180e8c1b655f4a0dc3385cd799140880e67ed7a24f9 WatchSource:0}: Error finding container 81eba8d1fa76e1a262708180e8c1b655f4a0dc3385cd799140880e67ed7a24f9: Status 404 returned error can't find the container with id 81eba8d1fa76e1a262708180e8c1b655f4a0dc3385cd799140880e67ed7a24f9
Aug 04 19:06:42.592756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:42.592719    2565 generic.go:356] "Generic (PLEG): container finished" podID="f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e" containerID="75671fc9aac0eda2c902744f80079f4f27c0fb06f82c5d0869cf1085ec8fd388" exitCode=0
Aug 04 19:06:42.593181 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:42.592818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn" event={"ID":"f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e","Type":"ContainerDied","Data":"75671fc9aac0eda2c902744f80079f4f27c0fb06f82c5d0869cf1085ec8fd388"}
Aug 04 19:06:42.593181 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:42.592874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn" event={"ID":"f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e","Type":"ContainerStarted","Data":"81eba8d1fa76e1a262708180e8c1b655f4a0dc3385cd799140880e67ed7a24f9"}
Aug 04 19:06:43.760069 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:43.760041    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"
Aug 04 19:06:43.946056 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:43.945964    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e-maas-api-service-ca\") pod \"f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e\" (UID: \"f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e\") "
Aug 04 19:06:43.946359 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:43.946337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e" (UID: "f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:06:44.047255 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:44.047218    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:06:44.609791 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:44.609749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"
Aug 04 19:06:44.609989 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:44.609805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn" event={"ID":"f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e","Type":"ContainerDied","Data":"81eba8d1fa76e1a262708180e8c1b655f4a0dc3385cd799140880e67ed7a24f9"}
Aug 04 19:06:44.609989 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:44.609854    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81eba8d1fa76e1a262708180e8c1b655f4a0dc3385cd799140880e67ed7a24f9"
Aug 04 19:06:54.275504 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:54.275463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:06:57.116531 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:57.116494    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"]
Aug 04 19:06:57.123340 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:57.123310    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59f3c9c8-sv5hn"]
Aug 04 19:06:57.571077 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:57.571044    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e" path="/var/lib/kubelet/pods/f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e/volumes"
Aug 04 19:06:58.985592 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:06:58.985550    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:07:05.215422 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:05.215325    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"]
Aug 04 19:07:20.244742 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.244699    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w" podUID="e7591622-8f6b-4097-b81b-1afe85ee7a99" containerName="main" containerID="cri-o://49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13" gracePeriod=45
Aug 04 19:07:20.492672 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.492650    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:07:20.605570 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.605472    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-dshm\") pod \"e7591622-8f6b-4097-b81b-1afe85ee7a99\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") "
Aug 04 19:07:20.605712 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.605582    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-home\") pod \"e7591622-8f6b-4097-b81b-1afe85ee7a99\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") "
Aug 04 19:07:20.605712 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.605651    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7591622-8f6b-4097-b81b-1afe85ee7a99-tls-certs\") pod \"e7591622-8f6b-4097-b81b-1afe85ee7a99\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") "
Aug 04 19:07:20.605822 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.605711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-tmp-dir\") pod \"e7591622-8f6b-4097-b81b-1afe85ee7a99\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") "
Aug 04 19:07:20.605822 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.605739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcpl6\" (UniqueName: \"kubernetes.io/projected/e7591622-8f6b-4097-b81b-1afe85ee7a99-kube-api-access-bcpl6\") pod \"e7591622-8f6b-4097-b81b-1afe85ee7a99\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") "
Aug 04 19:07:20.605822 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.605791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-model-cache\") pod \"e7591622-8f6b-4097-b81b-1afe85ee7a99\" (UID: \"e7591622-8f6b-4097-b81b-1afe85ee7a99\") "
Aug 04 19:07:20.605991 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.605866    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-home" (OuterVolumeSpecName: "home") pod "e7591622-8f6b-4097-b81b-1afe85ee7a99" (UID: "e7591622-8f6b-4097-b81b-1afe85ee7a99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:20.606086 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.606070    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:07:20.606157 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.606103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e7591622-8f6b-4097-b81b-1afe85ee7a99" (UID: "e7591622-8f6b-4097-b81b-1afe85ee7a99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:20.606157 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.606142    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-model-cache" (OuterVolumeSpecName: "model-cache") pod "e7591622-8f6b-4097-b81b-1afe85ee7a99" (UID: "e7591622-8f6b-4097-b81b-1afe85ee7a99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:20.607808 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.607758    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-dshm" (OuterVolumeSpecName: "dshm") pod "e7591622-8f6b-4097-b81b-1afe85ee7a99" (UID: "e7591622-8f6b-4097-b81b-1afe85ee7a99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:20.607935 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.607908    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7591622-8f6b-4097-b81b-1afe85ee7a99-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e7591622-8f6b-4097-b81b-1afe85ee7a99" (UID: "e7591622-8f6b-4097-b81b-1afe85ee7a99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:07:20.607996 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.607930    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7591622-8f6b-4097-b81b-1afe85ee7a99-kube-api-access-bcpl6" (OuterVolumeSpecName: "kube-api-access-bcpl6") pod "e7591622-8f6b-4097-b81b-1afe85ee7a99" (UID: "e7591622-8f6b-4097-b81b-1afe85ee7a99"). InnerVolumeSpecName "kube-api-access-bcpl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:20.706878 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.706839    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:07:20.706878 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.706878    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7591622-8f6b-4097-b81b-1afe85ee7a99-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:07:20.707134 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.706891    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:07:20.707134 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.706905    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcpl6\" (UniqueName: \"kubernetes.io/projected/e7591622-8f6b-4097-b81b-1afe85ee7a99-kube-api-access-bcpl6\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:07:20.707134 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.706918    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7591622-8f6b-4097-b81b-1afe85ee7a99-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:07:20.813372 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.813335    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7591622-8f6b-4097-b81b-1afe85ee7a99" containerID="49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13" exitCode=0
Aug 04 19:07:20.813554 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.813393    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"
Aug 04 19:07:20.813554 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.813429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w" event={"ID":"e7591622-8f6b-4097-b81b-1afe85ee7a99","Type":"ContainerDied","Data":"49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13"}
Aug 04 19:07:20.813554 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.813478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w" event={"ID":"e7591622-8f6b-4097-b81b-1afe85ee7a99","Type":"ContainerDied","Data":"22ed99585ef5a406b65d7d4a56e7c873e37ca11f6c8787e59fce131ce465050e"}
Aug 04 19:07:20.813554 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.813503    2565 scope.go:117] "RemoveContainer" containerID="49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13"
Aug 04 19:07:20.822847 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.822829    2565 scope.go:117] "RemoveContainer" containerID="49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13"
Aug 04 19:07:20.823087 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:07:20.823069    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13\": container with ID starting with 49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13 not found: ID does not exist" containerID="49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13"
Aug 04 19:07:20.823144 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.823096    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13"} err="failed to get container status \"49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13\": rpc error: code = NotFound desc = could not find container \"49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13\": container with ID starting with 49a1bae8843ea9492857729faf76cbe1525264c14215cea501243805da0a3f13 not found: ID does not exist"
Aug 04 19:07:20.835335 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.835311    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"]
Aug 04 19:07:20.839622 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:20.839600    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-59f3c9c8/e2e-lifecycle-model-59f3c9c8-kserve-6f7d54f887-xzx5w"]
Aug 04 19:07:21.571285 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:21.571249    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7591622-8f6b-4097-b81b-1afe85ee7a99" path="/var/lib/kubelet/pods/e7591622-8f6b-4097-b81b-1afe85ee7a99/volumes"
Aug 04 19:07:51.375475 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:07:51.375430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:08:02.797165 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:02.797105    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:08:09.192735 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:09.192699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:08:09.734367 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:09.734326    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:08:09.740895 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:09.740861    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:08:19.189391 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:19.189353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:08:57.671453 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.671416    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"]
Aug 04 19:08:57.672029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.671861    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7591622-8f6b-4097-b81b-1afe85ee7a99" containerName="main"
Aug 04 19:08:57.672029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.671874    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7591622-8f6b-4097-b81b-1afe85ee7a99" containerName="main"
Aug 04 19:08:57.672029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.671886    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e" containerName="revoke-keys"
Aug 04 19:08:57.672029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.671893    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e" containerName="revoke-keys"
Aug 04 19:08:57.672029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.671954    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a993e8-7ef7-4ff6-a1af-afd7ea74e82e" containerName="revoke-keys"
Aug 04 19:08:57.672029 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.671963    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7591622-8f6b-4097-b81b-1afe85ee7a99" containerName="main"
Aug 04 19:08:57.675099 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.675081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.678186 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.678159    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 19:08:57.678323 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.678163    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-91f5f5-openshift-default-dockercfg-kzhd2\""
Aug 04 19:08:57.690418 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.690387    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"]
Aug 04 19:08:57.739573 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j766j\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-kube-api-access-j766j\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.739770 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-socket\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.739770 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-podinfo\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.739770 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-envoy\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.739770 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-certs\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.739770 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-token\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.739770 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istiod-ca-cert\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.740063 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-credential-socket\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.740063 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.739919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-data\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841108 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j766j\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-kube-api-access-j766j\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841325 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-socket\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841325 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-podinfo\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841325 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-envoy\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841521 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-certs\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841521 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-token\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841521 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istiod-ca-cert\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841696 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-credential-socket\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841696 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-data\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841843 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-socket\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.841911 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-certs\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.842017 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.841991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-credential-socket\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.842151 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.842067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-data\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.842288 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.842267    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istiod-ca-cert\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.843829 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.843810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-envoy\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.843946 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.843931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-podinfo\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.849867 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.849835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-token\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.849967 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.849910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j766j\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-kube-api-access-j766j\") pod \"e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") " pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:57.986223 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:57.986191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:58.141371 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:58.141267    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"]
Aug 04 19:08:58.149505 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:08:58.149437    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b9c4a6_7b4a_49ab_a3f7_50a7dcb20300.slice/crio-7f18fa45c0e60080f7d52291a0bcd843b1632eeeee990694a47dd4ab18fc9cf2 WatchSource:0}: Error finding container 7f18fa45c0e60080f7d52291a0bcd843b1632eeeee990694a47dd4ab18fc9cf2: Status 404 returned error can't find the container with id 7f18fa45c0e60080f7d52291a0bcd843b1632eeeee990694a47dd4ab18fc9cf2
Aug 04 19:08:58.154842 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:58.154736    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:08:58.155109 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:58.154923    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:08:58.155109 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:58.154982    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:08:58.386617 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:58.386578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" event={"ID":"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300","Type":"ContainerStarted","Data":"94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd"}
Aug 04 19:08:58.386816 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:58.386633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" event={"ID":"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300","Type":"ContainerStarted","Data":"7f18fa45c0e60080f7d52291a0bcd843b1632eeeee990694a47dd4ab18fc9cf2"}
Aug 04 19:08:58.409484 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:58.409414    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podStartSLOduration=1.409395894 podStartE2EDuration="1.409395894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:08:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:08:58.408216402 +0000 UTC m=+2449.376106952" watchObservedRunningTime="2026-08-04 19:08:58.409395894 +0000 UTC m=+2449.377286440"
Aug 04 19:08:58.986327 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:58.986293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:08:59.991860 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:08:59.991827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:09:00.398505 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:00.398421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:09:00.399389 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:00.399370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:09:05.082478 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:05.082432    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:09:09.875327 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:09.875291    2565 scope.go:117] "RemoveContainer" containerID="6f91892806ae3b2409dbd40b9ce2815bdd0184a81db25db4d2896e7bf30d5b4a"
Aug 04 19:09:15.400488 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:15.400447    2565 patch_prober.go:28] interesting pod/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:09:15.400990 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:15.400513    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:09:15.486243 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:15.486209    2565 generic.go:356] "Generic (PLEG): container finished" podID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerID="94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd" exitCode=0
Aug 04 19:09:15.486426 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:15.486257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" event={"ID":"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300","Type":"ContainerDied","Data":"94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd"}
Aug 04 19:09:15.486653 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:15.486639    2565 scope.go:117] "RemoveContainer" containerID="94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd"
Aug 04 19:09:15.487828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:15.487796    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:09:15.487942 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:15.487869    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:09:15.487942 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:15.487906    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:09:16.499948 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:16.499901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" event={"ID":"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300","Type":"ContainerStarted","Data":"311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977"}
Aug 04 19:09:16.987150 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:16.987105    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:09:16.987397 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:16.987256    2565 patch_prober.go:28] interesting pod/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:09:16.987397 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:16.987307    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:09:17.987573 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:17.987530    2565 patch_prober.go:28] interesting pod/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:09:17.988275 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:17.988237    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:09:18.987358 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:18.987306    2565 patch_prober.go:28] interesting pod/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:09:18.987695 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:18.987657    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:09:19.987452 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:19.987406    2565 patch_prober.go:28] interesting pod/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:09:19.987769 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:19.987736    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:09:20.986738 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:20.986688    2565 patch_prober.go:28] interesting pod/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:09:20.986990 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:20.986762    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:09:21.991039 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:21.991001    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:09:21.991520 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:21.991285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:09:21.992085 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:21.992068    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:09:33.711794 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:09:33.711753    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:10:00.098437 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:00.098399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:10:06.801180 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:06.801082    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:10:32.892231 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.892191    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"]
Aug 04 19:10:32.895894 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.895875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:32.899740 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.899703    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-77907c\"/\"openshift-service-ca.crt\""
Aug 04 19:10:32.899740 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.899703    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-77907c\"/\"kube-root-ca.crt\""
Aug 04 19:10:32.900835 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.900814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-77907c\"/\"test-model-77907c-kserve-self-signed-certs\""
Aug 04 19:10:32.900986 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.900811    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-77907c\"/\"default-dockercfg-chlsk\""
Aug 04 19:10:32.912097 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.912061    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"]
Aug 04 19:10:32.970270 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.970235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwzh9\" (UniqueName: \"kubernetes.io/projected/3e6363ee-a6a3-422d-9abb-5afa26c9a241-kube-api-access-lwzh9\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:32.970457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.970284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tls-certs\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:32.970457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.970359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-dshm\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:32.970457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.970388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tmp-dir\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:32.970457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.970440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-model-cache\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:32.970598 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:32.970518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-home\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.071469 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.071429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-home\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.071696 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.071479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzh9\" (UniqueName: \"kubernetes.io/projected/3e6363ee-a6a3-422d-9abb-5afa26c9a241-kube-api-access-lwzh9\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.071696 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.071614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tls-certs\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.071874 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.071694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-dshm\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.071874 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.071724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tmp-dir\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.071874 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.071835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-model-cache\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.072026 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.071958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-home\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.072160 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.072130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tmp-dir\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.072267 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.072183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-model-cache\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.074063 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.074042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-dshm\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.074254 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.074237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tls-certs\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.081256 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.081227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwzh9\" (UniqueName: \"kubernetes.io/projected/3e6363ee-a6a3-422d-9abb-5afa26c9a241-kube-api-access-lwzh9\") pod \"test-model-77907c-kserve-6869d7896c-mms6c\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") " pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.205606 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.205509    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:33.367187 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.367161    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"]
Aug 04 19:10:33.369261 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:10:33.369230    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e6363ee_a6a3_422d_9abb_5afa26c9a241.slice/crio-2ec4fae49f9f867b40a38f2ea61232cf8d5bf0b5d1bc584a198845f8f017bfb6 WatchSource:0}: Error finding container 2ec4fae49f9f867b40a38f2ea61232cf8d5bf0b5d1bc584a198845f8f017bfb6: Status 404 returned error can't find the container with id 2ec4fae49f9f867b40a38f2ea61232cf8d5bf0b5d1bc584a198845f8f017bfb6
Aug 04 19:10:33.960906 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.960864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c" event={"ID":"3e6363ee-a6a3-422d-9abb-5afa26c9a241","Type":"ContainerStarted","Data":"1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b"}
Aug 04 19:10:33.961347 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.960924    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c" event={"ID":"3e6363ee-a6a3-422d-9abb-5afa26c9a241","Type":"ContainerStarted","Data":"2ec4fae49f9f867b40a38f2ea61232cf8d5bf0b5d1bc584a198845f8f017bfb6"}
Aug 04 19:10:33.984669 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:33.984614    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c" podStartSLOduration=1.9845954 podStartE2EDuration="1.9845954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:10:33.983930962 +0000 UTC m=+2544.951821520" watchObservedRunningTime="2026-08-04 19:10:33.9845954 +0000 UTC m=+2544.952485937"
Aug 04 19:10:35.795502 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:35.795467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:10:43.206204 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:43.206167    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:43.206870 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:43.206254    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:43.218909 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:43.218886    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:44.043680 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:44.043649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:10:44.288565 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:10:44.288530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:11:14.692466 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.692420    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"]
Aug 04 19:11:14.817531 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.817482    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"]
Aug 04 19:11:14.821318 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.821300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"
Aug 04 19:11:14.824057 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.824034    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:11:14.824198 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.824090    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:11:14.830100 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.830073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"]
Aug 04 19:11:14.894532 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.894486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt\" (UID: \"6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"
Aug 04 19:11:14.995287 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.995253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt\" (UID: \"6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"
Aug 04 19:11:14.995962 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:14.995934    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt\" (UID: \"6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"
Aug 04 19:11:15.133721 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:15.133680    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"
Aug 04 19:11:15.295363 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:15.295332    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"]
Aug 04 19:11:15.297419 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:11:15.297391    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8d7ff1_25c0_46a6_b7a5_ff60c29dcbf0.slice/crio-eb4e2cd41eb97de7c4877df431d4957b8e575e911092177fe6fa5be21e297722 WatchSource:0}: Error finding container eb4e2cd41eb97de7c4877df431d4957b8e575e911092177fe6fa5be21e297722: Status 404 returned error can't find the container with id eb4e2cd41eb97de7c4877df431d4957b8e575e911092177fe6fa5be21e297722
Aug 04 19:11:16.215263 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:16.215229    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0" containerID="a420b72f6ae9b1524827f2e1defbb362a8f1596eae10151ec429b56794c67a07" exitCode=0
Aug 04 19:11:16.215679 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:16.215276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt" event={"ID":"6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0","Type":"ContainerDied","Data":"a420b72f6ae9b1524827f2e1defbb362a8f1596eae10151ec429b56794c67a07"}
Aug 04 19:11:16.215679 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:16.215321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt" event={"ID":"6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0","Type":"ContainerStarted","Data":"eb4e2cd41eb97de7c4877df431d4957b8e575e911092177fe6fa5be21e297722"}
Aug 04 19:11:16.990179 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:16.990143    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:11:17.365407 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:17.365380    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"
Aug 04 19:11:17.522650 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:17.522613    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0-maas-api-service-ca\") pod \"6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0\" (UID: \"6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0\") "
Aug 04 19:11:17.523004 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:17.522983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0" (UID: "6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:17.623859 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:17.623814    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:18.227791 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:18.227753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt" event={"ID":"6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0","Type":"ContainerDied","Data":"eb4e2cd41eb97de7c4877df431d4957b8e575e911092177fe6fa5be21e297722"}
Aug 04 19:11:18.228028 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:18.227832    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb4e2cd41eb97de7c4877df431d4957b8e575e911092177fe6fa5be21e297722"
Aug 04 19:11:18.228028 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:18.227765    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"
Aug 04 19:11:25.556038 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:25.555999    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"]
Aug 04 19:11:25.560456 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:25.560416    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-91f5f5-v44rt"]
Aug 04 19:11:25.571239 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:25.571206    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0" path="/var/lib/kubelet/pods/6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0/volumes"
Aug 04 19:11:27.601298 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:27.601253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:11:29.714876 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:29.714815    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c" podUID="3e6363ee-a6a3-422d-9abb-5afa26c9a241" containerName="main" containerID="cri-o://1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b" gracePeriod=45
Aug 04 19:11:29.979095 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:29.979013    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:11:30.049585 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.049547    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-dshm\") pod \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") "
Aug 04 19:11:30.049823 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.049614    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tmp-dir\") pod \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") "
Aug 04 19:11:30.049823 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.049638    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-model-cache\") pod \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") "
Aug 04 19:11:30.049823 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.049676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwzh9\" (UniqueName: \"kubernetes.io/projected/3e6363ee-a6a3-422d-9abb-5afa26c9a241-kube-api-access-lwzh9\") pod \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") "
Aug 04 19:11:30.049823 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.049691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-home\") pod \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") "
Aug 04 19:11:30.049823 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.049730    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tls-certs\") pod \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\" (UID: \"3e6363ee-a6a3-422d-9abb-5afa26c9a241\") "
Aug 04 19:11:30.050098 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.050001    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e6363ee-a6a3-422d-9abb-5afa26c9a241" (UID: "3e6363ee-a6a3-422d-9abb-5afa26c9a241"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:30.050098 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.050031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-home" (OuterVolumeSpecName: "home") pod "3e6363ee-a6a3-422d-9abb-5afa26c9a241" (UID: "3e6363ee-a6a3-422d-9abb-5afa26c9a241"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:30.050098 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.050031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e6363ee-a6a3-422d-9abb-5afa26c9a241" (UID: "3e6363ee-a6a3-422d-9abb-5afa26c9a241"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:30.052129 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.052104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-dshm" (OuterVolumeSpecName: "dshm") pod "3e6363ee-a6a3-422d-9abb-5afa26c9a241" (UID: "3e6363ee-a6a3-422d-9abb-5afa26c9a241"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:30.052251 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.052149    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e6363ee-a6a3-422d-9abb-5afa26c9a241" (UID: "3e6363ee-a6a3-422d-9abb-5afa26c9a241"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:11:30.052251 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.052226    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e6363ee-a6a3-422d-9abb-5afa26c9a241-kube-api-access-lwzh9" (OuterVolumeSpecName: "kube-api-access-lwzh9") pod "3e6363ee-a6a3-422d-9abb-5afa26c9a241" (UID: "3e6363ee-a6a3-422d-9abb-5afa26c9a241"). InnerVolumeSpecName "kube-api-access-lwzh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:30.151274 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.151239    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:30.151274 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.151269    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:30.151274 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.151279    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:30.151528 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.151291    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:30.151528 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.151302    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwzh9\" (UniqueName: \"kubernetes.io/projected/3e6363ee-a6a3-422d-9abb-5afa26c9a241-kube-api-access-lwzh9\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:30.151528 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.151313    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e6363ee-a6a3-422d-9abb-5afa26c9a241-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:30.306726 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.306689    2565 generic.go:356] "Generic (PLEG): container finished" podID="3e6363ee-a6a3-422d-9abb-5afa26c9a241" containerID="1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b" exitCode=0
Aug 04 19:11:30.306929 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.306751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c" event={"ID":"3e6363ee-a6a3-422d-9abb-5afa26c9a241","Type":"ContainerDied","Data":"1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b"}
Aug 04 19:11:30.306929 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.306814    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"
Aug 04 19:11:30.306929 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.306818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c" event={"ID":"3e6363ee-a6a3-422d-9abb-5afa26c9a241","Type":"ContainerDied","Data":"2ec4fae49f9f867b40a38f2ea61232cf8d5bf0b5d1bc584a198845f8f017bfb6"}
Aug 04 19:11:30.306929 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.306843    2565 scope.go:117] "RemoveContainer" containerID="1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b"
Aug 04 19:11:30.318377 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.318359    2565 scope.go:117] "RemoveContainer" containerID="1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b"
Aug 04 19:11:30.318690 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:11:30.318657    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b\": container with ID starting with 1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b not found: ID does not exist" containerID="1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b"
Aug 04 19:11:30.318860 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.318701    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b"} err="failed to get container status \"1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b\": rpc error: code = NotFound desc = could not find container \"1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b\": container with ID starting with 1e4adb43a8034f0bc1ccfd04037de456c1f1fc1cfb2b2d78b90721b00f57337b not found: ID does not exist"
Aug 04 19:11:30.334060 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.334027    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"]
Aug 04 19:11:30.338857 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:30.338830    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-77907c/test-model-77907c-kserve-6869d7896c-mms6c"]
Aug 04 19:11:31.572016 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:31.571930    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e6363ee-a6a3-422d-9abb-5afa26c9a241" path="/var/lib/kubelet/pods/3e6363ee-a6a3-422d-9abb-5afa26c9a241/volumes"
Aug 04 19:11:32.441441 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.441406    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"]
Aug 04 19:11:32.441709 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.441635    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy" containerID="cri-o://311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977" gracePeriod=30
Aug 04 19:11:32.798371 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.798326    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"]
Aug 04 19:11:32.799018 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.798997    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e6363ee-a6a3-422d-9abb-5afa26c9a241" containerName="main"
Aug 04 19:11:32.799119 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.799020    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e6363ee-a6a3-422d-9abb-5afa26c9a241" containerName="main"
Aug 04 19:11:32.799119 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.799068    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0" containerName="revoke-keys"
Aug 04 19:11:32.799119 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.799077    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0" containerName="revoke-keys"
Aug 04 19:11:32.799273 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.799178    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e6363ee-a6a3-422d-9abb-5afa26c9a241" containerName="main"
Aug 04 19:11:32.799273 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.799196    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8d7ff1-25c0-46a6-b7a5-ff60c29dcbf0" containerName="revoke-keys"
Aug 04 19:11:32.803862 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.803839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"
Aug 04 19:11:32.807027 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.806999    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:11:32.807322 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.807298    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:11:32.810175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.810149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"]
Aug 04 19:11:32.876400 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.876358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-77907c-w52qt\" (UID: \"8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"
Aug 04 19:11:32.977054 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.977011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-77907c-w52qt\" (UID: \"8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"
Aug 04 19:11:32.977689 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:32.977666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-77907c-w52qt\" (UID: \"8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"
Aug 04 19:11:33.116261 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:33.116159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"
Aug 04 19:11:33.265990 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:33.265955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"]
Aug 04 19:11:33.267985 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:11:33.267956    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff9a5a7_e4e7_4d50_9ee6_e2cb2aa475cc.slice/crio-7b33de1b6dac3e76a852bc40012d28785113e81ad6cbdc13dea021d21e51ff1d WatchSource:0}: Error finding container 7b33de1b6dac3e76a852bc40012d28785113e81ad6cbdc13dea021d21e51ff1d: Status 404 returned error can't find the container with id 7b33de1b6dac3e76a852bc40012d28785113e81ad6cbdc13dea021d21e51ff1d
Aug 04 19:11:33.328524 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:33.328490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt" event={"ID":"8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc","Type":"ContainerStarted","Data":"7b33de1b6dac3e76a852bc40012d28785113e81ad6cbdc13dea021d21e51ff1d"}
Aug 04 19:11:34.336488 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:34.336397    2565 generic.go:356] "Generic (PLEG): container finished" podID="8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc" containerID="6bc0ed935ab58fd42190ce9b44c45ef625ba11425d2e93b5f4824dbb0234c6aa" exitCode=0
Aug 04 19:11:34.336488 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:34.336478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt" event={"ID":"8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc","Type":"ContainerDied","Data":"6bc0ed935ab58fd42190ce9b44c45ef625ba11425d2e93b5f4824dbb0234c6aa"}
Aug 04 19:11:35.492084 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:35.492060    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"
Aug 04 19:11:35.604563 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:35.604466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc-maas-api-service-ca\") pod \"8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc\" (UID: \"8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc\") "
Aug 04 19:11:35.604877 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:35.604853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc" (UID: "8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:35.705680 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:35.705633    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:36.349756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:36.349718    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"
Aug 04 19:11:36.349756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:36.349748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt" event={"ID":"8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc","Type":"ContainerDied","Data":"7b33de1b6dac3e76a852bc40012d28785113e81ad6cbdc13dea021d21e51ff1d"}
Aug 04 19:11:36.350018 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:36.349863    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b33de1b6dac3e76a852bc40012d28785113e81ad6cbdc13dea021d21e51ff1d"
Aug 04 19:11:36.994558 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:36.994520    2565 patch_prober.go:28] interesting pod/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 19:11:36.994967 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:36.994588    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 19:11:37.721051 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.720965    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:11:37.825384 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825352    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-data\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.825645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825431    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-credential-socket\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.825645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825468    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-socket\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.825645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825503    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-envoy\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.825645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825530    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-certs\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.825645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825589    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istiod-ca-cert\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.825645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825639    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j766j\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-kube-api-access-j766j\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.826014 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825669    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-podinfo\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.826014 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825669    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:37.826014 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825692    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-token\") pod \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\" (UID: \"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300\") "
Aug 04 19:11:37.826014 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825703    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-data" (OuterVolumeSpecName: "istio-data") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:37.826014 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825718    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:37.826014 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825923    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:37.826014 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.825998    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:37.826359 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.826195    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.826359 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.826214    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.826359 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.826227    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.826359 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.826241    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.826359 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.826255    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.827982 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.827947    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 19:11:37.828093 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.828064    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-token" (OuterVolumeSpecName: "istio-token") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:37.828169 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.828142    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:37.828210 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.828183    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-kube-api-access-j766j" (OuterVolumeSpecName: "kube-api-access-j766j") pod "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" (UID: "27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300"). InnerVolumeSpecName "kube-api-access-j766j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:37.927245 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.927205    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.927245 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.927237    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.927245 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.927246    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.927245 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.927255    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j766j\" (UniqueName: \"kubernetes.io/projected/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300-kube-api-access-j766j\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:11:37.941017 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.940970    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"]
Aug 04 19:11:37.943323 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:37.943301    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77907c-w52qt"]
Aug 04 19:11:38.363159 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.363121    2565 generic.go:356] "Generic (PLEG): container finished" podID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerID="311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977" exitCode=0
Aug 04 19:11:38.363613 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.363176    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"
Aug 04 19:11:38.363613 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.363205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" event={"ID":"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300","Type":"ContainerDied","Data":"311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977"}
Aug 04 19:11:38.363613 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.363263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv" event={"ID":"27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300","Type":"ContainerDied","Data":"7f18fa45c0e60080f7d52291a0bcd843b1632eeeee990694a47dd4ab18fc9cf2"}
Aug 04 19:11:38.363613 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.363289    2565 scope.go:117] "RemoveContainer" containerID="311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977"
Aug 04 19:11:38.377692 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.377634    2565 scope.go:117] "RemoveContainer" containerID="94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd"
Aug 04 19:11:38.386888 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.386861    2565 scope.go:117] "RemoveContainer" containerID="311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977"
Aug 04 19:11:38.387307 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:11:38.387277    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977\": container with ID starting with 311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977 not found: ID does not exist" containerID="311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977"
Aug 04 19:11:38.387427 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.387319    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977"} err="failed to get container status \"311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977\": rpc error: code = NotFound desc = could not find container \"311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977\": container with ID starting with 311d3ed6df93fb49b967e60b6edef73fa063fcc7b94bba9b1c3aaca044392977 not found: ID does not exist"
Aug 04 19:11:38.387427 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.387345    2565 scope.go:117] "RemoveContainer" containerID="94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd"
Aug 04 19:11:38.387809 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:11:38.387760    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd\": container with ID starting with 94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd not found: ID does not exist" containerID="94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd"
Aug 04 19:11:38.387910 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.387818    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd"} err="failed to get container status \"94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd\": rpc error: code = NotFound desc = could not find container \"94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd\": container with ID starting with 94b5b8173c292e700ac346fd6a3215b4c9b4f88d1d2fac8b595db6fd33ec74cd not found: ID does not exist"
Aug 04 19:11:38.390100 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.390080    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"]
Aug 04 19:11:38.394183 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:38.394162    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv"]
Aug 04 19:11:39.570936 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:39.570901    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" path="/var/lib/kubelet/pods/27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300/volumes"
Aug 04 19:11:39.571348 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:39.571289    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc" path="/var/lib/kubelet/pods/8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc/volumes"
Aug 04 19:11:39.883795 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:39.883694    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:11:52.577943 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:11:52.577902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:12:19.424032 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.423993    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"]
Aug 04 19:12:19.424635 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424615    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy"
Aug 04 19:12:19.424728 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424638    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy"
Aug 04 19:12:19.424728 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424654    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy"
Aug 04 19:12:19.424728 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424661    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy"
Aug 04 19:12:19.424728 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424689    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc" containerName="revoke-keys"
Aug 04 19:12:19.424728 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424698    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc" containerName="revoke-keys"
Aug 04 19:12:19.424997 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424830    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy"
Aug 04 19:12:19.424997 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424845    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b9c4a6-7b4a-49ab-a3f7-50a7dcb20300" containerName="istio-proxy"
Aug 04 19:12:19.424997 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.424858    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ff9a5a7-e4e7-4d50-9ee6-e2cb2aa475cc" containerName="revoke-keys"
Aug 04 19:12:19.427994 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.427973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.430720 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.430700    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 19:12:19.430869 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.430854    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-7afb35-openshift-default-dockercfg-4xjtb\""
Aug 04 19:12:19.442074 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.442049    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"]
Aug 04 19:12:19.536557 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8cq\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-kube-api-access-gt8cq\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.536757 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-credential-socket\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.536757 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6258de73-414a-4230-9fa0-69541e2679f8-istio-podinfo\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.536757 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-certs\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.536757 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6258de73-414a-4230-9fa0-69541e2679f8-istiod-ca-cert\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.536757 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-socket\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.537059 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-envoy\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.537059 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-istio-token\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.537059 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.536927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-data\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638000 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.637962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8cq\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-kube-api-access-gt8cq\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638218 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-credential-socket\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638218 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6258de73-414a-4230-9fa0-69541e2679f8-istio-podinfo\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638218 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-certs\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638218 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6258de73-414a-4230-9fa0-69541e2679f8-istiod-ca-cert\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638218 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-socket\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638218 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-envoy\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638218 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-istio-token\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638670 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-data\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638670 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-certs\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638670 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-credential-socket\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638809 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-socket\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638809 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-data\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.638959 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.638937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6258de73-414a-4230-9fa0-69541e2679f8-istiod-ca-cert\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.640728 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.640701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6258de73-414a-4230-9fa0-69541e2679f8-istio-podinfo\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.640828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.640711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-envoy\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.650034 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.650006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-istio-token\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.650353 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.650335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8cq\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-kube-api-access-gt8cq\") pod \"e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") " pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.738573 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.738541    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:19.887011 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.886987    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"]
Aug 04 19:12:19.888701 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:12:19.888672    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6258de73_414a_4230_9fa0_69541e2679f8.slice/crio-ca536cc539d532ef37462eff878b466e095aa92a6c8d230fefbc7b5d87fb9d8b WatchSource:0}: Error finding container ca536cc539d532ef37462eff878b466e095aa92a6c8d230fefbc7b5d87fb9d8b: Status 404 returned error can't find the container with id ca536cc539d532ef37462eff878b466e095aa92a6c8d230fefbc7b5d87fb9d8b
Aug 04 19:12:19.890755 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.890726    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:12:19.890832 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.890814    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:12:19.890872 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:19.890848    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:12:20.619858 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:20.619820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" event={"ID":"6258de73-414a-4230-9fa0-69541e2679f8","Type":"ContainerStarted","Data":"7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef"}
Aug 04 19:12:20.620257 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:20.619880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" event={"ID":"6258de73-414a-4230-9fa0-69541e2679f8","Type":"ContainerStarted","Data":"ca536cc539d532ef37462eff878b466e095aa92a6c8d230fefbc7b5d87fb9d8b"}
Aug 04 19:12:20.644973 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:20.644916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" podStartSLOduration=1.6448980930000001 podStartE2EDuration="1.644898093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:12:20.644512162 +0000 UTC m=+2651.612402710" watchObservedRunningTime="2026-08-04 19:12:20.644898093 +0000 UTC m=+2651.612788639"
Aug 04 19:12:20.739633 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:20.739598    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:20.744521 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:20.744499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:21.626595 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:21.626563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:21.627499 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:21.627481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:26.994820 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:26.994765    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:12:37.041131 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:37.041068    2565 patch_prober.go:28] interesting pod/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": read tcp 10.134.0.2:48630->10.134.0.66:15021: read: connection reset by peer" start-of-body=
Aug 04 19:12:37.041562 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:37.041153    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": read tcp 10.134.0.2:48630->10.134.0.66:15021: read: connection reset by peer"
Aug 04 19:12:37.738287 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:37.738250    2565 generic.go:356] "Generic (PLEG): container finished" podID="6258de73-414a-4230-9fa0-69541e2679f8" containerID="7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef" exitCode=0
Aug 04 19:12:37.738495 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:37.738328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" event={"ID":"6258de73-414a-4230-9fa0-69541e2679f8","Type":"ContainerDied","Data":"7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef"}
Aug 04 19:12:37.738823 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:37.738806    2565 scope.go:117] "RemoveContainer" containerID="7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef"
Aug 04 19:12:37.739900 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:37.739870    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:12:37.739962 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:37.739950    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:12:37.739999 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:37.739984    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:12:38.746357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:38.746319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" event={"ID":"6258de73-414a-4230-9fa0-69541e2679f8","Type":"ContainerStarted","Data":"ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a"}
Aug 04 19:12:39.739430 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:39.739389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:39.739639 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:39.739618    2565 patch_prober.go:28] interesting pod/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 04 19:12:39.739689 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:39.739669    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 04 19:12:40.079642 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.079542    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"]
Aug 04 19:12:40.082581 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.082548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"
Aug 04 19:12:40.086597 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.086564    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:12:40.087291 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.087168    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:12:40.103440 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.103338    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"]
Aug 04 19:12:40.253949 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.253909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1587cdf-a05c-4a61-9258-7877fafa8c85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c028db-zgn22\" (UID: \"c1587cdf-a05c-4a61-9258-7877fafa8c85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"
Aug 04 19:12:40.355081 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.354979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1587cdf-a05c-4a61-9258-7877fafa8c85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c028db-zgn22\" (UID: \"c1587cdf-a05c-4a61-9258-7877fafa8c85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"
Aug 04 19:12:40.355688 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.355666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1587cdf-a05c-4a61-9258-7877fafa8c85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c028db-zgn22\" (UID: \"c1587cdf-a05c-4a61-9258-7877fafa8c85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"
Aug 04 19:12:40.405366 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.405316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"
Aug 04 19:12:40.609862 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.608601    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"]
Aug 04 19:12:40.612991 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:12:40.612956    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1587cdf_a05c_4a61_9258_7877fafa8c85.slice/crio-7e6d5256dc91c629ac571228ba8f7362a36d97b3ae40d550abcfdccb3015c249 WatchSource:0}: Error finding container 7e6d5256dc91c629ac571228ba8f7362a36d97b3ae40d550abcfdccb3015c249: Status 404 returned error can't find the container with id 7e6d5256dc91c629ac571228ba8f7362a36d97b3ae40d550abcfdccb3015c249
Aug 04 19:12:40.739176 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.739138    2565 patch_prober.go:28] interesting pod/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 04 19:12:40.739368 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.739191    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 04 19:12:40.758490 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:40.758450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22" event={"ID":"c1587cdf-a05c-4a61-9258-7877fafa8c85","Type":"ContainerStarted","Data":"7e6d5256dc91c629ac571228ba8f7362a36d97b3ae40d550abcfdccb3015c249"}
Aug 04 19:12:41.739605 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:41.739569    2565 patch_prober.go:28] interesting pod/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 04 19:12:41.740046 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:41.739624    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 04 19:12:41.766147 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:41.766111    2565 generic.go:356] "Generic (PLEG): container finished" podID="c1587cdf-a05c-4a61-9258-7877fafa8c85" containerID="32719fcd558663ab71f14882b375ecd4078621a87098d0dc1b58419ccd51201f" exitCode=0
Aug 04 19:12:41.766327 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:41.766201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22" event={"ID":"c1587cdf-a05c-4a61-9258-7877fafa8c85","Type":"ContainerDied","Data":"32719fcd558663ab71f14882b375ecd4078621a87098d0dc1b58419ccd51201f"}
Aug 04 19:12:42.739234 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:42.739189    2565 patch_prober.go:28] interesting pod/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 04 19:12:42.739437 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:42.739254    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 04 19:12:42.938515 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:42.938489    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"
Aug 04 19:12:43.080470 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:43.080372    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1587cdf-a05c-4a61-9258-7877fafa8c85-maas-api-service-ca\") pod \"c1587cdf-a05c-4a61-9258-7877fafa8c85\" (UID: \"c1587cdf-a05c-4a61-9258-7877fafa8c85\") "
Aug 04 19:12:43.080738 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:43.080715    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1587cdf-a05c-4a61-9258-7877fafa8c85-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1587cdf-a05c-4a61-9258-7877fafa8c85" (UID: "c1587cdf-a05c-4a61-9258-7877fafa8c85"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:12:43.181058 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:43.181007    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1587cdf-a05c-4a61-9258-7877fafa8c85-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:12:43.739975 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:43.739926    2565 patch_prober.go:28] interesting pod/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 04 19:12:43.740170 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:43.740001    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 04 19:12:43.780238 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:43.780206    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"
Aug 04 19:12:43.780453 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:43.780237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22" event={"ID":"c1587cdf-a05c-4a61-9258-7877fafa8c85","Type":"ContainerDied","Data":"7e6d5256dc91c629ac571228ba8f7362a36d97b3ae40d550abcfdccb3015c249"}
Aug 04 19:12:43.780453 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:43.780285    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e6d5256dc91c629ac571228ba8f7362a36d97b3ae40d550abcfdccb3015c249"
Aug 04 19:12:44.743381 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:44.743341    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:44.743820 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:44.743663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:44.744394 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:44.744375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:12:52.603165 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:52.603122    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"]
Aug 04 19:12:52.605426 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:52.605401    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c028db-zgn22"]
Aug 04 19:12:53.571234 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:53.571199    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1587cdf-a05c-4a61-9258-7877fafa8c85" path="/var/lib/kubelet/pods/c1587cdf-a05c-4a61-9258-7877fafa8c85/volumes"
Aug 04 19:12:54.582234 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:12:54.582198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:13:00.039336 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.039300    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"]
Aug 04 19:13:00.039764 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.039756    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1587cdf-a05c-4a61-9258-7877fafa8c85" containerName="revoke-keys"
Aug 04 19:13:00.039857 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.039769    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1587cdf-a05c-4a61-9258-7877fafa8c85" containerName="revoke-keys"
Aug 04 19:13:00.039914 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.039878    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1587cdf-a05c-4a61-9258-7877fafa8c85" containerName="revoke-keys"
Aug 04 19:13:00.046800 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.044986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"
Aug 04 19:13:00.049256 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.049233    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:13:00.049464 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.049239    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:13:00.052874 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.052844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"]
Aug 04 19:13:00.148175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.148129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0c5eb1-1faa-4560-b333-20807b07b9c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj\" (UID: \"2b0c5eb1-1faa-4560-b333-20807b07b9c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"
Aug 04 19:13:00.249716 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.249676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0c5eb1-1faa-4560-b333-20807b07b9c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj\" (UID: \"2b0c5eb1-1faa-4560-b333-20807b07b9c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"
Aug 04 19:13:00.250363 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.250341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0c5eb1-1faa-4560-b333-20807b07b9c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj\" (UID: \"2b0c5eb1-1faa-4560-b333-20807b07b9c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"
Aug 04 19:13:00.360724 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.360641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"
Aug 04 19:13:00.504060 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.504034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"]
Aug 04 19:13:00.506252 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:13:00.506222    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0c5eb1_1faa_4560_b333_20807b07b9c2.slice/crio-b6b937f3c4e900b5a69d9b2ee3d48bc89fb9631a33c6f2970b08845cbf5006fd WatchSource:0}: Error finding container b6b937f3c4e900b5a69d9b2ee3d48bc89fb9631a33c6f2970b08845cbf5006fd: Status 404 returned error can't find the container with id b6b937f3c4e900b5a69d9b2ee3d48bc89fb9631a33c6f2970b08845cbf5006fd
Aug 04 19:13:00.887163 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.887057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj" event={"ID":"2b0c5eb1-1faa-4560-b333-20807b07b9c2","Type":"ContainerStarted","Data":"66c25a29c8944d4e3324c8fed878423ea33116816eedc21e51eb62af85deff96"}
Aug 04 19:13:00.887163 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.887121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj" event={"ID":"2b0c5eb1-1faa-4560-b333-20807b07b9c2","Type":"ContainerStarted","Data":"b6b937f3c4e900b5a69d9b2ee3d48bc89fb9631a33c6f2970b08845cbf5006fd"}
Aug 04 19:13:00.903948 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:00.903881    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj" podStartSLOduration=0.90386211 podStartE2EDuration="903.86211ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:13:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:13:00.902346756 +0000 UTC m=+2691.870237308" watchObservedRunningTime="2026-08-04 19:13:00.90386211 +0000 UTC m=+2691.871752656"
Aug 04 19:13:01.894532 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:01.894493    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b0c5eb1-1faa-4560-b333-20807b07b9c2" containerID="66c25a29c8944d4e3324c8fed878423ea33116816eedc21e51eb62af85deff96" exitCode=0
Aug 04 19:13:01.894985 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:01.894580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj" event={"ID":"2b0c5eb1-1faa-4560-b333-20807b07b9c2","Type":"ContainerDied","Data":"66c25a29c8944d4e3324c8fed878423ea33116816eedc21e51eb62af85deff96"}
Aug 04 19:13:03.037748 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:03.037717    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"
Aug 04 19:13:03.081518 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:03.081489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0c5eb1-1faa-4560-b333-20807b07b9c2-maas-api-service-ca\") pod \"2b0c5eb1-1faa-4560-b333-20807b07b9c2\" (UID: \"2b0c5eb1-1faa-4560-b333-20807b07b9c2\") "
Aug 04 19:13:03.081947 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:03.081916    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b0c5eb1-1faa-4560-b333-20807b07b9c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b0c5eb1-1faa-4560-b333-20807b07b9c2" (UID: "2b0c5eb1-1faa-4560-b333-20807b07b9c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:13:03.182924 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:03.182826    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0c5eb1-1faa-4560-b333-20807b07b9c2-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:03.907737 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:03.907654    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"
Aug 04 19:13:03.907737 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:03.907657    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj" event={"ID":"2b0c5eb1-1faa-4560-b333-20807b07b9c2","Type":"ContainerDied","Data":"b6b937f3c4e900b5a69d9b2ee3d48bc89fb9631a33c6f2970b08845cbf5006fd"}
Aug 04 19:13:03.907949 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:03.907786    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6b937f3c4e900b5a69d9b2ee3d48bc89fb9631a33c6f2970b08845cbf5006fd"
Aug 04 19:13:09.780162 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:09.780127    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:13:09.789352 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:09.789330    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:13:09.967867 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:09.967838    2565 scope.go:117] "RemoveContainer" containerID="75671fc9aac0eda2c902744f80079f4f27c0fb06f82c5d0869cf1085ec8fd388"
Aug 04 19:13:10.443254 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:10.443217    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"]
Aug 04 19:13:10.447546 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:10.447516    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7afb35-rzjzj"]
Aug 04 19:13:11.570428 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:11.570391    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0c5eb1-1faa-4560-b333-20807b07b9c2" path="/var/lib/kubelet/pods/2b0c5eb1-1faa-4560-b333-20807b07b9c2/volumes"
Aug 04 19:13:12.377602 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:12.377563    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:13:17.098184 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:17.098145    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"]
Aug 04 19:13:17.098666 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:17.098361    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy" containerID="cri-o://ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a" gracePeriod=30
Aug 04 19:13:22.360652 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.360582    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:13:22.484924 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.484883    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-data\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485125 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.484936    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-credential-socket\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485125 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.484960    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6258de73-414a-4230-9fa0-69541e2679f8-istiod-ca-cert\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485125 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt8cq\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-kube-api-access-gt8cq\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485125 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-certs\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485125 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485053    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6258de73-414a-4230-9fa0-69541e2679f8-istio-podinfo\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485125 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485083    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-socket\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485436 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485172    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-envoy\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485436 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-istio-token\") pod \"6258de73-414a-4230-9fa0-69541e2679f8\" (UID: \"6258de73-414a-4230-9fa0-69541e2679f8\") "
Aug 04 19:13:22.485436 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485194    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:13:22.485436 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485295    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:13:22.485436 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485339    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:13:22.485669 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485460    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:13:22.485669 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6258de73-414a-4230-9fa0-69541e2679f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:13:22.485669 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485519    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:22.485669 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485538    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:22.485669 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.485551    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:22.487427 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.487402    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6258de73-414a-4230-9fa0-69541e2679f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 19:13:22.487541 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.487437    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-kube-api-access-gt8cq" (OuterVolumeSpecName: "kube-api-access-gt8cq") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "kube-api-access-gt8cq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:13:22.487936 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.487917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:13:22.488031 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.487931    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6258de73-414a-4230-9fa0-69541e2679f8" (UID: "6258de73-414a-4230-9fa0-69541e2679f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:13:22.587035 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.587000    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt8cq\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-kube-api-access-gt8cq\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:22.587035 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.587029    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6258de73-414a-4230-9fa0-69541e2679f8-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:22.587035 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.587038    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:22.587273 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.587047    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6258de73-414a-4230-9fa0-69541e2679f8-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:22.587273 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.587058    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6258de73-414a-4230-9fa0-69541e2679f8-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:22.587273 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:22.587066    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6258de73-414a-4230-9fa0-69541e2679f8-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:13:23.034032 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.033998    2565 generic.go:356] "Generic (PLEG): container finished" podID="6258de73-414a-4230-9fa0-69541e2679f8" containerID="ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a" exitCode=0
Aug 04 19:13:23.034217 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.034043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" event={"ID":"6258de73-414a-4230-9fa0-69541e2679f8","Type":"ContainerDied","Data":"ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a"}
Aug 04 19:13:23.034217 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.034047    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"
Aug 04 19:13:23.034217 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.034111    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6" event={"ID":"6258de73-414a-4230-9fa0-69541e2679f8","Type":"ContainerDied","Data":"ca536cc539d532ef37462eff878b466e095aa92a6c8d230fefbc7b5d87fb9d8b"}
Aug 04 19:13:23.034217 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.034134    2565 scope.go:117] "RemoveContainer" containerID="ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a"
Aug 04 19:13:23.045132 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.045116    2565 scope.go:117] "RemoveContainer" containerID="7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef"
Aug 04 19:13:23.053554 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.053531    2565 scope.go:117] "RemoveContainer" containerID="ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a"
Aug 04 19:13:23.053826 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:13:23.053799    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a\": container with ID starting with ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a not found: ID does not exist" containerID="ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a"
Aug 04 19:13:23.053908 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.053839    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a"} err="failed to get container status \"ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a\": rpc error: code = NotFound desc = could not find container \"ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a\": container with ID starting with ec0a152b448cd7ff9c77f9826c45051cb9364900ef560bf360f6f7f99ec4659a not found: ID does not exist"
Aug 04 19:13:23.053908 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.053865    2565 scope.go:117] "RemoveContainer" containerID="7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef"
Aug 04 19:13:23.054138 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:13:23.054120    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef\": container with ID starting with 7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef not found: ID does not exist" containerID="7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef"
Aug 04 19:13:23.054194 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.054148    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef"} err="failed to get container status \"7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef\": rpc error: code = NotFound desc = could not find container \"7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef\": container with ID starting with 7a4416dd9a44ee24b8e04ccb36d13daa9a0d4957354bce2e53986e6e4d951eef not found: ID does not exist"
Aug 04 19:13:23.058670 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.058648    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"]
Aug 04 19:13:23.067325 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.067305    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6"]
Aug 04 19:13:23.575951 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:23.575916    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6258de73-414a-4230-9fa0-69541e2679f8" path="/var/lib/kubelet/pods/6258de73-414a-4230-9fa0-69541e2679f8/volumes"
Aug 04 19:13:24.481662 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:24.481626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:13:51.655918 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.655872    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"]
Aug 04 19:13:51.656514 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.656493    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0c5eb1-1faa-4560-b333-20807b07b9c2" containerName="revoke-keys"
Aug 04 19:13:51.656601 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.656518    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0c5eb1-1faa-4560-b333-20807b07b9c2" containerName="revoke-keys"
Aug 04 19:13:51.656601 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.656542    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy"
Aug 04 19:13:51.656601 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.656552    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy"
Aug 04 19:13:51.656756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.656672    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy"
Aug 04 19:13:51.656756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.656686    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b0c5eb1-1faa-4560-b333-20807b07b9c2" containerName="revoke-keys"
Aug 04 19:13:51.656756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.656700    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy"
Aug 04 19:13:51.659871 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.659849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.662374 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.662350    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 19:13:51.662487 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.662396    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1a00f6-openshift-default-dockercfg-k2lt8\""
Aug 04 19:13:51.670562 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.670533    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"]
Aug 04 19:13:51.774960 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.774910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw88d\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-kube-api-access-dw88d\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.775185 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.774978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-envoy\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.775185 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.775021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-certs\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.775185 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.775046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-data\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.775185 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.775087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b742b666-921e-4799-ad2d-f598bb833965-istiod-ca-cert\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.775185 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.775165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b742b666-921e-4799-ad2d-f598bb833965-istio-podinfo\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.775418 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.775194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-credential-socket\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.775418 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.775233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-socket\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.775418 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.775260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-istio-token\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876445 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw88d\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-kube-api-access-dw88d\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-envoy\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-certs\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-data\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876658 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b742b666-921e-4799-ad2d-f598bb833965-istiod-ca-cert\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876941 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b742b666-921e-4799-ad2d-f598bb833965-istio-podinfo\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876941 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-credential-socket\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876941 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-socket\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.876941 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.876852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-istio-token\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.877141 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.877039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-certs\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.877225 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.877200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-data\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.877283 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.877264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-credential-socket\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.877352 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.877305    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-socket\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.877405 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.877392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b742b666-921e-4799-ad2d-f598bb833965-istiod-ca-cert\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.879132 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.879106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-envoy\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.879517 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.879490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b742b666-921e-4799-ad2d-f598bb833965-istio-podinfo\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.885638 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.885598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-istio-token\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.885973 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.885948    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw88d\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-kube-api-access-dw88d\") pod \"e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") " pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:51.972395 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:51.972300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:52.119821 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:52.119793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"]
Aug 04 19:13:52.121340 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:13:52.121312    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb742b666_921e_4799_ad2d_f598bb833965.slice/crio-b12443557188a23ba7413c37abbae65eed477ca5a8f9102fa15871e9de4f2a4a WatchSource:0}: Error finding container b12443557188a23ba7413c37abbae65eed477ca5a8f9102fa15871e9de4f2a4a: Status 404 returned error can't find the container with id b12443557188a23ba7413c37abbae65eed477ca5a8f9102fa15871e9de4f2a4a
Aug 04 19:13:52.123682 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:52.123638    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:13:52.123793 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:52.123722    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:13:52.123793 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:52.123753    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:13:52.215625 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:52.215593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" event={"ID":"b742b666-921e-4799-ad2d-f598bb833965","Type":"ContainerStarted","Data":"0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2"}
Aug 04 19:13:52.215864 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:52.215655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" event={"ID":"b742b666-921e-4799-ad2d-f598bb833965","Type":"ContainerStarted","Data":"b12443557188a23ba7413c37abbae65eed477ca5a8f9102fa15871e9de4f2a4a"}
Aug 04 19:13:52.236737 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:52.236654    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podStartSLOduration=1.236631605 podStartE2EDuration="1.236631605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:13:52.236001903 +0000 UTC m=+2743.203892462" watchObservedRunningTime="2026-08-04 19:13:52.236631605 +0000 UTC m=+2743.204522222"
Aug 04 19:13:52.973161 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:52.973109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:53.978090 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:53.978057    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:54.228356 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:54.228263    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:54.229899 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:54.229876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:13:58.570831 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:13:58.570799    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:14:09.229549 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:09.229514    2565 patch_prober.go:28] interesting pod/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 19:14:09.229991 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:09.229572    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 19:14:09.334621 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:09.334584    2565 generic.go:356] "Generic (PLEG): container finished" podID="b742b666-921e-4799-ad2d-f598bb833965" containerID="0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2" exitCode=0
Aug 04 19:14:09.334811 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:09.334657    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" event={"ID":"b742b666-921e-4799-ad2d-f598bb833965","Type":"ContainerDied","Data":"0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2"}
Aug 04 19:14:09.335092 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:09.335078    2565 scope.go:117] "RemoveContainer" containerID="0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2"
Aug 04 19:14:09.336175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:09.336144    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:14:09.336282 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:09.336231    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:14:09.336282 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:09.336276    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:14:10.342786 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:10.342682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" event={"ID":"b742b666-921e-4799-ad2d-f598bb833965","Type":"ContainerStarted","Data":"4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d"}
Aug 04 19:14:10.972914 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:10.972859    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:14:10.973171 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:10.973147    2565 patch_prober.go:28] interesting pod/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 19:14:10.973223 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:10.973202    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 19:14:11.973390 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:11.973342    2565 patch_prober.go:28] interesting pod/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 19:14:11.973920 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:11.973420    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 19:14:12.973288 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:12.973249    2565 patch_prober.go:28] interesting pod/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 19:14:12.973486 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:12.973306    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 19:14:13.973647 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:13.973600    2565 patch_prober.go:28] interesting pod/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 19:14:13.974102 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:13.973672    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 19:14:14.973175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:14.973134    2565 patch_prober.go:28] interesting pod/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 19:14:14.973366 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:14.973195    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 19:14:15.976944 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:15.976912    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:14:15.977352 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:15.977189    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:14:15.977895 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:15.977868    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:14:26.478610 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:14:26.478568    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:15:00.139977 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.139925    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"]
Aug 04 19:15:00.140593 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.140574    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy"
Aug 04 19:15:00.140645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.140596    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6258de73-414a-4230-9fa0-69541e2679f8" containerName="istio-proxy"
Aug 04 19:15:00.144252 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.144231    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"]
Aug 04 19:15:00.144364 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.144344    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"
Aug 04 19:15:00.147371 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.147348    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:15:00.147865 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.147848    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj"]
Aug 04 19:15:00.147962 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.147949    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"
Aug 04 19:15:00.151421 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.151395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj"
Aug 04 19:15:00.155005 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.154299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"]
Aug 04 19:15:00.159183 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.159153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"]
Aug 04 19:15:00.159354 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.159333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"
Aug 04 19:15:00.163058 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.163035    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj"]
Aug 04 19:15:00.170482 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.170461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"
Aug 04 19:15:00.208646 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.208583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj"
Aug 04 19:15:00.341645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.341590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"]
Aug 04 19:15:00.344965 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:15:00.344932    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94558ff9_e9c2_4625_8a95_0d2ef2338ecb.slice/crio-8a4188921a1a0ed227d3099ea588a906d80b363e471fbd817c9fc45f10c745bd WatchSource:0}: Error finding container 8a4188921a1a0ed227d3099ea588a906d80b363e471fbd817c9fc45f10c745bd: Status 404 returned error can't find the container with id 8a4188921a1a0ed227d3099ea588a906d80b363e471fbd817c9fc45f10c745bd
Aug 04 19:15:00.374878 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.374849    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"]
Aug 04 19:15:00.379398 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:15:00.379366    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d920475_9efe_4bb1_bba8_0eb467bd5ccb.slice/crio-9546ff5da0c7bc97439870c83143ad845496be6a5b868b074e17b9da55f0295b WatchSource:0}: Error finding container 9546ff5da0c7bc97439870c83143ad845496be6a5b868b074e17b9da55f0295b: Status 404 returned error can't find the container with id 9546ff5da0c7bc97439870c83143ad845496be6a5b868b074e17b9da55f0295b
Aug 04 19:15:00.400184 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.400149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj"]
Aug 04 19:15:00.400847 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:15:00.400819    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3fee13_45d3_405d_abb9_c11a182d951b.slice/crio-de8d7eb17fffefba4631e61c3d4d812c1c46ea2809ccdef7926cb7fdc3a5c80b WatchSource:0}: Error finding container de8d7eb17fffefba4631e61c3d4d812c1c46ea2809ccdef7926cb7fdc3a5c80b: Status 404 returned error can't find the container with id de8d7eb17fffefba4631e61c3d4d812c1c46ea2809ccdef7926cb7fdc3a5c80b
Aug 04 19:15:00.646534 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.646496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt" event={"ID":"7d920475-9efe-4bb1-bba8-0eb467bd5ccb","Type":"ContainerStarted","Data":"9546ff5da0c7bc97439870c83143ad845496be6a5b868b074e17b9da55f0295b"}
Aug 04 19:15:00.647672 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.647644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj" event={"ID":"aa3fee13-45d3-405d-abb9-c11a182d951b","Type":"ContainerStarted","Data":"de8d7eb17fffefba4631e61c3d4d812c1c46ea2809ccdef7926cb7fdc3a5c80b"}
Aug 04 19:15:00.648850 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:00.648787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg" event={"ID":"94558ff9-e9c2-4625-8a95-0d2ef2338ecb","Type":"ContainerStarted","Data":"8a4188921a1a0ed227d3099ea588a906d80b363e471fbd817c9fc45f10c745bd"}
Aug 04 19:15:01.656038 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:01.655938    2565 generic.go:356] "Generic (PLEG): container finished" podID="aa3fee13-45d3-405d-abb9-c11a182d951b" containerID="d57a4ed9c8a823efe90a1731bec93957bf4f3738c76e19c2461b0b58b05d7475" exitCode=0
Aug 04 19:15:01.656457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:01.656031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj" event={"ID":"aa3fee13-45d3-405d-abb9-c11a182d951b","Type":"ContainerDied","Data":"d57a4ed9c8a823efe90a1731bec93957bf4f3738c76e19c2461b0b58b05d7475"}
Aug 04 19:15:01.657634 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:01.657610    2565 generic.go:356] "Generic (PLEG): container finished" podID="94558ff9-e9c2-4625-8a95-0d2ef2338ecb" containerID="cfa22ee4c14ea9151e00b25b5b3c3a23109f43fe0e415983fcb702c5f7d7d87d" exitCode=0
Aug 04 19:15:01.657767 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:01.657689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg" event={"ID":"94558ff9-e9c2-4625-8a95-0d2ef2338ecb","Type":"ContainerDied","Data":"cfa22ee4c14ea9151e00b25b5b3c3a23109f43fe0e415983fcb702c5f7d7d87d"}
Aug 04 19:15:01.659168 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:01.659143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt" event={"ID":"7d920475-9efe-4bb1-bba8-0eb467bd5ccb","Type":"ContainerDied","Data":"7650f16ed70951d5f92838bc3c88fea0e8a03d3311f3afdb912f86979a00746b"}
Aug 04 19:15:01.659168 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:01.659127    2565 generic.go:356] "Generic (PLEG): container finished" podID="7d920475-9efe-4bb1-bba8-0eb467bd5ccb" containerID="7650f16ed70951d5f92838bc3c88fea0e8a03d3311f3afdb912f86979a00746b" exitCode=0
Aug 04 19:15:02.823541 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:02.823502    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj"
Aug 04 19:15:02.862268 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:02.862236    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"
Aug 04 19:15:02.865965 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:02.865939    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"
Aug 04 19:15:03.676844 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.676809    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"
Aug 04 19:15:03.676844 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.676818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt" event={"ID":"7d920475-9efe-4bb1-bba8-0eb467bd5ccb","Type":"ContainerDied","Data":"9546ff5da0c7bc97439870c83143ad845496be6a5b868b074e17b9da55f0295b"}
Aug 04 19:15:03.677097 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.676882    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9546ff5da0c7bc97439870c83143ad845496be6a5b868b074e17b9da55f0295b"
Aug 04 19:15:03.678558 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.678538    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj"
Aug 04 19:15:03.678708 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.678573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764515-2g7gj" event={"ID":"aa3fee13-45d3-405d-abb9-c11a182d951b","Type":"ContainerDied","Data":"de8d7eb17fffefba4631e61c3d4d812c1c46ea2809ccdef7926cb7fdc3a5c80b"}
Aug 04 19:15:03.678708 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.678634    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de8d7eb17fffefba4631e61c3d4d812c1c46ea2809ccdef7926cb7fdc3a5c80b"
Aug 04 19:15:03.680195 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.680169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg" event={"ID":"94558ff9-e9c2-4625-8a95-0d2ef2338ecb","Type":"ContainerDied","Data":"8a4188921a1a0ed227d3099ea588a906d80b363e471fbd817c9fc45f10c745bd"}
Aug 04 19:15:03.680195 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.680188    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"
Aug 04 19:15:03.680372 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:03.680218    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a4188921a1a0ed227d3099ea588a906d80b363e471fbd817c9fc45f10c745bd"
Aug 04 19:15:13.496857 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.496820    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"]
Aug 04 19:15:13.497354 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497229    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3fee13-45d3-405d-abb9-c11a182d951b" containerName="cleanup"
Aug 04 19:15:13.497354 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497241    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3fee13-45d3-405d-abb9-c11a182d951b" containerName="cleanup"
Aug 04 19:15:13.497354 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497251    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d920475-9efe-4bb1-bba8-0eb467bd5ccb" containerName="cleanup"
Aug 04 19:15:13.497354 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497257    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d920475-9efe-4bb1-bba8-0eb467bd5ccb" containerName="cleanup"
Aug 04 19:15:13.497354 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497275    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94558ff9-e9c2-4625-8a95-0d2ef2338ecb" containerName="cleanup"
Aug 04 19:15:13.497354 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497281    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94558ff9-e9c2-4625-8a95-0d2ef2338ecb" containerName="cleanup"
Aug 04 19:15:13.497565 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497366    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d920475-9efe-4bb1-bba8-0eb467bd5ccb" containerName="cleanup"
Aug 04 19:15:13.497565 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497380    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa3fee13-45d3-405d-abb9-c11a182d951b" containerName="cleanup"
Aug 04 19:15:13.497565 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.497387    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="94558ff9-e9c2-4625-8a95-0d2ef2338ecb" containerName="cleanup"
Aug 04 19:15:13.500769 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.500747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.503358 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.503329    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a00f6\"/\"openshift-service-ca.crt\""
Aug 04 19:15:13.504255 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.504230    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a00f6\"/\"auth-test-model-1a00f6-kserve-self-signed-certs\""
Aug 04 19:15:13.504388 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.504270    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a00f6\"/\"kube-root-ca.crt\""
Aug 04 19:15:13.504388 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.504349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a00f6\"/\"default-dockercfg-7snqf\""
Aug 04 19:15:13.511556 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.511523    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"]
Aug 04 19:15:13.587262 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.587223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-dshm\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.587457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.587290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-home\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.587457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.587374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-tmp-dir\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.587457 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.587443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-model-cache\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.587588 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.587483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25e357f-e935-4248-812f-1f1d9425b9eb-tls-certs\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.587588 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.587505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7pl9\" (UniqueName: \"kubernetes.io/projected/d25e357f-e935-4248-812f-1f1d9425b9eb-kube-api-access-s7pl9\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.688599 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.688563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-tmp-dir\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.688828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.688616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-model-cache\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.688828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.688652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25e357f-e935-4248-812f-1f1d9425b9eb-tls-certs\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.688828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.688674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7pl9\" (UniqueName: \"kubernetes.io/projected/d25e357f-e935-4248-812f-1f1d9425b9eb-kube-api-access-s7pl9\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.688828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.688697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-dshm\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.688828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.688746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-home\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.689147 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.689099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-tmp-dir\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.689191 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.689155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-model-cache\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.689191 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.689183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-home\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.691152 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.691122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-dshm\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.691409 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.691390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25e357f-e935-4248-812f-1f1d9425b9eb-tls-certs\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.696569 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.696542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7pl9\" (UniqueName: \"kubernetes.io/projected/d25e357f-e935-4248-812f-1f1d9425b9eb-kube-api-access-s7pl9\") pod \"auth-test-model-1a00f6-kserve-66556c856c-svn59\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") " pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.812481 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.812383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:13.982859 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:13.982828    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"]
Aug 04 19:15:13.984448 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:15:13.984413    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd25e357f_e935_4248_812f_1f1d9425b9eb.slice/crio-bf3c9f07514f8226ac385bc5df0f1ef3bd02e5ec32fcabf34983f6ee4daf2b9b WatchSource:0}: Error finding container bf3c9f07514f8226ac385bc5df0f1ef3bd02e5ec32fcabf34983f6ee4daf2b9b: Status 404 returned error can't find the container with id bf3c9f07514f8226ac385bc5df0f1ef3bd02e5ec32fcabf34983f6ee4daf2b9b
Aug 04 19:15:14.751845 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:14.751801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59" event={"ID":"d25e357f-e935-4248-812f-1f1d9425b9eb","Type":"ContainerStarted","Data":"63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885"}
Aug 04 19:15:14.751845 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:14.751856    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59" event={"ID":"d25e357f-e935-4248-812f-1f1d9425b9eb","Type":"ContainerStarted","Data":"bf3c9f07514f8226ac385bc5df0f1ef3bd02e5ec32fcabf34983f6ee4daf2b9b"}
Aug 04 19:15:14.770406 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:14.770346    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59" podStartSLOduration=1.7703291330000002 podStartE2EDuration="1.770329133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:15:14.767761474 +0000 UTC m=+2825.735652021" watchObservedRunningTime="2026-08-04 19:15:14.770329133 +0000 UTC m=+2825.738219681"
Aug 04 19:15:15.969236 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:15.969158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:15:23.813066 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:23.813030    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:23.813585 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:23.813112    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:23.825646 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:23.825616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:24.823227 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:24.823197    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:15:39.765556 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:39.765515    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:15:53.068324 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:15:53.068288    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:16:00.922205 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:16:00.922119    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:16:08.070191 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:16:08.070145    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:16:19.665229 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:16:19.665184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:16:30.974360 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:16:30.974251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:16:46.478813 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:16:46.478765    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:16:57.972585 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:16:57.972544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:17:12.679512 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:17:12.679475    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:17:23.872366 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:17:23.872319    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:17:39.175997 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:17:39.175904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:17:50.575808 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:17:50.575759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:18:05.477943 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:05.477888    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:18:08.486680 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:08.486636    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"]
Aug 04 19:18:09.836094 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:09.836053    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:18:09.838272 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:09.838246    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:18:10.035649 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:10.035615    2565 scope.go:117] "RemoveContainer" containerID="a420b72f6ae9b1524827f2e1defbb362a8f1596eae10151ec429b56794c67a07"
Aug 04 19:18:10.045039 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:10.045018    2565 scope.go:117] "RemoveContainer" containerID="6bc0ed935ab58fd42190ce9b44c45ef625ba11425d2e93b5f4824dbb0234c6aa"
Aug 04 19:18:13.874194 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.874158    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"]
Aug 04 19:18:13.879134 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.879113    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:13.881633 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.881603    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1d2c46\"/\"openshift-service-ca.crt\""
Aug 04 19:18:13.881769 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.881638    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1d2c46\"/\"kube-root-ca.crt\""
Aug 04 19:18:13.882614 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.882591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1d2c46\"/\"default-dockercfg-5fxxj\""
Aug 04 19:18:13.882721 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.882620    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1d2c46\"/\"sub-test-model-1d2c46-kserve-self-signed-certs\""
Aug 04 19:18:13.890927 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.890900    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"]
Aug 04 19:18:13.957733 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.957693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aee28b21-08cb-41c6-bbe2-3419f2434b27-tls-certs\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:13.957957 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.957754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-home\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:13.957957 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.957803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-dshm\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:13.957957 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.957869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-model-cache\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:13.957957 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.957902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42dhp\" (UniqueName: \"kubernetes.io/projected/aee28b21-08cb-41c6-bbe2-3419f2434b27-kube-api-access-42dhp\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:13.958113 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:13.957967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-tmp-dir\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.058741 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.058698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-model-cache\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.058974 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.058754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42dhp\" (UniqueName: \"kubernetes.io/projected/aee28b21-08cb-41c6-bbe2-3419f2434b27-kube-api-access-42dhp\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.058974 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.058887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-tmp-dir\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.058974 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.058915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aee28b21-08cb-41c6-bbe2-3419f2434b27-tls-certs\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.058974 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.058971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-home\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.059223 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.058996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-dshm\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.059302 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.059276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-model-cache\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.059302 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.059294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-tmp-dir\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.059418 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.059328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-home\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.061411 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.061373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-dshm\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.061534 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.061486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aee28b21-08cb-41c6-bbe2-3419f2434b27-tls-certs\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.067625 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.067603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42dhp\" (UniqueName: \"kubernetes.io/projected/aee28b21-08cb-41c6-bbe2-3419f2434b27-kube-api-access-42dhp\") pod \"sub-test-model-1d2c46-kserve-69fd8d6595-l55lg\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") " pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.189514 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.189409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:14.337185 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.337157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"]
Aug 04 19:18:14.338199 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:18:14.338171    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaee28b21_08cb_41c6_bbe2_3419f2434b27.slice/crio-2d9c2066b1c087b569846febccb430cf3ad89db2c00d5b7a705a893b6a15f7eb WatchSource:0}: Error finding container 2d9c2066b1c087b569846febccb430cf3ad89db2c00d5b7a705a893b6a15f7eb: Status 404 returned error can't find the container with id 2d9c2066b1c087b569846febccb430cf3ad89db2c00d5b7a705a893b6a15f7eb
Aug 04 19:18:14.678866 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.678828    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:18:14.874767 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.874724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg" event={"ID":"aee28b21-08cb-41c6-bbe2-3419f2434b27","Type":"ContainerStarted","Data":"1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9"}
Aug 04 19:18:14.875210 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.874809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg" event={"ID":"aee28b21-08cb-41c6-bbe2-3419f2434b27","Type":"ContainerStarted","Data":"2d9c2066b1c087b569846febccb430cf3ad89db2c00d5b7a705a893b6a15f7eb"}
Aug 04 19:18:14.894006 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:14.893951    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg" podStartSLOduration=1.893929246 podStartE2EDuration="1.893929246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:18:14.891531823 +0000 UTC m=+3005.859422368" watchObservedRunningTime="2026-08-04 19:18:14.893929246 +0000 UTC m=+3005.861819818"
Aug 04 19:18:20.481038 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:20.481003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:18:23.507439 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.507368    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59" podUID="d25e357f-e935-4248-812f-1f1d9425b9eb" containerName="main" containerID="cri-o://63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885" gracePeriod=45
Aug 04 19:18:23.760233 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.760167    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:18:23.875063 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875030    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25e357f-e935-4248-812f-1f1d9425b9eb-tls-certs\") pod \"d25e357f-e935-4248-812f-1f1d9425b9eb\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") "
Aug 04 19:18:23.875257 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875119    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-tmp-dir\") pod \"d25e357f-e935-4248-812f-1f1d9425b9eb\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") "
Aug 04 19:18:23.875257 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875136    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-model-cache\") pod \"d25e357f-e935-4248-812f-1f1d9425b9eb\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") "
Aug 04 19:18:23.875257 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-dshm\") pod \"d25e357f-e935-4248-812f-1f1d9425b9eb\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") "
Aug 04 19:18:23.875257 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875191    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7pl9\" (UniqueName: \"kubernetes.io/projected/d25e357f-e935-4248-812f-1f1d9425b9eb-kube-api-access-s7pl9\") pod \"d25e357f-e935-4248-812f-1f1d9425b9eb\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") "
Aug 04 19:18:23.875478 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875283    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-home\") pod \"d25e357f-e935-4248-812f-1f1d9425b9eb\" (UID: \"d25e357f-e935-4248-812f-1f1d9425b9eb\") "
Aug 04 19:18:23.875478 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875454    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-model-cache" (OuterVolumeSpecName: "model-cache") pod "d25e357f-e935-4248-812f-1f1d9425b9eb" (UID: "d25e357f-e935-4248-812f-1f1d9425b9eb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:18:23.875599 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875470    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d25e357f-e935-4248-812f-1f1d9425b9eb" (UID: "d25e357f-e935-4248-812f-1f1d9425b9eb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:18:23.875599 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875500    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-home" (OuterVolumeSpecName: "home") pod "d25e357f-e935-4248-812f-1f1d9425b9eb" (UID: "d25e357f-e935-4248-812f-1f1d9425b9eb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:18:23.875792 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875753    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:18:23.875844 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875796    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:18:23.875844 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.875810    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:18:23.877495 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.877465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25e357f-e935-4248-812f-1f1d9425b9eb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d25e357f-e935-4248-812f-1f1d9425b9eb" (UID: "d25e357f-e935-4248-812f-1f1d9425b9eb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:18:23.877495 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.877465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-dshm" (OuterVolumeSpecName: "dshm") pod "d25e357f-e935-4248-812f-1f1d9425b9eb" (UID: "d25e357f-e935-4248-812f-1f1d9425b9eb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:18:23.877650 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.877500    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25e357f-e935-4248-812f-1f1d9425b9eb-kube-api-access-s7pl9" (OuterVolumeSpecName: "kube-api-access-s7pl9") pod "d25e357f-e935-4248-812f-1f1d9425b9eb" (UID: "d25e357f-e935-4248-812f-1f1d9425b9eb"). InnerVolumeSpecName "kube-api-access-s7pl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:18:23.934157 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.934124    2565 generic.go:356] "Generic (PLEG): container finished" podID="d25e357f-e935-4248-812f-1f1d9425b9eb" containerID="63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885" exitCode=0
Aug 04 19:18:23.934351 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.934168    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"
Aug 04 19:18:23.934351 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.934214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59" event={"ID":"d25e357f-e935-4248-812f-1f1d9425b9eb","Type":"ContainerDied","Data":"63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885"}
Aug 04 19:18:23.934351 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.934262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59" event={"ID":"d25e357f-e935-4248-812f-1f1d9425b9eb","Type":"ContainerDied","Data":"bf3c9f07514f8226ac385bc5df0f1ef3bd02e5ec32fcabf34983f6ee4daf2b9b"}
Aug 04 19:18:23.934351 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.934283    2565 scope.go:117] "RemoveContainer" containerID="63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885"
Aug 04 19:18:23.944116 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.944099    2565 scope.go:117] "RemoveContainer" containerID="63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885"
Aug 04 19:18:23.944395 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:18:23.944370    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885\": container with ID starting with 63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885 not found: ID does not exist" containerID="63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885"
Aug 04 19:18:23.944483 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.944404    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885"} err="failed to get container status \"63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885\": rpc error: code = NotFound desc = could not find container \"63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885\": container with ID starting with 63ba02f41c807c9da5ee804e6562dfd77f89fabddc2624b8aea5ededa3784885 not found: ID does not exist"
Aug 04 19:18:23.956601 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.956576    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"]
Aug 04 19:18:23.960742 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.960715    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1a00f6/auth-test-model-1a00f6-kserve-66556c856c-svn59"]
Aug 04 19:18:23.976570 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.976547    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25e357f-e935-4248-812f-1f1d9425b9eb-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:18:23.976570 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.976570    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7pl9\" (UniqueName: \"kubernetes.io/projected/d25e357f-e935-4248-812f-1f1d9425b9eb-kube-api-access-s7pl9\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:18:23.976722 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:23.976580    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25e357f-e935-4248-812f-1f1d9425b9eb-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:18:24.190157 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:24.190065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:24.190157 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:24.190121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:24.202895 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:24.202864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:24.953654 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:24.953621    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:18:25.571517 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:25.571484    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25e357f-e935-4248-812f-1f1d9425b9eb" path="/var/lib/kubelet/pods/d25e357f-e935-4248-812f-1f1d9425b9eb/volumes"
Aug 04 19:18:38.406683 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:18:38.406640    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:19:10.073000 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:10.072961    2565 scope.go:117] "RemoveContainer" containerID="32719fcd558663ab71f14882b375ecd4078621a87098d0dc1b58419ccd51201f"
Aug 04 19:19:10.081967 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:10.081944    2565 scope.go:117] "RemoveContainer" containerID="66c25a29c8944d4e3324c8fed878423ea33116816eedc21e51eb62af85deff96"
Aug 04 19:19:15.720662 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:15.720623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:19:27.279632 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:27.279595    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:19:39.466949 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:39.466913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:19:43.498425 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:43.498390    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"]
Aug 04 19:19:49.603065 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:49.603022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:19:58.518260 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.518221    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg" podUID="aee28b21-08cb-41c6-bbe2-3419f2434b27" containerName="main" containerID="cri-o://1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9" gracePeriod=45
Aug 04 19:19:58.780102 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.780031    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:19:58.825023 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.824953    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aee28b21-08cb-41c6-bbe2-3419f2434b27-tls-certs\") pod \"aee28b21-08cb-41c6-bbe2-3419f2434b27\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") "
Aug 04 19:19:58.825023 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.825039    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-model-cache\") pod \"aee28b21-08cb-41c6-bbe2-3419f2434b27\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") "
Aug 04 19:19:58.825399 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.825150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-home\") pod \"aee28b21-08cb-41c6-bbe2-3419f2434b27\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") "
Aug 04 19:19:58.825399 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.825265    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-dshm\") pod \"aee28b21-08cb-41c6-bbe2-3419f2434b27\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") "
Aug 04 19:19:58.825399 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.825359    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-model-cache" (OuterVolumeSpecName: "model-cache") pod "aee28b21-08cb-41c6-bbe2-3419f2434b27" (UID: "aee28b21-08cb-41c6-bbe2-3419f2434b27"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:19:58.825586 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.825411    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42dhp\" (UniqueName: \"kubernetes.io/projected/aee28b21-08cb-41c6-bbe2-3419f2434b27-kube-api-access-42dhp\") pod \"aee28b21-08cb-41c6-bbe2-3419f2434b27\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") "
Aug 04 19:19:58.825586 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.825408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-home" (OuterVolumeSpecName: "home") pod "aee28b21-08cb-41c6-bbe2-3419f2434b27" (UID: "aee28b21-08cb-41c6-bbe2-3419f2434b27"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:19:58.825586 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.825486    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-tmp-dir\") pod \"aee28b21-08cb-41c6-bbe2-3419f2434b27\" (UID: \"aee28b21-08cb-41c6-bbe2-3419f2434b27\") "
Aug 04 19:19:58.825875 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.825791    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aee28b21-08cb-41c6-bbe2-3419f2434b27" (UID: "aee28b21-08cb-41c6-bbe2-3419f2434b27"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:19:58.826162 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.826134    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:19:58.826162 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.826161    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:19:58.826376 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.826176    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:19:58.828301 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.828253    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-dshm" (OuterVolumeSpecName: "dshm") pod "aee28b21-08cb-41c6-bbe2-3419f2434b27" (UID: "aee28b21-08cb-41c6-bbe2-3419f2434b27"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:19:58.828505 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.828354    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aee28b21-08cb-41c6-bbe2-3419f2434b27-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aee28b21-08cb-41c6-bbe2-3419f2434b27" (UID: "aee28b21-08cb-41c6-bbe2-3419f2434b27"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:19:58.828505 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.828362    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee28b21-08cb-41c6-bbe2-3419f2434b27-kube-api-access-42dhp" (OuterVolumeSpecName: "kube-api-access-42dhp") pod "aee28b21-08cb-41c6-bbe2-3419f2434b27" (UID: "aee28b21-08cb-41c6-bbe2-3419f2434b27"). InnerVolumeSpecName "kube-api-access-42dhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:19:58.926756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.926722    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aee28b21-08cb-41c6-bbe2-3419f2434b27-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:19:58.926756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.926754    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42dhp\" (UniqueName: \"kubernetes.io/projected/aee28b21-08cb-41c6-bbe2-3419f2434b27-kube-api-access-42dhp\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:19:58.926756 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:58.926764    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aee28b21-08cb-41c6-bbe2-3419f2434b27-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:19:59.269862 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.269826    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"]
Aug 04 19:19:59.270357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.270338    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aee28b21-08cb-41c6-bbe2-3419f2434b27" containerName="main"
Aug 04 19:19:59.270357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.270357    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aee28b21-08cb-41c6-bbe2-3419f2434b27" containerName="main"
Aug 04 19:19:59.270499 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.270370    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25e357f-e935-4248-812f-1f1d9425b9eb" containerName="main"
Aug 04 19:19:59.270499 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.270375    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25e357f-e935-4248-812f-1f1d9425b9eb" containerName="main"
Aug 04 19:19:59.270499 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.270461    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25e357f-e935-4248-812f-1f1d9425b9eb" containerName="main"
Aug 04 19:19:59.270499 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.270469    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aee28b21-08cb-41c6-bbe2-3419f2434b27" containerName="main"
Aug 04 19:19:59.273726 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.273709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.276330 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.276310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1d2c46\"/\"rate-test-model-1d2c46-kserve-self-signed-certs\""
Aug 04 19:19:59.284753 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.284694    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"]
Aug 04 19:19:59.330605 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.330564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-home\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.330829 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.330627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b945f206-752f-44b7-ac64-157201450239-tls-certs\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.330829 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.330688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-dshm\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.330829 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.330741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-tmp-dir\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.330829 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.330802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-model-cache\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.330829 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.330824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62sgl\" (UniqueName: \"kubernetes.io/projected/b945f206-752f-44b7-ac64-157201450239-kube-api-access-62sgl\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.431640 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.431600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b945f206-752f-44b7-ac64-157201450239-tls-certs\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.431640 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.431645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-dshm\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.431907 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.431694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-tmp-dir\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.431907 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.431736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-model-cache\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.431907 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.431762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62sgl\" (UniqueName: \"kubernetes.io/projected/b945f206-752f-44b7-ac64-157201450239-kube-api-access-62sgl\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.431907 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.431854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-home\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.432242 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.432219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-tmp-dir\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.432318 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.432252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-model-cache\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.432318 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.432287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-home\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.434574 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.434557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-dshm\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.434870 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.434850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b945f206-752f-44b7-ac64-157201450239-tls-certs\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.439731 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.439709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62sgl\" (UniqueName: \"kubernetes.io/projected/b945f206-752f-44b7-ac64-157201450239-kube-api-access-62sgl\") pod \"rate-test-model-1d2c46-kserve-56d648cc95-8wtdv\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") " pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.521330 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.521232    2565 generic.go:356] "Generic (PLEG): container finished" podID="aee28b21-08cb-41c6-bbe2-3419f2434b27" containerID="1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9" exitCode=0
Aug 04 19:19:59.521330 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.521293    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"
Aug 04 19:19:59.521330 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.521299    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg" event={"ID":"aee28b21-08cb-41c6-bbe2-3419f2434b27","Type":"ContainerDied","Data":"1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9"}
Aug 04 19:19:59.521938 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.521336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg" event={"ID":"aee28b21-08cb-41c6-bbe2-3419f2434b27","Type":"ContainerDied","Data":"2d9c2066b1c087b569846febccb430cf3ad89db2c00d5b7a705a893b6a15f7eb"}
Aug 04 19:19:59.521938 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.521352    2565 scope.go:117] "RemoveContainer" containerID="1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9"
Aug 04 19:19:59.539993 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.539964    2565 scope.go:117] "RemoveContainer" containerID="1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9"
Aug 04 19:19:59.540303 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:19:59.540281    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9\": container with ID starting with 1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9 not found: ID does not exist" containerID="1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9"
Aug 04 19:19:59.540352 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.540316    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9"} err="failed to get container status \"1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9\": rpc error: code = NotFound desc = could not find container \"1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9\": container with ID starting with 1fb6e90eecabeef12e944aa6438d23f2166a32947c2de6c3e3ccddf30c1a1cc9 not found: ID does not exist"
Aug 04 19:19:59.551310 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.551277    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"]
Aug 04 19:19:59.555076 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.555048    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/sub-test-model-1d2c46-kserve-69fd8d6595-l55lg"]
Aug 04 19:19:59.570656 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.570626    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aee28b21-08cb-41c6-bbe2-3419f2434b27" path="/var/lib/kubelet/pods/aee28b21-08cb-41c6-bbe2-3419f2434b27/volumes"
Aug 04 19:19:59.584573 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.584543    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:19:59.731481 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:19:59.731453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"]
Aug 04 19:19:59.733879 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:19:59.733846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb945f206_752f_44b7_ac64_157201450239.slice/crio-3aefcee77b21729dcfe9fa86393e7e428d29455feba0ecd1455814df474f682e WatchSource:0}: Error finding container 3aefcee77b21729dcfe9fa86393e7e428d29455feba0ecd1455814df474f682e: Status 404 returned error can't find the container with id 3aefcee77b21729dcfe9fa86393e7e428d29455feba0ecd1455814df474f682e
Aug 04 19:20:00.529074 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:00.529036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv" event={"ID":"b945f206-752f-44b7-ac64-157201450239","Type":"ContainerStarted","Data":"52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c"}
Aug 04 19:20:00.529564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:00.529092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv" event={"ID":"b945f206-752f-44b7-ac64-157201450239","Type":"ContainerStarted","Data":"3aefcee77b21729dcfe9fa86393e7e428d29455feba0ecd1455814df474f682e"}
Aug 04 19:20:00.547107 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:00.547047    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv" podStartSLOduration=1.547031981 podStartE2EDuration="1.547031981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:20:00.545029704 +0000 UTC m=+3111.512920278" watchObservedRunningTime="2026-08-04 19:20:00.547031981 +0000 UTC m=+3111.514922505"
Aug 04 19:20:01.667087 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:01.667052    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:20:09.585225 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:09.585195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:20:09.585754 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:09.585249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:20:09.597838 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:09.597809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:20:10.600250 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:10.600212    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:20:47.400419 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:20:47.400331    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:21:22.381273 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:22.381233    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:21:30.866513 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:30.866462    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:21:46.780425 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:46.780387    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:21:51.982397 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:51.982359    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"]
Aug 04 19:21:53.801485 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:53.801439    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140139631640112"]
Aug 04 19:21:53.804948 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:53.804931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631640112"
Aug 04 19:21:53.807405 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:53.807380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9rxf8\""
Aug 04 19:21:53.809522 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:53.809497    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631640112"]
Aug 04 19:21:53.873648 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:53.873608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmgv\" (UniqueName: \"kubernetes.io/projected/783f01dd-dd0f-48ac-86c2-f6a2d17022d8-kube-api-access-pwmgv\") pod \"test-curl-7556-140139631640112\" (UID: \"783f01dd-dd0f-48ac-86c2-f6a2d17022d8\") " pod="opendatahub/test-curl-7556-140139631640112"
Aug 04 19:21:53.974788 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:53.974748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmgv\" (UniqueName: \"kubernetes.io/projected/783f01dd-dd0f-48ac-86c2-f6a2d17022d8-kube-api-access-pwmgv\") pod \"test-curl-7556-140139631640112\" (UID: \"783f01dd-dd0f-48ac-86c2-f6a2d17022d8\") " pod="opendatahub/test-curl-7556-140139631640112"
Aug 04 19:21:53.984131 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:53.984105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmgv\" (UniqueName: \"kubernetes.io/projected/783f01dd-dd0f-48ac-86c2-f6a2d17022d8-kube-api-access-pwmgv\") pod \"test-curl-7556-140139631640112\" (UID: \"783f01dd-dd0f-48ac-86c2-f6a2d17022d8\") " pod="opendatahub/test-curl-7556-140139631640112"
Aug 04 19:21:54.116212 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:54.116120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631640112"
Aug 04 19:21:54.251466 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:54.251436    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631640112"]
Aug 04 19:21:54.253446 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:21:54.253412    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod783f01dd_dd0f_48ac_86c2_f6a2d17022d8.slice/crio-2e24d3d715ef5cad51383ddb940be919495c05164a838a92e00982e95008d6c8 WatchSource:0}: Error finding container 2e24d3d715ef5cad51383ddb940be919495c05164a838a92e00982e95008d6c8: Status 404 returned error can't find the container with id 2e24d3d715ef5cad51383ddb940be919495c05164a838a92e00982e95008d6c8
Aug 04 19:21:54.254843 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:54.254826    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 19:21:55.219552 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:55.219469    2565 generic.go:356] "Generic (PLEG): container finished" podID="783f01dd-dd0f-48ac-86c2-f6a2d17022d8" containerID="d3f46877533dcf5268474a6c38c74f6d02dba2e0943758bf4b5a90e9f5356792" exitCode=0
Aug 04 19:21:55.219963 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:55.219553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631640112" event={"ID":"783f01dd-dd0f-48ac-86c2-f6a2d17022d8","Type":"ContainerDied","Data":"d3f46877533dcf5268474a6c38c74f6d02dba2e0943758bf4b5a90e9f5356792"}
Aug 04 19:21:55.219963 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:55.219595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631640112" event={"ID":"783f01dd-dd0f-48ac-86c2-f6a2d17022d8","Type":"ContainerStarted","Data":"2e24d3d715ef5cad51383ddb940be919495c05164a838a92e00982e95008d6c8"}
Aug 04 19:21:55.870328 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:55.870291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:21:56.380481 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.380450    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631640112"
Aug 04 19:21:56.417049 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.417020    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140139631640112_783f01dd-dd0f-48ac-86c2-f6a2d17022d8/test-curl-7556-140139631640112/0.log"
Aug 04 19:21:56.439078 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.439039    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140139631640112"]
Aug 04 19:21:56.442360 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.442333    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140139631640112"]
Aug 04 19:21:56.499236 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.499205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwmgv\" (UniqueName: \"kubernetes.io/projected/783f01dd-dd0f-48ac-86c2-f6a2d17022d8-kube-api-access-pwmgv\") pod \"783f01dd-dd0f-48ac-86c2-f6a2d17022d8\" (UID: \"783f01dd-dd0f-48ac-86c2-f6a2d17022d8\") "
Aug 04 19:21:56.501500 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.501471    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/783f01dd-dd0f-48ac-86c2-f6a2d17022d8-kube-api-access-pwmgv" (OuterVolumeSpecName: "kube-api-access-pwmgv") pod "783f01dd-dd0f-48ac-86c2-f6a2d17022d8" (UID: "783f01dd-dd0f-48ac-86c2-f6a2d17022d8"). InnerVolumeSpecName "kube-api-access-pwmgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:21:56.562285 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.562253    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140139631653936"]
Aug 04 19:21:56.562692 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.562677    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="783f01dd-dd0f-48ac-86c2-f6a2d17022d8" containerName="test-curl-7556-140139631640112"
Aug 04 19:21:56.562735 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.562694    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="783f01dd-dd0f-48ac-86c2-f6a2d17022d8" containerName="test-curl-7556-140139631640112"
Aug 04 19:21:56.562771 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.562756    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="783f01dd-dd0f-48ac-86c2-f6a2d17022d8" containerName="test-curl-7556-140139631640112"
Aug 04 19:21:56.565949 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.565933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631653936"
Aug 04 19:21:56.571083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.571054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631653936"]
Aug 04 19:21:56.600466 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.600429    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwmgv\" (UniqueName: \"kubernetes.io/projected/783f01dd-dd0f-48ac-86c2-f6a2d17022d8-kube-api-access-pwmgv\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:21:56.701772 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.701734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzhm9\" (UniqueName: \"kubernetes.io/projected/461ce2a7-9a1b-49be-b2c0-79bc4edeebed-kube-api-access-rzhm9\") pod \"test-curl-7556-140139631653936\" (UID: \"461ce2a7-9a1b-49be-b2c0-79bc4edeebed\") " pod="opendatahub/test-curl-7556-140139631653936"
Aug 04 19:21:56.802927 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.802836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzhm9\" (UniqueName: \"kubernetes.io/projected/461ce2a7-9a1b-49be-b2c0-79bc4edeebed-kube-api-access-rzhm9\") pod \"test-curl-7556-140139631653936\" (UID: \"461ce2a7-9a1b-49be-b2c0-79bc4edeebed\") " pod="opendatahub/test-curl-7556-140139631653936"
Aug 04 19:21:56.811502 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.811475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzhm9\" (UniqueName: \"kubernetes.io/projected/461ce2a7-9a1b-49be-b2c0-79bc4edeebed-kube-api-access-rzhm9\") pod \"test-curl-7556-140139631653936\" (UID: \"461ce2a7-9a1b-49be-b2c0-79bc4edeebed\") " pod="opendatahub/test-curl-7556-140139631653936"
Aug 04 19:21:56.876571 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:56.876536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631653936"
Aug 04 19:21:57.010026 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:57.009998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631653936"]
Aug 04 19:21:57.011545 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:21:57.011520    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod461ce2a7_9a1b_49be_b2c0_79bc4edeebed.slice/crio-ccc43072fcb59976d5305268c1fdb7ba37d25b5b78046dd18146a8a36c20739f WatchSource:0}: Error finding container ccc43072fcb59976d5305268c1fdb7ba37d25b5b78046dd18146a8a36c20739f: Status 404 returned error can't find the container with id ccc43072fcb59976d5305268c1fdb7ba37d25b5b78046dd18146a8a36c20739f
Aug 04 19:21:57.232969 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:57.232878    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631640112"
Aug 04 19:21:57.232969 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:57.232936    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e24d3d715ef5cad51383ddb940be919495c05164a838a92e00982e95008d6c8"
Aug 04 19:21:57.234072 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:57.234045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631653936" event={"ID":"461ce2a7-9a1b-49be-b2c0-79bc4edeebed","Type":"ContainerStarted","Data":"ccc43072fcb59976d5305268c1fdb7ba37d25b5b78046dd18146a8a36c20739f"}
Aug 04 19:21:57.243630 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:21:57.243594    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7556-140139631640112\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="783f01dd-dd0f-48ac-86c2-f6a2d17022d8" pod="opendatahub/test-curl-7556-140139631640112"
Aug 04 19:21:57.571697 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:57.571664    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="783f01dd-dd0f-48ac-86c2-f6a2d17022d8" path="/var/lib/kubelet/pods/783f01dd-dd0f-48ac-86c2-f6a2d17022d8/volumes"
Aug 04 19:21:58.241270 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:58.241235    2565 generic.go:356] "Generic (PLEG): container finished" podID="461ce2a7-9a1b-49be-b2c0-79bc4edeebed" containerID="2da53b285cbbbf5c8200c03a371f10b29cadba06e3cbac58dc5a69e3e5ed321b" exitCode=0
Aug 04 19:21:58.241497 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:58.241318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631653936" event={"ID":"461ce2a7-9a1b-49be-b2c0-79bc4edeebed","Type":"ContainerDied","Data":"2da53b285cbbbf5c8200c03a371f10b29cadba06e3cbac58dc5a69e3e5ed321b"}
Aug 04 19:21:59.383168 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.383140    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631653936"
Aug 04 19:21:59.406201 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.406180    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140139631653936_461ce2a7-9a1b-49be-b2c0-79bc4edeebed/test-curl-7556-140139631653936/0.log"
Aug 04 19:21:59.429327 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.429302    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140139631653936"]
Aug 04 19:21:59.432671 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.432650    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140139631653936"]
Aug 04 19:21:59.529920 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.529844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzhm9\" (UniqueName: \"kubernetes.io/projected/461ce2a7-9a1b-49be-b2c0-79bc4edeebed-kube-api-access-rzhm9\") pod \"461ce2a7-9a1b-49be-b2c0-79bc4edeebed\" (UID: \"461ce2a7-9a1b-49be-b2c0-79bc4edeebed\") "
Aug 04 19:21:59.531903 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.531883    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461ce2a7-9a1b-49be-b2c0-79bc4edeebed-kube-api-access-rzhm9" (OuterVolumeSpecName: "kube-api-access-rzhm9") pod "461ce2a7-9a1b-49be-b2c0-79bc4edeebed" (UID: "461ce2a7-9a1b-49be-b2c0-79bc4edeebed"). InnerVolumeSpecName "kube-api-access-rzhm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:21:59.570717 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.570691    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461ce2a7-9a1b-49be-b2c0-79bc4edeebed" path="/var/lib/kubelet/pods/461ce2a7-9a1b-49be-b2c0-79bc4edeebed/volumes"
Aug 04 19:21:59.582447 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.582425    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:21:59.582837 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.582824    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461ce2a7-9a1b-49be-b2c0-79bc4edeebed" containerName="test-curl-7556-140139631653936"
Aug 04 19:21:59.582881 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.582838    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="461ce2a7-9a1b-49be-b2c0-79bc4edeebed" containerName="test-curl-7556-140139631653936"
Aug 04 19:21:59.582925 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.582915    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="461ce2a7-9a1b-49be-b2c0-79bc4edeebed" containerName="test-curl-7556-140139631653936"
Aug 04 19:21:59.585753 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.585740    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:21:59.590592 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.590570    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:21:59.630890 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.630865    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzhm9\" (UniqueName: \"kubernetes.io/projected/461ce2a7-9a1b-49be-b2c0-79bc4edeebed-kube-api-access-rzhm9\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:21:59.731674 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.731646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhkx\" (UniqueName: \"kubernetes.io/projected/b83b8543-33f1-46f3-b977-3011d95bdfab-kube-api-access-rfhkx\") pod \"test-curl-7556-140139631688992\" (UID: \"b83b8543-33f1-46f3-b977-3011d95bdfab\") " pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:21:59.833173 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.833079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhkx\" (UniqueName: \"kubernetes.io/projected/b83b8543-33f1-46f3-b977-3011d95bdfab-kube-api-access-rfhkx\") pod \"test-curl-7556-140139631688992\" (UID: \"b83b8543-33f1-46f3-b977-3011d95bdfab\") " pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:21:59.841069 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.841040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhkx\" (UniqueName: \"kubernetes.io/projected/b83b8543-33f1-46f3-b977-3011d95bdfab-kube-api-access-rfhkx\") pod \"test-curl-7556-140139631688992\" (UID: \"b83b8543-33f1-46f3-b977-3011d95bdfab\") " pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:21:59.897589 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:21:59.897564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:00.027056 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:00.027030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:22:00.028500 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:22:00.028473    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb83b8543_33f1_46f3_b977_3011d95bdfab.slice/crio-50cf08aa6cc98163dc05cf8a2399c4280e593b19a26a0b0207b310e5d9b7147e WatchSource:0}: Error finding container 50cf08aa6cc98163dc05cf8a2399c4280e593b19a26a0b0207b310e5d9b7147e: Status 404 returned error can't find the container with id 50cf08aa6cc98163dc05cf8a2399c4280e593b19a26a0b0207b310e5d9b7147e
Aug 04 19:22:00.253672 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:00.253643    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631653936"
Aug 04 19:22:00.253841 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:00.253689    2565 scope.go:117] "RemoveContainer" containerID="2da53b285cbbbf5c8200c03a371f10b29cadba06e3cbac58dc5a69e3e5ed321b"
Aug 04 19:22:00.255056 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:00.255034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631688992" event={"ID":"b83b8543-33f1-46f3-b977-3011d95bdfab","Type":"ContainerStarted","Data":"50cf08aa6cc98163dc05cf8a2399c4280e593b19a26a0b0207b310e5d9b7147e"}
Aug 04 19:22:01.262624 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:01.262541    2565 generic.go:356] "Generic (PLEG): container finished" podID="b83b8543-33f1-46f3-b977-3011d95bdfab" containerID="344f3ce08c92a27b3398e0293e63bf5714a2cd13d50309e0177940bd68979f15" exitCode=0
Aug 04 19:22:01.263203 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:01.262629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631688992" event={"ID":"b83b8543-33f1-46f3-b977-3011d95bdfab","Type":"ContainerDied","Data":"344f3ce08c92a27b3398e0293e63bf5714a2cd13d50309e0177940bd68979f15"}
Aug 04 19:22:02.409568 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.409541    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:02.428718 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.428690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140139631688992_b83b8543-33f1-46f3-b977-3011d95bdfab/test-curl-7556-140139631688992/0.log"
Aug 04 19:22:02.448713 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.448683    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:22:02.452678 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.452650    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:22:02.556845 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.556747    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfhkx\" (UniqueName: \"kubernetes.io/projected/b83b8543-33f1-46f3-b977-3011d95bdfab-kube-api-access-rfhkx\") pod \"b83b8543-33f1-46f3-b977-3011d95bdfab\" (UID: \"b83b8543-33f1-46f3-b977-3011d95bdfab\") "
Aug 04 19:22:02.558848 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.558825    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83b8543-33f1-46f3-b977-3011d95bdfab-kube-api-access-rfhkx" (OuterVolumeSpecName: "kube-api-access-rfhkx") pod "b83b8543-33f1-46f3-b977-3011d95bdfab" (UID: "b83b8543-33f1-46f3-b977-3011d95bdfab"). InnerVolumeSpecName "kube-api-access-rfhkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:22:02.563494 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.563469    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:22:02.563890 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.563876    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83b8543-33f1-46f3-b977-3011d95bdfab" containerName="test-curl-7556-140139631688992"
Aug 04 19:22:02.563939 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.563892    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83b8543-33f1-46f3-b977-3011d95bdfab" containerName="test-curl-7556-140139631688992"
Aug 04 19:22:02.563995 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.563984    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b83b8543-33f1-46f3-b977-3011d95bdfab" containerName="test-curl-7556-140139631688992"
Aug 04 19:22:02.567241 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.567219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:02.574590 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.574532    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:22:02.658343 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.658292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/b6e9013a-0c27-4a03-9a01-c4f33550d0d4-kube-api-access-nc7gc\") pod \"test-curl-7556-140139631688992\" (UID: \"b6e9013a-0c27-4a03-9a01-c4f33550d0d4\") " pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:02.658540 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.658376    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfhkx\" (UniqueName: \"kubernetes.io/projected/b83b8543-33f1-46f3-b977-3011d95bdfab-kube-api-access-rfhkx\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:02.759719 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.759619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/b6e9013a-0c27-4a03-9a01-c4f33550d0d4-kube-api-access-nc7gc\") pod \"test-curl-7556-140139631688992\" (UID: \"b6e9013a-0c27-4a03-9a01-c4f33550d0d4\") " pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:02.770845 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.770714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/b6e9013a-0c27-4a03-9a01-c4f33550d0d4-kube-api-access-nc7gc\") pod \"test-curl-7556-140139631688992\" (UID: \"b6e9013a-0c27-4a03-9a01-c4f33550d0d4\") " pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:02.879171 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:02.879072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:03.014659 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:03.014628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:22:03.016839 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:22:03.016813    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6e9013a_0c27_4a03_9a01_c4f33550d0d4.slice/crio-ce6f91c524f07d16b5e4d1d04b1fd672f6a27c29fca749e9c2faab3c2accffea WatchSource:0}: Error finding container ce6f91c524f07d16b5e4d1d04b1fd672f6a27c29fca749e9c2faab3c2accffea: Status 404 returned error can't find the container with id ce6f91c524f07d16b5e4d1d04b1fd672f6a27c29fca749e9c2faab3c2accffea
Aug 04 19:22:03.277723 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:03.277694    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:03.277944 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:03.277729    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50cf08aa6cc98163dc05cf8a2399c4280e593b19a26a0b0207b310e5d9b7147e"
Aug 04 19:22:03.279018 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:03.278982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631688992" event={"ID":"b6e9013a-0c27-4a03-9a01-c4f33550d0d4","Type":"ContainerStarted","Data":"ce6f91c524f07d16b5e4d1d04b1fd672f6a27c29fca749e9c2faab3c2accffea"}
Aug 04 19:22:03.290365 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:03.290333    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7556-140139631688992" oldPodUID="b83b8543-33f1-46f3-b977-3011d95bdfab" podUID="b6e9013a-0c27-4a03-9a01-c4f33550d0d4"
Aug 04 19:22:03.571130 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:03.571052    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83b8543-33f1-46f3-b977-3011d95bdfab" path="/var/lib/kubelet/pods/b83b8543-33f1-46f3-b977-3011d95bdfab/volumes"
Aug 04 19:22:04.286082 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:04.286045    2565 generic.go:356] "Generic (PLEG): container finished" podID="b6e9013a-0c27-4a03-9a01-c4f33550d0d4" containerID="d1824d62a5e02a5f3141b06c1942458267c1c7a2f44741b6deedad322e2018e9" exitCode=0
Aug 04 19:22:04.286255 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:04.286142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631688992" event={"ID":"b6e9013a-0c27-4a03-9a01-c4f33550d0d4","Type":"ContainerDied","Data":"d1824d62a5e02a5f3141b06c1942458267c1c7a2f44741b6deedad322e2018e9"}
Aug 04 19:22:05.443474 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.443443    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:05.465721 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.465688    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140139631688992_b6e9013a-0c27-4a03-9a01-c4f33550d0d4/test-curl-7556-140139631688992/0.log"
Aug 04 19:22:05.490345 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.490303    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:22:05.494025 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.493993    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140139631688992"]
Aug 04 19:22:05.586385 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.586297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/b6e9013a-0c27-4a03-9a01-c4f33550d0d4-kube-api-access-nc7gc\") pod \"b6e9013a-0c27-4a03-9a01-c4f33550d0d4\" (UID: \"b6e9013a-0c27-4a03-9a01-c4f33550d0d4\") "
Aug 04 19:22:05.588514 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.588479    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e9013a-0c27-4a03-9a01-c4f33550d0d4-kube-api-access-nc7gc" (OuterVolumeSpecName: "kube-api-access-nc7gc") pod "b6e9013a-0c27-4a03-9a01-c4f33550d0d4" (UID: "b6e9013a-0c27-4a03-9a01-c4f33550d0d4"). InnerVolumeSpecName "kube-api-access-nc7gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:22:05.609246 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.609208    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:05.609652 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.609636    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e9013a-0c27-4a03-9a01-c4f33550d0d4" containerName="test-curl-7556-140139631688992"
Aug 04 19:22:05.609726 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.609653    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e9013a-0c27-4a03-9a01-c4f33550d0d4" containerName="test-curl-7556-140139631688992"
Aug 04 19:22:05.609762 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.609744    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e9013a-0c27-4a03-9a01-c4f33550d0d4" containerName="test-curl-7556-140139631688992"
Aug 04 19:22:05.613004 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.612987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:05.618522 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.618492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:05.687716 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.687658    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc7gc\" (UniqueName: \"kubernetes.io/projected/b6e9013a-0c27-4a03-9a01-c4f33550d0d4-kube-api-access-nc7gc\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:05.789023 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.788982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4h4k\" (UniqueName: \"kubernetes.io/projected/e2e94a90-f8ae-44d9-b8b1-7bf520669f87-kube-api-access-s4h4k\") pod \"test-curl-7556-140139631665488\" (UID: \"e2e94a90-f8ae-44d9-b8b1-7bf520669f87\") " pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:05.890601 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.890510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4h4k\" (UniqueName: \"kubernetes.io/projected/e2e94a90-f8ae-44d9-b8b1-7bf520669f87-kube-api-access-s4h4k\") pod \"test-curl-7556-140139631665488\" (UID: \"e2e94a90-f8ae-44d9-b8b1-7bf520669f87\") " pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:05.899213 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.899186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4h4k\" (UniqueName: \"kubernetes.io/projected/e2e94a90-f8ae-44d9-b8b1-7bf520669f87-kube-api-access-s4h4k\") pod \"test-curl-7556-140139631665488\" (UID: \"e2e94a90-f8ae-44d9-b8b1-7bf520669f87\") " pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:05.923088 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:05.923055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:06.285590 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:06.285560    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:06.287310 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:22:06.287276    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2e94a90_f8ae_44d9_b8b1_7bf520669f87.slice/crio-a7b4c94e889ec78cd9b4670ffe4d601a21925d0342d1e915be9961bf0fa8b618 WatchSource:0}: Error finding container a7b4c94e889ec78cd9b4670ffe4d601a21925d0342d1e915be9961bf0fa8b618: Status 404 returned error can't find the container with id a7b4c94e889ec78cd9b4670ffe4d601a21925d0342d1e915be9961bf0fa8b618
Aug 04 19:22:06.301852 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:06.301815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631665488" event={"ID":"e2e94a90-f8ae-44d9-b8b1-7bf520669f87","Type":"ContainerStarted","Data":"a7b4c94e889ec78cd9b4670ffe4d601a21925d0342d1e915be9961bf0fa8b618"}
Aug 04 19:22:06.303175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:06.303155    2565 scope.go:117] "RemoveContainer" containerID="d1824d62a5e02a5f3141b06c1942458267c1c7a2f44741b6deedad322e2018e9"
Aug 04 19:22:06.303295 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:06.303182    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631688992"
Aug 04 19:22:07.001719 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.001677    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv" podUID="b945f206-752f-44b7-ac64-157201450239" containerName="main" containerID="cri-o://52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c" gracePeriod=45
Aug 04 19:22:07.251346 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.251320    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:22:07.311915 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.311821    2565 generic.go:356] "Generic (PLEG): container finished" podID="b945f206-752f-44b7-ac64-157201450239" containerID="52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c" exitCode=0
Aug 04 19:22:07.311915 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.311868    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"
Aug 04 19:22:07.312150 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.311909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv" event={"ID":"b945f206-752f-44b7-ac64-157201450239","Type":"ContainerDied","Data":"52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c"}
Aug 04 19:22:07.312150 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.311953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv" event={"ID":"b945f206-752f-44b7-ac64-157201450239","Type":"ContainerDied","Data":"3aefcee77b21729dcfe9fa86393e7e428d29455feba0ecd1455814df474f682e"}
Aug 04 19:22:07.312150 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.311972    2565 scope.go:117] "RemoveContainer" containerID="52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c"
Aug 04 19:22:07.313620 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.313596    2565 generic.go:356] "Generic (PLEG): container finished" podID="e2e94a90-f8ae-44d9-b8b1-7bf520669f87" containerID="4e9a11f701295a614a6c148df58b88b1e50c16c09b2138525edd305dd03d7846" exitCode=0
Aug 04 19:22:07.313720 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.313668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631665488" event={"ID":"e2e94a90-f8ae-44d9-b8b1-7bf520669f87","Type":"ContainerDied","Data":"4e9a11f701295a614a6c148df58b88b1e50c16c09b2138525edd305dd03d7846"}
Aug 04 19:22:07.321660 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.321642    2565 scope.go:117] "RemoveContainer" containerID="52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c"
Aug 04 19:22:07.321955 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:22:07.321932    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c\": container with ID starting with 52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c not found: ID does not exist" containerID="52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c"
Aug 04 19:22:07.322030 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.321964    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c"} err="failed to get container status \"52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c\": rpc error: code = NotFound desc = could not find container \"52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c\": container with ID starting with 52ea9e7ddccfec6ee691b20dbf348f4cc7fe068af2dd1d56c3d6582daf47425c not found: ID does not exist"
Aug 04 19:22:07.403950 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.403911    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-home\") pod \"b945f206-752f-44b7-ac64-157201450239\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") "
Aug 04 19:22:07.404144 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.403972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62sgl\" (UniqueName: \"kubernetes.io/projected/b945f206-752f-44b7-ac64-157201450239-kube-api-access-62sgl\") pod \"b945f206-752f-44b7-ac64-157201450239\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") "
Aug 04 19:22:07.404144 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404095    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-dshm\") pod \"b945f206-752f-44b7-ac64-157201450239\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") "
Aug 04 19:22:07.404144 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-model-cache\") pod \"b945f206-752f-44b7-ac64-157201450239\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") "
Aug 04 19:22:07.404275 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b945f206-752f-44b7-ac64-157201450239-tls-certs\") pod \"b945f206-752f-44b7-ac64-157201450239\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") "
Aug 04 19:22:07.404275 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-tmp-dir\") pod \"b945f206-752f-44b7-ac64-157201450239\" (UID: \"b945f206-752f-44b7-ac64-157201450239\") "
Aug 04 19:22:07.404275 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404246    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-home" (OuterVolumeSpecName: "home") pod "b945f206-752f-44b7-ac64-157201450239" (UID: "b945f206-752f-44b7-ac64-157201450239"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:22:07.404446 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404376    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-model-cache" (OuterVolumeSpecName: "model-cache") pod "b945f206-752f-44b7-ac64-157201450239" (UID: "b945f206-752f-44b7-ac64-157201450239"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:22:07.404526 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404504    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b945f206-752f-44b7-ac64-157201450239" (UID: "b945f206-752f-44b7-ac64-157201450239"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:22:07.404665 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404649    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:07.404710 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404671    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:07.404710 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.404683    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:07.406197 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.406171    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-dshm" (OuterVolumeSpecName: "dshm") pod "b945f206-752f-44b7-ac64-157201450239" (UID: "b945f206-752f-44b7-ac64-157201450239"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:22:07.406245 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.406177    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b945f206-752f-44b7-ac64-157201450239-kube-api-access-62sgl" (OuterVolumeSpecName: "kube-api-access-62sgl") pod "b945f206-752f-44b7-ac64-157201450239" (UID: "b945f206-752f-44b7-ac64-157201450239"). InnerVolumeSpecName "kube-api-access-62sgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:22:07.406340 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.406321    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b945f206-752f-44b7-ac64-157201450239-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b945f206-752f-44b7-ac64-157201450239" (UID: "b945f206-752f-44b7-ac64-157201450239"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:22:07.505389 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.505353    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b945f206-752f-44b7-ac64-157201450239-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:07.505389 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.505382    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b945f206-752f-44b7-ac64-157201450239-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:07.505389 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.505393    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62sgl\" (UniqueName: \"kubernetes.io/projected/b945f206-752f-44b7-ac64-157201450239-kube-api-access-62sgl\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:07.571038 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.570956    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e9013a-0c27-4a03-9a01-c4f33550d0d4" path="/var/lib/kubelet/pods/b6e9013a-0c27-4a03-9a01-c4f33550d0d4/volumes"
Aug 04 19:22:07.629195 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.629149    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"]
Aug 04 19:22:07.635753 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:07.635716    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1d2c46/rate-test-model-1d2c46-kserve-56d648cc95-8wtdv"]
Aug 04 19:22:08.468771 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.468744    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:08.491175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.491147    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140139631665488_e2e94a90-f8ae-44d9-b8b1-7bf520669f87/test-curl-7556-140139631665488/0.log"
Aug 04 19:22:08.513474 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.513423    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:08.517120 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.517083    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:08.618558 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.618453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4h4k\" (UniqueName: \"kubernetes.io/projected/e2e94a90-f8ae-44d9-b8b1-7bf520669f87-kube-api-access-s4h4k\") pod \"e2e94a90-f8ae-44d9-b8b1-7bf520669f87\" (UID: \"e2e94a90-f8ae-44d9-b8b1-7bf520669f87\") "
Aug 04 19:22:08.620879 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.620849    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2e94a90-f8ae-44d9-b8b1-7bf520669f87-kube-api-access-s4h4k" (OuterVolumeSpecName: "kube-api-access-s4h4k") pod "e2e94a90-f8ae-44d9-b8b1-7bf520669f87" (UID: "e2e94a90-f8ae-44d9-b8b1-7bf520669f87"). InnerVolumeSpecName "kube-api-access-s4h4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:22:08.628451 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.628424    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:08.628919 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.628905    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b945f206-752f-44b7-ac64-157201450239" containerName="main"
Aug 04 19:22:08.628970 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.628922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b945f206-752f-44b7-ac64-157201450239" containerName="main"
Aug 04 19:22:08.628970 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.628939    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e94a90-f8ae-44d9-b8b1-7bf520669f87" containerName="test-curl-7556-140139631665488"
Aug 04 19:22:08.628970 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.628948    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e94a90-f8ae-44d9-b8b1-7bf520669f87" containerName="test-curl-7556-140139631665488"
Aug 04 19:22:08.629061 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.629044    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2e94a90-f8ae-44d9-b8b1-7bf520669f87" containerName="test-curl-7556-140139631665488"
Aug 04 19:22:08.629061 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.629054    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b945f206-752f-44b7-ac64-157201450239" containerName="main"
Aug 04 19:22:08.632073 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.632056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:08.636896 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.636871    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:08.720799 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.720743    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4h4k\" (UniqueName: \"kubernetes.io/projected/e2e94a90-f8ae-44d9-b8b1-7bf520669f87-kube-api-access-s4h4k\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:08.821338 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.821302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gcqn\" (UniqueName: \"kubernetes.io/projected/3947ea6e-d979-4f51-ab00-1a960563195b-kube-api-access-8gcqn\") pod \"test-curl-7556-140139631665488\" (UID: \"3947ea6e-d979-4f51-ab00-1a960563195b\") " pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:08.922082 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.921989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gcqn\" (UniqueName: \"kubernetes.io/projected/3947ea6e-d979-4f51-ab00-1a960563195b-kube-api-access-8gcqn\") pod \"test-curl-7556-140139631665488\" (UID: \"3947ea6e-d979-4f51-ab00-1a960563195b\") " pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:08.930095 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.930064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gcqn\" (UniqueName: \"kubernetes.io/projected/3947ea6e-d979-4f51-ab00-1a960563195b-kube-api-access-8gcqn\") pod \"test-curl-7556-140139631665488\" (UID: \"3947ea6e-d979-4f51-ab00-1a960563195b\") " pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:08.943995 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:08.943962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:09.084353 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:09.084324    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:09.086225 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:22:09.086197    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3947ea6e_d979_4f51_ab00_1a960563195b.slice/crio-4b822caa6c77aa4c5d34e5d1d5c9b3f9baa151b7fbc4e0b00affb16a55c9a35e WatchSource:0}: Error finding container 4b822caa6c77aa4c5d34e5d1d5c9b3f9baa151b7fbc4e0b00affb16a55c9a35e: Status 404 returned error can't find the container with id 4b822caa6c77aa4c5d34e5d1d5c9b3f9baa151b7fbc4e0b00affb16a55c9a35e
Aug 04 19:22:09.327983 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:09.327954    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:09.328157 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:09.328032    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7b4c94e889ec78cd9b4670ffe4d601a21925d0342d1e915be9961bf0fa8b618"
Aug 04 19:22:09.329341 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:09.329303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631665488" event={"ID":"3947ea6e-d979-4f51-ab00-1a960563195b","Type":"ContainerStarted","Data":"4b822caa6c77aa4c5d34e5d1d5c9b3f9baa151b7fbc4e0b00affb16a55c9a35e"}
Aug 04 19:22:09.339825 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:09.339784    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7556-140139631665488" oldPodUID="e2e94a90-f8ae-44d9-b8b1-7bf520669f87" podUID="3947ea6e-d979-4f51-ab00-1a960563195b"
Aug 04 19:22:09.571081 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:09.571041    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b945f206-752f-44b7-ac64-157201450239" path="/var/lib/kubelet/pods/b945f206-752f-44b7-ac64-157201450239/volumes"
Aug 04 19:22:09.571589 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:09.571568    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2e94a90-f8ae-44d9-b8b1-7bf520669f87" path="/var/lib/kubelet/pods/e2e94a90-f8ae-44d9-b8b1-7bf520669f87/volumes"
Aug 04 19:22:10.336655 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:10.336618    2565 generic.go:356] "Generic (PLEG): container finished" podID="3947ea6e-d979-4f51-ab00-1a960563195b" containerID="b1daa3569b2f9e4f8d2ab7aac843a10ba1825e989bf64fe727364ad381497058" exitCode=0
Aug 04 19:22:10.336831 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:10.336699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140139631665488" event={"ID":"3947ea6e-d979-4f51-ab00-1a960563195b","Type":"ContainerDied","Data":"b1daa3569b2f9e4f8d2ab7aac843a10ba1825e989bf64fe727364ad381497058"}
Aug 04 19:22:11.492741 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:11.492711    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:11.511923 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:11.511893    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140139631665488_3947ea6e-d979-4f51-ab00-1a960563195b/test-curl-7556-140139631665488/0.log"
Aug 04 19:22:11.532035 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:11.531998    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:11.535588 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:11.535559    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140139631665488"]
Aug 04 19:22:11.544195 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:11.544166    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gcqn\" (UniqueName: \"kubernetes.io/projected/3947ea6e-d979-4f51-ab00-1a960563195b-kube-api-access-8gcqn\") pod \"3947ea6e-d979-4f51-ab00-1a960563195b\" (UID: \"3947ea6e-d979-4f51-ab00-1a960563195b\") "
Aug 04 19:22:11.546365 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:11.546339    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3947ea6e-d979-4f51-ab00-1a960563195b-kube-api-access-8gcqn" (OuterVolumeSpecName: "kube-api-access-8gcqn") pod "3947ea6e-d979-4f51-ab00-1a960563195b" (UID: "3947ea6e-d979-4f51-ab00-1a960563195b"). InnerVolumeSpecName "kube-api-access-8gcqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:22:11.571147 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:11.571114    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3947ea6e-d979-4f51-ab00-1a960563195b" path="/var/lib/kubelet/pods/3947ea6e-d979-4f51-ab00-1a960563195b/volumes"
Aug 04 19:22:11.645586 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:11.645485    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gcqn\" (UniqueName: \"kubernetes.io/projected/3947ea6e-d979-4f51-ab00-1a960563195b-kube-api-access-8gcqn\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:22:12.313177 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.313133    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"]
Aug 04 19:22:12.313609 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.313595    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3947ea6e-d979-4f51-ab00-1a960563195b" containerName="test-curl-7556-140139631665488"
Aug 04 19:22:12.313677 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.313612    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3947ea6e-d979-4f51-ab00-1a960563195b" containerName="test-curl-7556-140139631665488"
Aug 04 19:22:12.313717 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.313705    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3947ea6e-d979-4f51-ab00-1a960563195b" containerName="test-curl-7556-140139631665488"
Aug 04 19:22:12.317108 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.317090    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.320263 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.320238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-f3a5e8-openshift-default-dockercfg-p55rk\""
Aug 04 19:22:12.350393 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.350329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istiod-ca-cert\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.350877 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.350841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-podinfo\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.351005 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.350879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-certs\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.351005 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.350904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-socket\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.351005 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.350990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-token\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.351175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.351044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-credential-socket\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.351175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.351070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-data\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.351175 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.351153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67q58\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-kube-api-access-67q58\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.351321 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.351265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-envoy\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.352325 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.352288    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"]
Aug 04 19:22:12.352684 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.352669    2565 scope.go:117] "RemoveContainer" containerID="b1daa3569b2f9e4f8d2ab7aac843a10ba1825e989bf64fe727364ad381497058"
Aug 04 19:22:12.352684 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.352684    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140139631665488"
Aug 04 19:22:12.452276 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q58\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-kube-api-access-67q58\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452471 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-envoy\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452471 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istiod-ca-cert\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452471 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-podinfo\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452630 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-certs\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452630 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-socket\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452738 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-token\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452738 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-credential-socket\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452885 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-data\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.452940 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-certs\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.453013 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.452984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-socket\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.453108 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.453088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-data\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.453172 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.453157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-credential-socket\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.453405 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.453385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istiod-ca-cert\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.455145 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.455124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-podinfo\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.455239 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.455175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-envoy\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.466295 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.466266    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67q58\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-kube-api-access-67q58\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.466558 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.466530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-token\") pod \"e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") " pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.627721 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.627623    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:12.779098 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.779067    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"]
Aug 04 19:22:12.781045 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:22:12.781010    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ecbffd_c16d_4c8f_8307_20138f5dfdca.slice/crio-adb798e6656f672bcebf9758cb8285bdccc4fff7451fffb059a2a61b804cabec WatchSource:0}: Error finding container adb798e6656f672bcebf9758cb8285bdccc4fff7451fffb059a2a61b804cabec: Status 404 returned error can't find the container with id adb798e6656f672bcebf9758cb8285bdccc4fff7451fffb059a2a61b804cabec
Aug 04 19:22:12.783522 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.783478    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:22:12.783634 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.783555    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:22:12.783634 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:12.783584    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:22:13.361843 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:13.361803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" event={"ID":"83ecbffd-c16d-4c8f-8307-20138f5dfdca","Type":"ContainerStarted","Data":"4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17"}
Aug 04 19:22:13.362073 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:13.361871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" event={"ID":"83ecbffd-c16d-4c8f-8307-20138f5dfdca","Type":"ContainerStarted","Data":"adb798e6656f672bcebf9758cb8285bdccc4fff7451fffb059a2a61b804cabec"}
Aug 04 19:22:13.386623 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:13.386565    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podStartSLOduration=1.386547541 podStartE2EDuration="1.386547541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:22:13.38460358 +0000 UTC m=+3244.352494129" watchObservedRunningTime="2026-08-04 19:22:13.386547541 +0000 UTC m=+3244.354438086"
Aug 04 19:22:13.628922 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:13.628820    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:13.634033 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:13.634005    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:14.368469 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:14.368434    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:14.369485 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:14.369463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:19.276934 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:19.276896    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:22:29.370011 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:29.369970    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Aug 04 19:22:29.370537 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:29.370057    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Aug 04 19:22:29.467427 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:29.467392    2565 generic.go:356] "Generic (PLEG): container finished" podID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerID="4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17" exitCode=0
Aug 04 19:22:29.467597 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:29.467473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" event={"ID":"83ecbffd-c16d-4c8f-8307-20138f5dfdca","Type":"ContainerDied","Data":"4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17"}
Aug 04 19:22:29.467934 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:29.467919    2565 scope.go:117] "RemoveContainer" containerID="4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17"
Aug 04 19:22:29.469017 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:29.468984    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:22:29.469158 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:29.469129    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:22:29.469232 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:29.469198    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Aug 04 19:22:30.474833 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:30.474798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" event={"ID":"83ecbffd-c16d-4c8f-8307-20138f5dfdca","Type":"ContainerStarted","Data":"b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235"}
Aug 04 19:22:30.628752 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:30.628714    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:30.629135 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:30.629114    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Aug 04 19:22:30.629192 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:30.629173    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Aug 04 19:22:31.628842 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:31.628767    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Aug 04 19:22:31.629240 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:31.628866    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Aug 04 19:22:32.628645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:32.628599    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Aug 04 19:22:32.628870 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:32.628685    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Aug 04 19:22:33.628997 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:33.628949    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Aug 04 19:22:33.629410 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:33.629010    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Aug 04 19:22:34.628509 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:34.628476    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Aug 04 19:22:34.628695 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:34.628532    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Aug 04 19:22:35.628095 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:35.628054    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Aug 04 19:22:35.628527 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:35.628119    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Aug 04 19:22:36.632274 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:36.632243    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:36.632704 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:36.632519    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:36.633198 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:36.633182    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:22:45.719978 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.719935    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"]
Aug 04 19:22:45.724566 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.724536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:45.728462 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.728433    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2lnvj\""
Aug 04 19:22:45.730297 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.730269    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:22:45.730752 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.730724    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-f18332-serving-cert\""
Aug 04 19:22:45.731084 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.731061    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 19:22:45.738883 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.738842    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"]
Aug 04 19:22:45.808439 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.808402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:45.808655 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.808449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d0f1932-7339-429b-9b97-9c113112b1f7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:45.808655 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.808555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4jhg\" (UniqueName: \"kubernetes.io/projected/1d0f1932-7339-429b-9b97-9c113112b1f7-kube-api-access-d4jhg\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:45.909799 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.909714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:45.910229 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.909903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d0f1932-7339-429b-9b97-9c113112b1f7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:45.910229 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.909996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4jhg\" (UniqueName: \"kubernetes.io/projected/1d0f1932-7339-429b-9b97-9c113112b1f7-kube-api-access-d4jhg\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:45.910229 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:22:45.910042    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-serving-cert: secret "maas-api-e2e-ipp-b-f18332-serving-cert" not found
Aug 04 19:22:45.910229 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:22:45.910162    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls podName:1d0f1932-7339-429b-9b97-9c113112b1f7 nodeName:}" failed. No retries permitted until 2026-08-04 19:22:46.410133301 +0000 UTC m=+3277.378023826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls") pod "maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64" (UID: "1d0f1932-7339-429b-9b97-9c113112b1f7") : secret "maas-api-e2e-ipp-b-f18332-serving-cert" not found
Aug 04 19:22:45.911045 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.911001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d0f1932-7339-429b-9b97-9c113112b1f7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:45.921048 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:45.921013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4jhg\" (UniqueName: \"kubernetes.io/projected/1d0f1932-7339-429b-9b97-9c113112b1f7-kube-api-access-d4jhg\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:46.414294 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:46.414260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:46.417180 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:46.417145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:46.642310 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:46.642268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:46.787858 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:46.787826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"]
Aug 04 19:22:46.789835 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:22:46.789801    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d0f1932_7339_429b_9b97_9c113112b1f7.slice/crio-147b1a4b1c67f0598620ad88f121556aebec28f46c33e524726bf0c00ca44909 WatchSource:0}: Error finding container 147b1a4b1c67f0598620ad88f121556aebec28f46c33e524726bf0c00ca44909: Status 404 returned error can't find the container with id 147b1a4b1c67f0598620ad88f121556aebec28f46c33e524726bf0c00ca44909
Aug 04 19:22:47.591470 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:47.591389    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64" event={"ID":"1d0f1932-7339-429b-9b97-9c113112b1f7","Type":"ContainerStarted","Data":"147b1a4b1c67f0598620ad88f121556aebec28f46c33e524726bf0c00ca44909"}
Aug 04 19:22:48.683209 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:48.683169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:22:49.606003 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:49.605959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64" event={"ID":"1d0f1932-7339-429b-9b97-9c113112b1f7","Type":"ContainerStarted","Data":"203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988"}
Aug 04 19:22:49.606224 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:49.606028    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:22:49.624682 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:49.624626    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64" podStartSLOduration=2.486423642 podStartE2EDuration="4.624609025s" totalImagesPullingTime="2.138185383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:22:49.622283204 +0000 UTC m=+3280.590173751" watchObservedRunningTime="2026-08-04 19:22:49.624609025 +0000 UTC m=+3280.592499571"
Aug 04 19:22:55.620197 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:22:55.620164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:23:09.877664 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:09.877636    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:23:09.881095 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:09.881070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:23:28.370791 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.370743    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"]
Aug 04 19:23:28.377710 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.377687    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.380554 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.380520    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-f3a5e8\"/\"kube-root-ca.crt\""
Aug 04 19:23:28.380715 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.380520    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-f3a5e8\"/\"openshift-service-ca.crt\""
Aug 04 19:23:28.380715 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.380532    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-f3a5e8\"/\"default-dockercfg-5k8rd\""
Aug 04 19:23:28.381343 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.381320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-f3a5e8\"/\"ipp-route-f3a5e8-kserve-self-signed-certs\""
Aug 04 19:23:28.382852 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.382825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"]
Aug 04 19:23:28.451283 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.451244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6280cf1-b61e-44e4-a68a-22778a650a5a-tls-certs\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.451475 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.451355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-dshm\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.451475 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.451422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-tmp-dir\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.451475 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.451442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dk4g\" (UniqueName: \"kubernetes.io/projected/f6280cf1-b61e-44e4-a68a-22778a650a5a-kube-api-access-5dk4g\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.451612 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.451475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-home\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.451612 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.451497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-model-cache\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.552556 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.552516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-tmp-dir\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.552556 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.552555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dk4g\" (UniqueName: \"kubernetes.io/projected/f6280cf1-b61e-44e4-a68a-22778a650a5a-kube-api-access-5dk4g\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.552882 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.552587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-home\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.552882 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.552605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-model-cache\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.552882 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.552656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6280cf1-b61e-44e4-a68a-22778a650a5a-tls-certs\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.552882 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.552726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-dshm\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.553135 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.553011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-tmp-dir\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.553135 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.553092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-model-cache\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.553135 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.553094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-home\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.555099 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.555073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-dshm\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.555344 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.555326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6280cf1-b61e-44e4-a68a-22778a650a5a-tls-certs\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.561081 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.561059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dk4g\" (UniqueName: \"kubernetes.io/projected/f6280cf1-b61e-44e4-a68a-22778a650a5a-kube-api-access-5dk4g\") pod \"ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") " pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.689999 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.689894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:28.833935 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.833908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"]
Aug 04 19:23:28.835261 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:23:28.835234    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6280cf1_b61e_44e4_a68a_22778a650a5a.slice/crio-eb69a13429e1003b2491696a72f2c25b0bf7fb0b4e4e951723c2ad75a8261d14 WatchSource:0}: Error finding container eb69a13429e1003b2491696a72f2c25b0bf7fb0b4e4e951723c2ad75a8261d14: Status 404 returned error can't find the container with id eb69a13429e1003b2491696a72f2c25b0bf7fb0b4e4e951723c2ad75a8261d14
Aug 04 19:23:28.846638 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:28.846609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl" event={"ID":"f6280cf1-b61e-44e4-a68a-22778a650a5a","Type":"ContainerStarted","Data":"eb69a13429e1003b2491696a72f2c25b0bf7fb0b4e4e951723c2ad75a8261d14"}
Aug 04 19:23:29.854579 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:29.854546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl" event={"ID":"f6280cf1-b61e-44e4-a68a-22778a650a5a","Type":"ContainerStarted","Data":"36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac"}
Aug 04 19:23:29.873825 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:29.873749    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl" podStartSLOduration=1.8737316800000001 podStartE2EDuration="1.87373168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:23:29.872078183 +0000 UTC m=+3320.839968754" watchObservedRunningTime="2026-08-04 19:23:29.87373168 +0000 UTC m=+3320.841622226"
Aug 04 19:23:30.168030 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:30.167939    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:23:38.690538 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:38.690446    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:38.690538 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:38.690501    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:38.703352 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:38.703323    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:38.932720 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:38.932685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:23:55.476202 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:23:55.476164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:24:16.582948 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:16.582911    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:24:35.742810 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:35.742757    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"]
Aug 04 19:24:35.746592 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:35.746572    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"
Aug 04 19:24:35.749233 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:35.749204    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:24:35.755543 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:35.755489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"]
Aug 04 19:24:35.861189 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:35.861152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec243a-faae-4bef-b39e-ce36230d692f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc\" (UID: \"7aec243a-faae-4bef-b39e-ce36230d692f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"
Aug 04 19:24:35.962028 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:35.961988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec243a-faae-4bef-b39e-ce36230d692f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc\" (UID: \"7aec243a-faae-4bef-b39e-ce36230d692f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"
Aug 04 19:24:35.962654 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:35.962629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec243a-faae-4bef-b39e-ce36230d692f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc\" (UID: \"7aec243a-faae-4bef-b39e-ce36230d692f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"
Aug 04 19:24:36.059486 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:36.059390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"
Aug 04 19:24:36.204105 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:36.204076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"]
Aug 04 19:24:36.206037 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:24:36.206003    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aec243a_faae_4bef_b39e_ce36230d692f.slice/crio-77de59eda0e92ffa8db8003cdcb8ab14d2251d827629989f8a5ba692ec4b553f WatchSource:0}: Error finding container 77de59eda0e92ffa8db8003cdcb8ab14d2251d827629989f8a5ba692ec4b553f: Status 404 returned error can't find the container with id 77de59eda0e92ffa8db8003cdcb8ab14d2251d827629989f8a5ba692ec4b553f
Aug 04 19:24:36.271167 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:36.271133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc" event={"ID":"7aec243a-faae-4bef-b39e-ce36230d692f","Type":"ContainerStarted","Data":"77de59eda0e92ffa8db8003cdcb8ab14d2251d827629989f8a5ba692ec4b553f"}
Aug 04 19:24:37.278485 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:37.278452    2565 generic.go:356] "Generic (PLEG): container finished" podID="7aec243a-faae-4bef-b39e-ce36230d692f" containerID="6e3416099fe9fa56c664480d7d6368cba6c1f715f73b23bb190e4b6f802794f2" exitCode=0
Aug 04 19:24:37.278933 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:37.278533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc" event={"ID":"7aec243a-faae-4bef-b39e-ce36230d692f","Type":"ContainerDied","Data":"6e3416099fe9fa56c664480d7d6368cba6c1f715f73b23bb190e4b6f802794f2"}
Aug 04 19:24:38.416831 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:38.416804    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"
Aug 04 19:24:38.489184 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:38.489152    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec243a-faae-4bef-b39e-ce36230d692f-maas-api-service-ca\") pod \"7aec243a-faae-4bef-b39e-ce36230d692f\" (UID: \"7aec243a-faae-4bef-b39e-ce36230d692f\") "
Aug 04 19:24:38.489601 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:38.489575    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aec243a-faae-4bef-b39e-ce36230d692f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7aec243a-faae-4bef-b39e-ce36230d692f" (UID: "7aec243a-faae-4bef-b39e-ce36230d692f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:24:38.590735 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:38.590647    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec243a-faae-4bef-b39e-ce36230d692f-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:24:39.292604 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:39.292572    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"
Aug 04 19:24:39.292822 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:39.292603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc" event={"ID":"7aec243a-faae-4bef-b39e-ce36230d692f","Type":"ContainerDied","Data":"77de59eda0e92ffa8db8003cdcb8ab14d2251d827629989f8a5ba692ec4b553f"}
Aug 04 19:24:39.292822 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:39.292656    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77de59eda0e92ffa8db8003cdcb8ab14d2251d827629989f8a5ba692ec4b553f"
Aug 04 19:24:42.075657 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:42.075623    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"]
Aug 04 19:24:42.078235 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:42.078208    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-249eef-7rcdc"]
Aug 04 19:24:43.570698 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:43.570652    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aec243a-faae-4bef-b39e-ce36230d692f" path="/var/lib/kubelet/pods/7aec243a-faae-4bef-b39e-ce36230d692f/volumes"
Aug 04 19:24:44.578688 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:44.578647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:24:52.422702 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.422663    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"]
Aug 04 19:24:52.423190 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.423114    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aec243a-faae-4bef-b39e-ce36230d692f" containerName="revoke-keys"
Aug 04 19:24:52.423190 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.423126    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aec243a-faae-4bef-b39e-ce36230d692f" containerName="revoke-keys"
Aug 04 19:24:52.423283 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.423193    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aec243a-faae-4bef-b39e-ce36230d692f" containerName="revoke-keys"
Aug 04 19:24:52.426161 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.426145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"
Aug 04 19:24:52.428669 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.428645    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:24:52.429660 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.429638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks\" (UID: \"cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"
Aug 04 19:24:52.434790 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.434754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"]
Aug 04 19:24:52.530429 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.530395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks\" (UID: \"cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"
Aug 04 19:24:52.531074 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.531056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks\" (UID: \"cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"
Aug 04 19:24:52.737579 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:52.737547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"
Aug 04 19:24:53.082555 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:53.082513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"]
Aug 04 19:24:53.083820 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:24:53.083789    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1b497b_2086_44c4_bfc5_1dc6bcab9a7e.slice/crio-d7a90dfce8bdd865fb1e02f38d115ce5954904839dbe39bf8c679d45133988dd WatchSource:0}: Error finding container d7a90dfce8bdd865fb1e02f38d115ce5954904839dbe39bf8c679d45133988dd: Status 404 returned error can't find the container with id d7a90dfce8bdd865fb1e02f38d115ce5954904839dbe39bf8c679d45133988dd
Aug 04 19:24:53.386811 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:53.386717    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks" event={"ID":"cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e","Type":"ContainerStarted","Data":"d7a90dfce8bdd865fb1e02f38d115ce5954904839dbe39bf8c679d45133988dd"}
Aug 04 19:24:54.395024 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:54.394987    2565 generic.go:356] "Generic (PLEG): container finished" podID="cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e" containerID="8102a3f9c4728e179ed955dff0a7c6b71f92d93b835ee31375f6f28324571375" exitCode=0
Aug 04 19:24:54.395458 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:54.395052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks" event={"ID":"cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e","Type":"ContainerDied","Data":"8102a3f9c4728e179ed955dff0a7c6b71f92d93b835ee31375f6f28324571375"}
Aug 04 19:24:55.539727 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:55.539699    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"
Aug 04 19:24:55.553391 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:55.553351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e-maas-api-service-ca\") pod \"cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e\" (UID: \"cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e\") "
Aug 04 19:24:55.553682 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:55.553660    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e" (UID: "cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:24:55.654843 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:55.654751    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:24:56.408389 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:56.408355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks" event={"ID":"cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e","Type":"ContainerDied","Data":"d7a90dfce8bdd865fb1e02f38d115ce5954904839dbe39bf8c679d45133988dd"}
Aug 04 19:24:56.408574 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:56.408402    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7a90dfce8bdd865fb1e02f38d115ce5954904839dbe39bf8c679d45133988dd"
Aug 04 19:24:56.408574 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:24:56.408366    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"
Aug 04 19:25:05.977727 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:05.977643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:25:08.180004 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:08.179930    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"]
Aug 04 19:25:08.183374 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:08.183340    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f3a5e8-h82ks"]
Aug 04 19:25:09.571251 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:09.571217    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e" path="/var/lib/kubelet/pods/cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e/volumes"
Aug 04 19:25:13.532599 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:13.532563    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"]
Aug 04 19:25:14.971133 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:14.971097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:25:28.551963 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.551916    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl" podUID="f6280cf1-b61e-44e4-a68a-22778a650a5a" containerName="main" containerID="cri-o://36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac" gracePeriod=45
Aug 04 19:25:28.810946 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.810876    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:25:28.975918 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.975883    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-home\") pod \"f6280cf1-b61e-44e4-a68a-22778a650a5a\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") "
Aug 04 19:25:28.976124 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.975933    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-dshm\") pod \"f6280cf1-b61e-44e4-a68a-22778a650a5a\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") "
Aug 04 19:25:28.976124 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976018    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-tmp-dir\") pod \"f6280cf1-b61e-44e4-a68a-22778a650a5a\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") "
Aug 04 19:25:28.976124 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976056    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6280cf1-b61e-44e4-a68a-22778a650a5a-tls-certs\") pod \"f6280cf1-b61e-44e4-a68a-22778a650a5a\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") "
Aug 04 19:25:28.976311 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976152    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dk4g\" (UniqueName: \"kubernetes.io/projected/f6280cf1-b61e-44e4-a68a-22778a650a5a-kube-api-access-5dk4g\") pod \"f6280cf1-b61e-44e4-a68a-22778a650a5a\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") "
Aug 04 19:25:28.976311 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-model-cache\") pod \"f6280cf1-b61e-44e4-a68a-22778a650a5a\" (UID: \"f6280cf1-b61e-44e4-a68a-22778a650a5a\") "
Aug 04 19:25:28.976311 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976183    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-home" (OuterVolumeSpecName: "home") pod "f6280cf1-b61e-44e4-a68a-22778a650a5a" (UID: "f6280cf1-b61e-44e4-a68a-22778a650a5a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:25:28.976468 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976348    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f6280cf1-b61e-44e4-a68a-22778a650a5a" (UID: "f6280cf1-b61e-44e4-a68a-22778a650a5a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:25:28.976525 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f6280cf1-b61e-44e4-a68a-22778a650a5a" (UID: "f6280cf1-b61e-44e4-a68a-22778a650a5a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:25:28.976579 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976524    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:25:28.976579 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.976545    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:25:28.978378 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.978348    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-dshm" (OuterVolumeSpecName: "dshm") pod "f6280cf1-b61e-44e4-a68a-22778a650a5a" (UID: "f6280cf1-b61e-44e4-a68a-22778a650a5a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:25:28.978498 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.978375    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6280cf1-b61e-44e4-a68a-22778a650a5a-kube-api-access-5dk4g" (OuterVolumeSpecName: "kube-api-access-5dk4g") pod "f6280cf1-b61e-44e4-a68a-22778a650a5a" (UID: "f6280cf1-b61e-44e4-a68a-22778a650a5a"). InnerVolumeSpecName "kube-api-access-5dk4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:25:28.978498 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:28.978410    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6280cf1-b61e-44e4-a68a-22778a650a5a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f6280cf1-b61e-44e4-a68a-22778a650a5a" (UID: "f6280cf1-b61e-44e4-a68a-22778a650a5a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:25:29.077755 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.077655    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dk4g\" (UniqueName: \"kubernetes.io/projected/f6280cf1-b61e-44e4-a68a-22778a650a5a-kube-api-access-5dk4g\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:25:29.077755 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.077691    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:25:29.077755 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.077702    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6280cf1-b61e-44e4-a68a-22778a650a5a-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:25:29.077755 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.077710    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6280cf1-b61e-44e4-a68a-22778a650a5a-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:25:29.624083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.624044    2565 generic.go:356] "Generic (PLEG): container finished" podID="f6280cf1-b61e-44e4-a68a-22778a650a5a" containerID="36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac" exitCode=0
Aug 04 19:25:29.624562 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.624103    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"
Aug 04 19:25:29.624562 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.624131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl" event={"ID":"f6280cf1-b61e-44e4-a68a-22778a650a5a","Type":"ContainerDied","Data":"36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac"}
Aug 04 19:25:29.624562 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.624180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl" event={"ID":"f6280cf1-b61e-44e4-a68a-22778a650a5a","Type":"ContainerDied","Data":"eb69a13429e1003b2491696a72f2c25b0bf7fb0b4e4e951723c2ad75a8261d14"}
Aug 04 19:25:29.624562 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.624200    2565 scope.go:117] "RemoveContainer" containerID="36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac"
Aug 04 19:25:29.634569 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.634547    2565 scope.go:117] "RemoveContainer" containerID="36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac"
Aug 04 19:25:29.634932 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:25:29.634910    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac\": container with ID starting with 36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac not found: ID does not exist" containerID="36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac"
Aug 04 19:25:29.634987 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.634942    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac"} err="failed to get container status \"36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac\": rpc error: code = NotFound desc = could not find container \"36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac\": container with ID starting with 36928ec849ec3c7a1b320dbeed9c6d23b299c7453ca824fdbdbe869a319c84ac not found: ID does not exist"
Aug 04 19:25:29.641836 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.641808    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"]
Aug 04 19:25:29.646009 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:29.645983    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-f3a5e8/ipp-route-f3a5e8-kserve-7585dd7fbc-7ccsl"]
Aug 04 19:25:31.572835 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:25:31.572799    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6280cf1-b61e-44e4-a68a-22778a650a5a" path="/var/lib/kubelet/pods/f6280cf1-b61e-44e4-a68a-22778a650a5a/volumes"
Aug 04 19:26:03.382977 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.382935    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"]
Aug 04 19:26:03.383579 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.383243    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" containerID="cri-o://b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235" gracePeriod=30
Aug 04 19:26:03.749167 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.749125    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"]
Aug 04 19:26:03.749665 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.749646    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e" containerName="revoke-keys"
Aug 04 19:26:03.749665 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.749666    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e" containerName="revoke-keys"
Aug 04 19:26:03.749763 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.749703    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6280cf1-b61e-44e4-a68a-22778a650a5a" containerName="main"
Aug 04 19:26:03.749763 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.749710    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6280cf1-b61e-44e4-a68a-22778a650a5a" containerName="main"
Aug 04 19:26:03.749869 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.749805    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd1b497b-2086-44c4-bfc5-1dc6bcab9a7e" containerName="revoke-keys"
Aug 04 19:26:03.749869 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.749812    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6280cf1-b61e-44e4-a68a-22778a650a5a" containerName="main"
Aug 04 19:26:03.753107 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.753088    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"
Aug 04 19:26:03.755442 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.755422    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:26:03.761671 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.761259    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"]
Aug 04 19:26:03.808873 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.808827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m\" (UID: \"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"
Aug 04 19:26:03.910012 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.909971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m\" (UID: \"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"
Aug 04 19:26:03.910691 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:03.910669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m\" (UID: \"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"
Aug 04 19:26:04.066596 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:04.066505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"
Aug 04 19:26:04.218629 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:04.218595    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"]
Aug 04 19:26:04.219860 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:26:04.219836    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c9a95d_7b3e_41fa_a12e_9dbfe24fffed.slice/crio-fdbcfb0a5bbf51d22f917453730ccc1cd127af3df7e981abcd3af431a35b52ec WatchSource:0}: Error finding container fdbcfb0a5bbf51d22f917453730ccc1cd127af3df7e981abcd3af431a35b52ec: Status 404 returned error can't find the container with id fdbcfb0a5bbf51d22f917453730ccc1cd127af3df7e981abcd3af431a35b52ec
Aug 04 19:26:04.846961 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:04.846925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m" event={"ID":"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed","Type":"ContainerStarted","Data":"db1247b8717ea55c074184cfdff715b20d9f9e3d17c7c69a1ea5c655b670ddb9"}
Aug 04 19:26:04.847366 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:04.846977    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m" event={"ID":"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed","Type":"ContainerStarted","Data":"fdbcfb0a5bbf51d22f917453730ccc1cd127af3df7e981abcd3af431a35b52ec"}
Aug 04 19:26:04.862140 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:04.862064    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m" podStartSLOduration=1.8620373890000002 podStartE2EDuration="1.862037389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:26:04.861957493 +0000 UTC m=+3475.829848050" watchObservedRunningTime="2026-08-04 19:26:04.862037389 +0000 UTC m=+3475.829927912"
Aug 04 19:26:05.855122 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:05.855081    2565 generic.go:356] "Generic (PLEG): container finished" podID="c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed" containerID="db1247b8717ea55c074184cfdff715b20d9f9e3d17c7c69a1ea5c655b670ddb9" exitCode=0
Aug 04 19:26:05.855549 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:05.855168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m" event={"ID":"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed","Type":"ContainerDied","Data":"db1247b8717ea55c074184cfdff715b20d9f9e3d17c7c69a1ea5c655b670ddb9"}
Aug 04 19:26:06.635008 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:06.634967    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 19:26:06.635196 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:06.635030    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 19:26:07.006577 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:07.006549    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"
Aug 04 19:26:07.139682 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:07.139636    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed-maas-api-service-ca\") pod \"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed\" (UID: \"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed\") "
Aug 04 19:26:07.140096 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:07.140070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed" (UID: "c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:07.241210 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:07.241175    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:07.869510 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:07.869407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m" event={"ID":"c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed","Type":"ContainerDied","Data":"fdbcfb0a5bbf51d22f917453730ccc1cd127af3df7e981abcd3af431a35b52ec"}
Aug 04 19:26:07.869510 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:07.869443    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"
Aug 04 19:26:07.869510 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:07.869469    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdbcfb0a5bbf51d22f917453730ccc1cd127af3df7e981abcd3af431a35b52ec"
Aug 04 19:26:08.647065 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.647002    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:26:08.757241 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-credential-socket\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757241 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757247    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-certs\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757516 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757267    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-socket\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757516 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757325    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-envoy\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757516 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757357    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-token\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757516 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757397    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istiod-ca-cert\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757516 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757429    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67q58\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-kube-api-access-67q58\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757516 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-data\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757865 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:26:08.757865 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757591    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:26:08.757865 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-podinfo\") pod \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\" (UID: \"83ecbffd-c16d-4c8f-8307-20138f5dfdca\") "
Aug 04 19:26:08.757865 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757802    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-data" (OuterVolumeSpecName: "istio-data") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:26:08.757865 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757845    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:26:08.758135 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.757958    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:08.758135 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.758119    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.758247 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.758140    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.758247 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.758156    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.758247 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.758171    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.758247 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.758184    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.759949 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.759918    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 19:26:08.760094 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.759946    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:26:08.760094 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.759967    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-token" (OuterVolumeSpecName: "istio-token") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:26:08.760094 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.759946    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-kube-api-access-67q58" (OuterVolumeSpecName: "kube-api-access-67q58") pod "83ecbffd-c16d-4c8f-8307-20138f5dfdca" (UID: "83ecbffd-c16d-4c8f-8307-20138f5dfdca"). InnerVolumeSpecName "kube-api-access-67q58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:26:08.858944 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.858903    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67q58\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-kube-api-access-67q58\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.858944 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.858936    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.858944 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.858946    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.858944 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.858955    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83ecbffd-c16d-4c8f-8307-20138f5dfdca-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:08.877353 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.877317    2565 generic.go:356] "Generic (PLEG): container finished" podID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerID="b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235" exitCode=0
Aug 04 19:26:08.877546 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.877367    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"
Aug 04 19:26:08.877546 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.877368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" event={"ID":"83ecbffd-c16d-4c8f-8307-20138f5dfdca","Type":"ContainerDied","Data":"b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235"}
Aug 04 19:26:08.877546 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.877507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb" event={"ID":"83ecbffd-c16d-4c8f-8307-20138f5dfdca","Type":"ContainerDied","Data":"adb798e6656f672bcebf9758cb8285bdccc4fff7451fffb059a2a61b804cabec"}
Aug 04 19:26:08.877546 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.877538    2565 scope.go:117] "RemoveContainer" containerID="b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235"
Aug 04 19:26:08.888006 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.887987    2565 scope.go:117] "RemoveContainer" containerID="4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17"
Aug 04 19:26:08.898677 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.898649    2565 scope.go:117] "RemoveContainer" containerID="b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235"
Aug 04 19:26:08.899076 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:26:08.899052    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235\": container with ID starting with b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235 not found: ID does not exist" containerID="b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235"
Aug 04 19:26:08.899152 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.899087    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235"} err="failed to get container status \"b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235\": rpc error: code = NotFound desc = could not find container \"b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235\": container with ID starting with b5e5d1bed3343fef0e44780a65458f15e969a61e4ffacc53fad426d36c3c1235 not found: ID does not exist"
Aug 04 19:26:08.899152 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.899138    2565 scope.go:117] "RemoveContainer" containerID="4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17"
Aug 04 19:26:08.899433 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:26:08.899412    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17\": container with ID starting with 4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17 not found: ID does not exist" containerID="4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17"
Aug 04 19:26:08.899503 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.899443    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17"} err="failed to get container status \"4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17\": rpc error: code = NotFound desc = could not find container \"4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17\": container with ID starting with 4f9fa0d546d462ea62ce7e3faa8942e4d0cd2dc3f1aab1562c724d1979ff9a17 not found: ID does not exist"
Aug 04 19:26:08.901339 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.901319    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"]
Aug 04 19:26:08.905317 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:08.905293    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb"]
Aug 04 19:26:09.571977 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:09.571947    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" path="/var/lib/kubelet/pods/83ecbffd-c16d-4c8f-8307-20138f5dfdca/volumes"
Aug 04 19:26:14.210077 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.210027    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"]
Aug 04 19:26:14.210589 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.210278    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64" podUID="1d0f1932-7339-429b-9b97-9c113112b1f7" containerName="maas-api" containerID="cri-o://203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988" gracePeriod=30
Aug 04 19:26:14.488744 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.488713    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:26:14.601804 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.601741    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"]
Aug 04 19:26:14.606342 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.606310    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f18332-q5g5m"]
Aug 04 19:26:14.618762 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.618730    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls\") pod \"1d0f1932-7339-429b-9b97-9c113112b1f7\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") "
Aug 04 19:26:14.618970 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.618791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d0f1932-7339-429b-9b97-9c113112b1f7-openshift-service-ca\") pod \"1d0f1932-7339-429b-9b97-9c113112b1f7\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") "
Aug 04 19:26:14.618970 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.618883    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4jhg\" (UniqueName: \"kubernetes.io/projected/1d0f1932-7339-429b-9b97-9c113112b1f7-kube-api-access-d4jhg\") pod \"1d0f1932-7339-429b-9b97-9c113112b1f7\" (UID: \"1d0f1932-7339-429b-9b97-9c113112b1f7\") "
Aug 04 19:26:14.619253 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.619228    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d0f1932-7339-429b-9b97-9c113112b1f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1d0f1932-7339-429b-9b97-9c113112b1f7" (UID: "1d0f1932-7339-429b-9b97-9c113112b1f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:14.621011 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.620989    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1d0f1932-7339-429b-9b97-9c113112b1f7" (UID: "1d0f1932-7339-429b-9b97-9c113112b1f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:26:14.621103 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.621042    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d0f1932-7339-429b-9b97-9c113112b1f7-kube-api-access-d4jhg" (OuterVolumeSpecName: "kube-api-access-d4jhg") pod "1d0f1932-7339-429b-9b97-9c113112b1f7" (UID: "1d0f1932-7339-429b-9b97-9c113112b1f7"). InnerVolumeSpecName "kube-api-access-d4jhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:26:14.720487 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.720383    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d0f1932-7339-429b-9b97-9c113112b1f7-maas-api-tls\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:14.720487 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.720413    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d0f1932-7339-429b-9b97-9c113112b1f7-openshift-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:14.720487 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.720425    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4jhg\" (UniqueName: \"kubernetes.io/projected/1d0f1932-7339-429b-9b97-9c113112b1f7-kube-api-access-d4jhg\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:14.916433 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.916398    2565 generic.go:356] "Generic (PLEG): container finished" podID="1d0f1932-7339-429b-9b97-9c113112b1f7" containerID="203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988" exitCode=0
Aug 04 19:26:14.916644 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.916444    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"
Aug 04 19:26:14.916644 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.916480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64" event={"ID":"1d0f1932-7339-429b-9b97-9c113112b1f7","Type":"ContainerDied","Data":"203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988"}
Aug 04 19:26:14.916644 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.916540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64" event={"ID":"1d0f1932-7339-429b-9b97-9c113112b1f7","Type":"ContainerDied","Data":"147b1a4b1c67f0598620ad88f121556aebec28f46c33e524726bf0c00ca44909"}
Aug 04 19:26:14.916644 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.916570    2565 scope.go:117] "RemoveContainer" containerID="203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988"
Aug 04 19:26:14.927606 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.927584    2565 scope.go:117] "RemoveContainer" containerID="203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988"
Aug 04 19:26:14.927905 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:26:14.927887    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988\": container with ID starting with 203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988 not found: ID does not exist" containerID="203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988"
Aug 04 19:26:14.927964 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.927913    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988"} err="failed to get container status \"203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988\": rpc error: code = NotFound desc = could not find container \"203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988\": container with ID starting with 203786881e3ff65e96b1309c24b68b06b2c004988c49cbc91f6967f696346988 not found: ID does not exist"
Aug 04 19:26:14.961928 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.961893    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"]
Aug 04 19:26:14.968429 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:14.968396    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f18332-59d6478bfd-l8f64"]
Aug 04 19:26:15.571357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:15.571324    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d0f1932-7339-429b-9b97-9c113112b1f7" path="/var/lib/kubelet/pods/1d0f1932-7339-429b-9b97-9c113112b1f7/volumes"
Aug 04 19:26:15.571791 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:15.571674    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed" path="/var/lib/kubelet/pods/c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed/volumes"
Aug 04 19:26:16.475141 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:16.475100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:26:22.326461 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.326419    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"]
Aug 04 19:26:22.326926 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.326912    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy"
Aug 04 19:26:22.326980 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.326928    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy"
Aug 04 19:26:22.326980 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.326941    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed" containerName="revoke-keys"
Aug 04 19:26:22.326980 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.326947    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed" containerName="revoke-keys"
Aug 04 19:26:22.326980 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.326969    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0f1932-7339-429b-9b97-9c113112b1f7" containerName="maas-api"
Aug 04 19:26:22.326980 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.326978    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0f1932-7339-429b-9b97-9c113112b1f7" containerName="maas-api"
Aug 04 19:26:22.327140 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.327045    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy"
Aug 04 19:26:22.327140 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.327056    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy"
Aug 04 19:26:22.327140 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.327068    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d0f1932-7339-429b-9b97-9c113112b1f7" containerName="maas-api"
Aug 04 19:26:22.327140 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.327076    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9c9a95d-7b3e-41fa-a12e-9dbfe24fffed" containerName="revoke-keys"
Aug 04 19:26:22.331885 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.331862    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"
Aug 04 19:26:22.334564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.334537    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:26:22.334724 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.334624    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:26:22.339822 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.339787    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"]
Aug 04 19:26:22.499049 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.499011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c23144-9ad5-4d72-928c-8460aed01373-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5\" (UID: \"32c23144-9ad5-4d72-928c-8460aed01373\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"
Aug 04 19:26:22.600247 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.600118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c23144-9ad5-4d72-928c-8460aed01373-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5\" (UID: \"32c23144-9ad5-4d72-928c-8460aed01373\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"
Aug 04 19:26:22.600828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.600771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c23144-9ad5-4d72-928c-8460aed01373-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5\" (UID: \"32c23144-9ad5-4d72-928c-8460aed01373\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"
Aug 04 19:26:22.646125 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.646091    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"
Aug 04 19:26:22.789881 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.789846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"]
Aug 04 19:26:22.791524 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:26:22.791497    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c23144_9ad5_4d72_928c_8460aed01373.slice/crio-73d9de2d143acf03005c045d3784b281f1de8a91d5c4de9fae178f589cd7bb61 WatchSource:0}: Error finding container 73d9de2d143acf03005c045d3784b281f1de8a91d5c4de9fae178f589cd7bb61: Status 404 returned error can't find the container with id 73d9de2d143acf03005c045d3784b281f1de8a91d5c4de9fae178f589cd7bb61
Aug 04 19:26:22.969494 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:22.969385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5" event={"ID":"32c23144-9ad5-4d72-928c-8460aed01373","Type":"ContainerStarted","Data":"73d9de2d143acf03005c045d3784b281f1de8a91d5c4de9fae178f589cd7bb61"}
Aug 04 19:26:23.978347 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:23.978238    2565 generic.go:356] "Generic (PLEG): container finished" podID="32c23144-9ad5-4d72-928c-8460aed01373" containerID="9ade1d7aef8027b9e037438f5d73526d78b2e60f35e9a7615fe3752b203fb03a" exitCode=0
Aug 04 19:26:23.978854 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:23.978334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5" event={"ID":"32c23144-9ad5-4d72-928c-8460aed01373","Type":"ContainerDied","Data":"9ade1d7aef8027b9e037438f5d73526d78b2e60f35e9a7615fe3752b203fb03a"}
Aug 04 19:26:25.126622 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:25.126594    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"
Aug 04 19:26:25.128861 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:25.128841    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c23144-9ad5-4d72-928c-8460aed01373-maas-api-service-ca\") pod \"32c23144-9ad5-4d72-928c-8460aed01373\" (UID: \"32c23144-9ad5-4d72-928c-8460aed01373\") "
Aug 04 19:26:25.129157 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:25.129135    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32c23144-9ad5-4d72-928c-8460aed01373-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "32c23144-9ad5-4d72-928c-8460aed01373" (UID: "32c23144-9ad5-4d72-928c-8460aed01373"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:25.229701 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:25.229662    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c23144-9ad5-4d72-928c-8460aed01373-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:25.993357 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:25.993328    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"
Aug 04 19:26:25.993544 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:25.993358    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5" event={"ID":"32c23144-9ad5-4d72-928c-8460aed01373","Type":"ContainerDied","Data":"73d9de2d143acf03005c045d3784b281f1de8a91d5c4de9fae178f589cd7bb61"}
Aug 04 19:26:25.993544 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:25.993405    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73d9de2d143acf03005c045d3784b281f1de8a91d5c4de9fae178f589cd7bb61"
Aug 04 19:26:32.809854 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:32.809740    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"]
Aug 04 19:26:32.812283 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:32.812254    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1d2c46-29764515-6j6zt"]
Aug 04 19:26:33.010248 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:33.010205    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"]
Aug 04 19:26:33.017614 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:33.017569    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-1d2c46-zt2j5"]
Aug 04 19:26:33.570260 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:33.570221    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32c23144-9ad5-4d72-928c-8460aed01373" path="/var/lib/kubelet/pods/32c23144-9ad5-4d72-928c-8460aed01373/volumes"
Aug 04 19:26:33.570566 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:33.570552    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d920475-9efe-4bb1-bba8-0eb467bd5ccb" path="/var/lib/kubelet/pods/7d920475-9efe-4bb1-bba8-0eb467bd5ccb/volumes"
Aug 04 19:26:34.792676 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:34.792630    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:26:40.189572 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.189526    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"]
Aug 04 19:26:40.190032 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.190002    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32c23144-9ad5-4d72-928c-8460aed01373" containerName="revoke-keys"
Aug 04 19:26:40.190032 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.190016    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="32c23144-9ad5-4d72-928c-8460aed01373" containerName="revoke-keys"
Aug 04 19:26:40.190032 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.190028    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy"
Aug 04 19:26:40.190032 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.190035    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ecbffd-c16d-4c8f-8307-20138f5dfdca" containerName="istio-proxy"
Aug 04 19:26:40.190172 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.190131    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="32c23144-9ad5-4d72-928c-8460aed01373" containerName="revoke-keys"
Aug 04 19:26:40.194280 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.194258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"
Aug 04 19:26:40.196952 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.196926    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:26:40.197103 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.197006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sxp2b\""
Aug 04 19:26:40.206251 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.206223    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"]
Aug 04 19:26:40.248640 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.248592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91027f5-314c-48a7-9e39-9ad089597a1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck\" (UID: \"e91027f5-314c-48a7-9e39-9ad089597a1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"
Aug 04 19:26:40.349250 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.349204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91027f5-314c-48a7-9e39-9ad089597a1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck\" (UID: \"e91027f5-314c-48a7-9e39-9ad089597a1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"
Aug 04 19:26:40.349926 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.349905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91027f5-314c-48a7-9e39-9ad089597a1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck\" (UID: \"e91027f5-314c-48a7-9e39-9ad089597a1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"
Aug 04 19:26:40.506714 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.506672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"
Aug 04 19:26:40.677724 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:40.677690    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"]
Aug 04 19:26:40.679039 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:26:40.679008    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91027f5_314c_48a7_9e39_9ad089597a1e.slice/crio-d6d73a0ca97fb13e697da76e7ac892f2327c14904ff17d1d76dc56399b6b4181 WatchSource:0}: Error finding container d6d73a0ca97fb13e697da76e7ac892f2327c14904ff17d1d76dc56399b6b4181: Status 404 returned error can't find the container with id d6d73a0ca97fb13e697da76e7ac892f2327c14904ff17d1d76dc56399b6b4181
Aug 04 19:26:41.088642 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:41.088606    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck" event={"ID":"e91027f5-314c-48a7-9e39-9ad089597a1e","Type":"ContainerStarted","Data":"b620282363d3ad9db7ad49621772639e962368d0468ae551e3ecb4afb4539d03"}
Aug 04 19:26:41.088840 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:41.088662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck" event={"ID":"e91027f5-314c-48a7-9e39-9ad089597a1e","Type":"ContainerStarted","Data":"d6d73a0ca97fb13e697da76e7ac892f2327c14904ff17d1d76dc56399b6b4181"}
Aug 04 19:26:41.107150 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:41.107093    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck" podStartSLOduration=1.107061125 podStartE2EDuration="1.107061125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:26:41.104583447 +0000 UTC m=+3512.072473993" watchObservedRunningTime="2026-08-04 19:26:41.107061125 +0000 UTC m=+3512.074951671"
Aug 04 19:26:42.096856 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:42.096814    2565 generic.go:356] "Generic (PLEG): container finished" podID="e91027f5-314c-48a7-9e39-9ad089597a1e" containerID="b620282363d3ad9db7ad49621772639e962368d0468ae551e3ecb4afb4539d03" exitCode=0
Aug 04 19:26:42.097309 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:42.096906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck" event={"ID":"e91027f5-314c-48a7-9e39-9ad089597a1e","Type":"ContainerDied","Data":"b620282363d3ad9db7ad49621772639e962368d0468ae551e3ecb4afb4539d03"}
Aug 04 19:26:43.245696 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:43.245666    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"
Aug 04 19:26:43.278796 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:43.278743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91027f5-314c-48a7-9e39-9ad089597a1e-maas-api-service-ca\") pod \"e91027f5-314c-48a7-9e39-9ad089597a1e\" (UID: \"e91027f5-314c-48a7-9e39-9ad089597a1e\") "
Aug 04 19:26:43.279120 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:43.279095    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91027f5-314c-48a7-9e39-9ad089597a1e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e91027f5-314c-48a7-9e39-9ad089597a1e" (UID: "e91027f5-314c-48a7-9e39-9ad089597a1e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:43.380551 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:43.380453    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91027f5-314c-48a7-9e39-9ad089597a1e-maas-api-service-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:26:44.117221 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:44.117185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck" event={"ID":"e91027f5-314c-48a7-9e39-9ad089597a1e","Type":"ContainerDied","Data":"d6d73a0ca97fb13e697da76e7ac892f2327c14904ff17d1d76dc56399b6b4181"}
Aug 04 19:26:44.117221 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:44.117214    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"
Aug 04 19:26:44.117466 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:44.117243    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6d73a0ca97fb13e697da76e7ac892f2327c14904ff17d1d76dc56399b6b4181"
Aug 04 19:26:50.813260 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:50.813222    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"]
Aug 04 19:26:50.815670 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:50.815643    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1a00f6-29764515-sfnjg"]
Aug 04 19:26:50.993407 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:50.993372    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"]
Aug 04 19:26:50.995826 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:50.995802    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a00f6-jx7ck"]
Aug 04 19:26:51.570579 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:51.570533    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94558ff9-e9c2-4625-8a95-0d2ef2338ecb" path="/var/lib/kubelet/pods/94558ff9-e9c2-4625-8a95-0d2ef2338ecb/volumes"
Aug 04 19:26:51.570985 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:51.570965    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91027f5-314c-48a7-9e39-9ad089597a1e" path="/var/lib/kubelet/pods/e91027f5-314c-48a7-9e39-9ad089597a1e/volumes"
Aug 04 19:26:52.884278 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:52.884236    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bhfzj"]
Aug 04 19:26:58.136891 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:58.136854    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"]
Aug 04 19:26:58.137330 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:58.137085    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy" containerID="cri-o://4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d" gracePeriod=30
Aug 04 19:26:58.793977 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:26:58.793938    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-797987f455-r98w2_8f05f902-7e8f-4e49-8fd8-41f6754e7a9c/authorino/0.log"
Aug 04 19:27:00.980248 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:00.980208    2565 patch_prober.go:28] interesting pod/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 19:27:00.980644 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:00.980281    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 19:27:03.392405 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.392375    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:27:03.477757 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477643    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-certs\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.477757 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477702    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-socket\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.477757 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-envoy\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.478083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-data\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.478083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-credential-socket\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.478083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477896    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b742b666-921e-4799-ad2d-f598bb833965-istiod-ca-cert\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.478083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b742b666-921e-4799-ad2d-f598bb833965-istio-podinfo\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.478083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477961    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-istio-token\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.478083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw88d\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-kube-api-access-dw88d\") pod \"b742b666-921e-4799-ad2d-f598bb833965\" (UID: \"b742b666-921e-4799-ad2d-f598bb833965\") "
Aug 04 19:27:03.478083 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.477989    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:27:03.478403 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.478202    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:27:03.478403 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.478211    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:27:03.478403 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.478351    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:03.478403 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.478373    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:03.478627 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.478405    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:03.478627 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.478509    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-data" (OuterVolumeSpecName: "istio-data") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:27:03.478755 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.478634    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b742b666-921e-4799-ad2d-f598bb833965-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:27:03.480367 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.480339    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-istio-token" (OuterVolumeSpecName: "istio-token") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:27:03.480367 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.480351    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b742b666-921e-4799-ad2d-f598bb833965-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 19:27:03.480577 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.480560    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-kube-api-access-dw88d" (OuterVolumeSpecName: "kube-api-access-dw88d") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "kube-api-access-dw88d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:27:03.480637 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.480622    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b742b666-921e-4799-ad2d-f598bb833965" (UID: "b742b666-921e-4799-ad2d-f598bb833965"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:27:03.579879 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.579855    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b742b666-921e-4799-ad2d-f598bb833965-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:03.579879 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.579878    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:03.580017 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.579888    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw88d\" (UniqueName: \"kubernetes.io/projected/b742b666-921e-4799-ad2d-f598bb833965-kube-api-access-dw88d\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:03.580017 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.579896    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:03.580017 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.579905    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b742b666-921e-4799-ad2d-f598bb833965-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:03.580017 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:03.579912    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b742b666-921e-4799-ad2d-f598bb833965-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Aug 04 19:27:04.241305 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.241265    2565 generic.go:356] "Generic (PLEG): container finished" podID="b742b666-921e-4799-ad2d-f598bb833965" containerID="4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d" exitCode=0
Aug 04 19:27:04.241527 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.241325    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"
Aug 04 19:27:04.241527 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.241345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" event={"ID":"b742b666-921e-4799-ad2d-f598bb833965","Type":"ContainerDied","Data":"4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d"}
Aug 04 19:27:04.241527 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.241405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9" event={"ID":"b742b666-921e-4799-ad2d-f598bb833965","Type":"ContainerDied","Data":"b12443557188a23ba7413c37abbae65eed477ca5a8f9102fa15871e9de4f2a4a"}
Aug 04 19:27:04.241527 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.241441    2565 scope.go:117] "RemoveContainer" containerID="4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d"
Aug 04 19:27:04.251677 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.251440    2565 scope.go:117] "RemoveContainer" containerID="0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2"
Aug 04 19:27:04.261471 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.261449    2565 scope.go:117] "RemoveContainer" containerID="4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d"
Aug 04 19:27:04.261593 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.261571    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"]
Aug 04 19:27:04.261836 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:27:04.261816    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d\": container with ID starting with 4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d not found: ID does not exist" containerID="4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d"
Aug 04 19:27:04.261887 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.261846    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d"} err="failed to get container status \"4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d\": rpc error: code = NotFound desc = could not find container \"4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d\": container with ID starting with 4f70ebb9c1cc48b5d35d7c2c69ee597e11013ad8e68bce7720a135011c565a4d not found: ID does not exist"
Aug 04 19:27:04.261887 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.261866    2565 scope.go:117] "RemoveContainer" containerID="0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2"
Aug 04 19:27:04.262123 ip-10-0-137-145 kubenswrapper[2565]: E0804 19:27:04.262095    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2\": container with ID starting with 0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2 not found: ID does not exist" containerID="0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2"
Aug 04 19:27:04.262185 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.262131    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2"} err="failed to get container status \"0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2\": rpc error: code = NotFound desc = could not find container \"0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2\": container with ID starting with 0065c098fa525ee4a16cabac12ab96a16dd5edf940853836bc3777754c133fa2 not found: ID does not exist"
Aug 04 19:27:04.265515 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.265491    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9"]
Aug 04 19:27:04.748908 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.748883    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5556d6485b-pmtlk_cb9ef714-ac26-4115-b67e-9082f6cba7e8/copy-manifests/0.log"
Aug 04 19:27:04.761858 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:04.761825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5556d6485b-pmtlk_cb9ef714-ac26-4115-b67e-9082f6cba7e8/manager/0.log"
Aug 04 19:27:05.222518 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:05.222442    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764485-pjqcz_9593a7b2-a774-4dec-855e-db33e206de14/cleanup/0.log"
Aug 04 19:27:05.327039 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:05.327006    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764500-f4g27_b6ced7fc-5a62-4b7b-8204-b6f63c749052/cleanup/0.log"
Aug 04 19:27:05.438889 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:05.438859    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764515-2g7gj_aa3fee13-45d3-405d-abb9-c11a182d951b/cleanup/0.log"
Aug 04 19:27:05.571488 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:05.571455    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b742b666-921e-4799-ad2d-f598bb833965" path="/var/lib/kubelet/pods/b742b666-921e-4799-ad2d-f598bb833965/volumes"
Aug 04 19:27:06.301059 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:06.301019    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-797987f455-r98w2_8f05f902-7e8f-4e49-8fd8-41f6754e7a9c/authorino/0.log"
Aug 04 19:27:06.616220 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:06.616137    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-f4r2s_41fa2f49-7874-4f27-acbf-038a01f95225/kuadrant-console-plugin/0.log"
Aug 04 19:27:06.833622 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:06.833593    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-bhfzj_d777d0ba-eb37-4c80-b6a4-0e743b4aecd6/limitador/0.log"
Aug 04 19:27:07.489051 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:07.489021    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65f654896c-4g4fs_99e61928-ec71-4779-bbe1-5404c752c7d2/kube-auth-proxy/0.log"
Aug 04 19:27:10.216507 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:10.216464    2565 scope.go:117] "RemoveContainer" containerID="cfa22ee4c14ea9151e00b25b5b3c3a23109f43fe0e415983fcb702c5f7d7d87d"
Aug 04 19:27:10.226049 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:10.226026    2565 scope.go:117] "RemoveContainer" containerID="7650f16ed70951d5f92838bc3c88fea0e8a03d3311f3afdb912f86979a00746b"
Aug 04 19:27:14.621482 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.621434    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-szqsg/must-gather-6kn9h"]
Aug 04 19:27:14.621939 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.621917    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91027f5-314c-48a7-9e39-9ad089597a1e" containerName="revoke-keys"
Aug 04 19:27:14.621939 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.621930    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91027f5-314c-48a7-9e39-9ad089597a1e" containerName="revoke-keys"
Aug 04 19:27:14.622016 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.621945    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy"
Aug 04 19:27:14.622016 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.621951    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy"
Aug 04 19:27:14.622016 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.621962    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy"
Aug 04 19:27:14.622016 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.621968    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy"
Aug 04 19:27:14.622149 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.622031    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91027f5-314c-48a7-9e39-9ad089597a1e" containerName="revoke-keys"
Aug 04 19:27:14.622149 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.622041    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy"
Aug 04 19:27:14.622149 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.622046    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b742b666-921e-4799-ad2d-f598bb833965" containerName="istio-proxy"
Aug 04 19:27:14.627195 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.627171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szqsg/must-gather-6kn9h"
Aug 04 19:27:14.630228 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.630202    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-szqsg\"/\"openshift-service-ca.crt\""
Aug 04 19:27:14.630398 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.630264    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-szqsg\"/\"kube-root-ca.crt\""
Aug 04 19:27:14.642108 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.642074    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szqsg/must-gather-6kn9h"]
Aug 04 19:27:14.786609 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.786571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82687712-974b-4d4b-855a-b108ccdecd1f-must-gather-output\") pod \"must-gather-6kn9h\" (UID: \"82687712-974b-4d4b-855a-b108ccdecd1f\") " pod="openshift-must-gather-szqsg/must-gather-6kn9h"
Aug 04 19:27:14.786609 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.786622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvlwq\" (UniqueName: \"kubernetes.io/projected/82687712-974b-4d4b-855a-b108ccdecd1f-kube-api-access-qvlwq\") pod \"must-gather-6kn9h\" (UID: \"82687712-974b-4d4b-855a-b108ccdecd1f\") " pod="openshift-must-gather-szqsg/must-gather-6kn9h"
Aug 04 19:27:14.887992 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.887899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82687712-974b-4d4b-855a-b108ccdecd1f-must-gather-output\") pod \"must-gather-6kn9h\" (UID: \"82687712-974b-4d4b-855a-b108ccdecd1f\") " pod="openshift-must-gather-szqsg/must-gather-6kn9h"
Aug 04 19:27:14.887992 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.887943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvlwq\" (UniqueName: \"kubernetes.io/projected/82687712-974b-4d4b-855a-b108ccdecd1f-kube-api-access-qvlwq\") pod \"must-gather-6kn9h\" (UID: \"82687712-974b-4d4b-855a-b108ccdecd1f\") " pod="openshift-must-gather-szqsg/must-gather-6kn9h"
Aug 04 19:27:14.888261 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.888241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82687712-974b-4d4b-855a-b108ccdecd1f-must-gather-output\") pod \"must-gather-6kn9h\" (UID: \"82687712-974b-4d4b-855a-b108ccdecd1f\") " pod="openshift-must-gather-szqsg/must-gather-6kn9h"
Aug 04 19:27:14.902445 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.902397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvlwq\" (UniqueName: \"kubernetes.io/projected/82687712-974b-4d4b-855a-b108ccdecd1f-kube-api-access-qvlwq\") pod \"must-gather-6kn9h\" (UID: \"82687712-974b-4d4b-855a-b108ccdecd1f\") " pod="openshift-must-gather-szqsg/must-gather-6kn9h"
Aug 04 19:27:14.937279 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:14.937241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szqsg/must-gather-6kn9h"
Aug 04 19:27:15.107333 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:15.107306    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szqsg/must-gather-6kn9h"]
Aug 04 19:27:15.109448 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:27:15.109413    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82687712_974b_4d4b_855a_b108ccdecd1f.slice/crio-d1e594c814df14b98d4e2e18be435908a7225d46f8558e06cc799e84803e6c90 WatchSource:0}: Error finding container d1e594c814df14b98d4e2e18be435908a7225d46f8558e06cc799e84803e6c90: Status 404 returned error can't find the container with id d1e594c814df14b98d4e2e18be435908a7225d46f8558e06cc799e84803e6c90
Aug 04 19:27:15.115324 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:15.115301    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 19:27:15.309735 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:15.309693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szqsg/must-gather-6kn9h" event={"ID":"82687712-974b-4d4b-855a-b108ccdecd1f","Type":"ContainerStarted","Data":"d1e594c814df14b98d4e2e18be435908a7225d46f8558e06cc799e84803e6c90"}
Aug 04 19:27:16.320925 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:16.320883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szqsg/must-gather-6kn9h" event={"ID":"82687712-974b-4d4b-855a-b108ccdecd1f","Type":"ContainerStarted","Data":"b2d6cd34a5c8ab09992f8d0ac0dfcf982c0fbe6c381244cdbc949b506004b0d1"}
Aug 04 19:27:16.321452 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:16.320941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szqsg/must-gather-6kn9h" event={"ID":"82687712-974b-4d4b-855a-b108ccdecd1f","Type":"ContainerStarted","Data":"4779ca7c74df0711e32bbb2f725fbc61a75ab54f9ceb9343e3bcca2aa4e92eaa"}
Aug 04 19:27:16.349620 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:16.349551    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-szqsg/must-gather-6kn9h" podStartSLOduration=1.6001438540000001 podStartE2EDuration="2.349527209s" totalImagesPullingTime="749.383355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:27:16.347877478 +0000 UTC m=+3547.315768025" watchObservedRunningTime="2026-08-04 19:27:16.349527209 +0000 UTC m=+3547.317417755"
Aug 04 19:27:18.042792 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:18.042754    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xsqt4_19b4a443-3471-4aea-8e62-dd47eaf3dbbd/global-pull-secret-syncer/0.log"
Aug 04 19:27:18.222559 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:18.222525    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xhbv8_8c616a19-ab9e-4dc7-8e12-da5e77bbfde6/konnectivity-agent/0.log"
Aug 04 19:27:18.334961 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:18.334872    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-145.ec2.internal_e0cde0a1474f8dd5c5f71e57322005ab/haproxy/0.log"
Aug 04 19:27:23.020796 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:23.020599    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-797987f455-r98w2_8f05f902-7e8f-4e49-8fd8-41f6754e7a9c/authorino/0.log"
Aug 04 19:27:23.137912 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:23.137875    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-f4r2s_41fa2f49-7874-4f27-acbf-038a01f95225/kuadrant-console-plugin/0.log"
Aug 04 19:27:23.266857 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:23.266826    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-bhfzj_d777d0ba-eb37-4c80-b6a4-0e743b4aecd6/limitador/0.log"
Aug 04 19:27:24.870581 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:24.870543    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce16b6cd-1123-4315-874f-23d36f0cef78/alertmanager/0.log"
Aug 04 19:27:24.899964 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:24.899932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce16b6cd-1123-4315-874f-23d36f0cef78/config-reloader/0.log"
Aug 04 19:27:24.931268 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:24.931227    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce16b6cd-1123-4315-874f-23d36f0cef78/kube-rbac-proxy-web/0.log"
Aug 04 19:27:24.959283 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:24.959245    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce16b6cd-1123-4315-874f-23d36f0cef78/kube-rbac-proxy/0.log"
Aug 04 19:27:24.985064 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:24.985031    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce16b6cd-1123-4315-874f-23d36f0cef78/kube-rbac-proxy-metric/0.log"
Aug 04 19:27:25.012786 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.012746    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce16b6cd-1123-4315-874f-23d36f0cef78/prom-label-proxy/0.log"
Aug 04 19:27:25.050506 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.050479    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce16b6cd-1123-4315-874f-23d36f0cef78/init-config-reloader/0.log"
Aug 04 19:27:25.133008 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.132910    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-xqghk_def47f39-6c6a-4bfd-96a0-1a236ff09095/kube-state-metrics/0.log"
Aug 04 19:27:25.157002 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.156975    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-xqghk_def47f39-6c6a-4bfd-96a0-1a236ff09095/kube-rbac-proxy-main/0.log"
Aug 04 19:27:25.193538 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.193500    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-xqghk_def47f39-6c6a-4bfd-96a0-1a236ff09095/kube-rbac-proxy-self/0.log"
Aug 04 19:27:25.230237 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.230198    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6ff967758-dz9rk_32e16744-06f9-4190-be9b-c75046e9b0f8/metrics-server/0.log"
Aug 04 19:27:25.447948 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.447867    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dsrbt_eadd8054-17cd-46f6-9c74-44c109c2df46/node-exporter/0.log"
Aug 04 19:27:25.472329 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.472300    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dsrbt_eadd8054-17cd-46f6-9c74-44c109c2df46/kube-rbac-proxy/0.log"
Aug 04 19:27:25.498333 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.498289    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dsrbt_eadd8054-17cd-46f6-9c74-44c109c2df46/init-textfile/0.log"
Aug 04 19:27:25.636801 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.636546    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m422w_1ac582e2-5891-4e6a-8435-e90b2cd68f56/kube-rbac-proxy-main/0.log"
Aug 04 19:27:25.673650 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.673614    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m422w_1ac582e2-5891-4e6a-8435-e90b2cd68f56/kube-rbac-proxy-self/0.log"
Aug 04 19:27:25.705433 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.705225    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m422w_1ac582e2-5891-4e6a-8435-e90b2cd68f56/openshift-state-metrics/0.log"
Aug 04 19:27:25.986535 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:25.986499    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-wgshh_4a8ed287-2258-499d-bb7a-21a452a4b136/prometheus-operator/0.log"
Aug 04 19:27:26.014722 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.014688    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-wgshh_4a8ed287-2258-499d-bb7a-21a452a4b136/kube-rbac-proxy/0.log"
Aug 04 19:27:26.053094 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.053060    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-zdqp4_5ed9cb74-fa47-4e84-a74f-ca86fb6e373a/prometheus-operator-admission-webhook/0.log"
Aug 04 19:27:26.098743 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.098702    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6df49689b-km9g7_489c86d7-ca86-4c58-8b53-8004d4eec554/telemeter-client/0.log"
Aug 04 19:27:26.134237 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.134208    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6df49689b-km9g7_489c86d7-ca86-4c58-8b53-8004d4eec554/reload/0.log"
Aug 04 19:27:26.178828 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.178792    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6df49689b-km9g7_489c86d7-ca86-4c58-8b53-8004d4eec554/kube-rbac-proxy/0.log"
Aug 04 19:27:26.223245 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.223211    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d6b8d8c7b-qhxkt_513fd842-c43e-4ad6-a3bc-6172bfdbdd1c/thanos-query/0.log"
Aug 04 19:27:26.259839 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.259740    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d6b8d8c7b-qhxkt_513fd842-c43e-4ad6-a3bc-6172bfdbdd1c/kube-rbac-proxy-web/0.log"
Aug 04 19:27:26.289387 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.289352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d6b8d8c7b-qhxkt_513fd842-c43e-4ad6-a3bc-6172bfdbdd1c/kube-rbac-proxy/0.log"
Aug 04 19:27:26.320587 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.320555    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d6b8d8c7b-qhxkt_513fd842-c43e-4ad6-a3bc-6172bfdbdd1c/prom-label-proxy/0.log"
Aug 04 19:27:26.348474 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.348444    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d6b8d8c7b-qhxkt_513fd842-c43e-4ad6-a3bc-6172bfdbdd1c/kube-rbac-proxy-rules/0.log"
Aug 04 19:27:26.381094 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:26.381064    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d6b8d8c7b-qhxkt_513fd842-c43e-4ad6-a3bc-6172bfdbdd1c/kube-rbac-proxy-metrics/0.log"
Aug 04 19:27:27.844560 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:27.844508    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-c9xt9_1ce3146a-2e6b-45e2-84ed-39434a7330f6/networking-console-plugin/0.log"
Aug 04 19:27:28.594979 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.594938    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"]
Aug 04 19:27:28.599904 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.599875    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/1.log"
Aug 04 19:27:28.602727 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.602701    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.605975 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.605912    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-8zwng_4b549cc5-d752-4434-8943-c18c9b334388/console-operator/2.log"
Aug 04 19:27:28.606499 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.606476    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-szqsg\"/\"default-dockercfg-7dnkb\""
Aug 04 19:27:28.619487 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.619448    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"]
Aug 04 19:27:28.654798 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.649252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-sys\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.654798 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.649378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-proc\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.654798 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.649424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-lib-modules\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.654798 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.649473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxth\" (UniqueName: \"kubernetes.io/projected/896339eb-f708-4c04-b08f-4d765e7369e5-kube-api-access-qwxth\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.654798 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.649518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-podres\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.750477 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.750430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxth\" (UniqueName: \"kubernetes.io/projected/896339eb-f708-4c04-b08f-4d765e7369e5-kube-api-access-qwxth\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.750512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-podres\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.750594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-sys\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.750679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-proc\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.750718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-lib-modules\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.750942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-lib-modules\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.751368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-podres\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.751428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-sys\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.752564 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.751472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/896339eb-f708-4c04-b08f-4d765e7369e5-proc\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.762199 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.762160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxth\" (UniqueName: \"kubernetes.io/projected/896339eb-f708-4c04-b08f-4d765e7369e5-kube-api-access-qwxth\") pod \"perf-node-gather-daemonset-hjbh2\" (UID: \"896339eb-f708-4c04-b08f-4d765e7369e5\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:28.915542 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:28.915453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:29.114932 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:29.114821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"]
Aug 04 19:27:29.132910 ip-10-0-137-145 kubenswrapper[2565]: W0804 19:27:29.124399    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod896339eb_f708_4c04_b08f_4d765e7369e5.slice/crio-766b23e6239a5fa52a161b771e674ba8e95bb8b180166856bc16ad0d817d219e WatchSource:0}: Error finding container 766b23e6239a5fa52a161b771e674ba8e95bb8b180166856bc16ad0d817d219e: Status 404 returned error can't find the container with id 766b23e6239a5fa52a161b771e674ba8e95bb8b180166856bc16ad0d817d219e
Aug 04 19:27:29.446377 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:29.446267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2" event={"ID":"896339eb-f708-4c04-b08f-4d765e7369e5","Type":"ContainerStarted","Data":"bf359f27aefaa3b956c5be10931b5d5871842bc1beab7867e70c9383f3d86e9d"}
Aug 04 19:27:29.446377 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:29.446329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2" event={"ID":"896339eb-f708-4c04-b08f-4d765e7369e5","Type":"ContainerStarted","Data":"766b23e6239a5fa52a161b771e674ba8e95bb8b180166856bc16ad0d817d219e"}
Aug 04 19:27:29.446645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:29.446480    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:29.475921 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:29.475861    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2" podStartSLOduration=1.475842917 podStartE2EDuration="1.475842917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 19:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:27:29.473665985 +0000 UTC m=+3560.441556531" watchObservedRunningTime="2026-08-04 19:27:29.475842917 +0000 UTC m=+3560.443733443"
Aug 04 19:27:29.510378 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:29.510345    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54c6dccd5b-8lcqb_9e9b08c1-58b7-47eb-802a-1263ebfdded1/console/0.log"
Aug 04 19:27:29.555714 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:29.555668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-2gtqj_2e932a80-dde9-4ade-bda1-3dd7a4351f2e/download-server/0.log"
Aug 04 19:27:31.465451 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:31.465420    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g5jmk_de66c1b7-4b86-4d92-b4a6-a64878863e31/dns/0.log"
Aug 04 19:27:31.499021 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:31.498970    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g5jmk_de66c1b7-4b86-4d92-b4a6-a64878863e31/kube-rbac-proxy/0.log"
Aug 04 19:27:31.758694 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:31.758652    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5fdp_eb2243ff-fa74-46ad-970e-87af0461c9f0/dns-node-resolver/0.log"
Aug 04 19:27:32.559218 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:32.559189    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v54tj_b3a50a40-9b27-4214-bb8a-8868393b5945/node-ca/0.log"
Aug 04 19:27:33.882980 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:33.882925    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65f654896c-4g4fs_99e61928-ec71-4779-bbe1-5404c752c7d2/kube-auth-proxy/0.log"
Aug 04 19:27:34.976645 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:34.976615    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-49w9b_585d547e-15a5-4e00-8f37-985cdcc6781b/serve-healthcheck-canary/0.log"
Aug 04 19:27:35.467050 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:35.467020    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-hjbh2"
Aug 04 19:27:35.571918 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:35.571886    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-wwhmp_a6b893bc-1de6-40ec-a965-a26aece839eb/insights-operator/0.log"
Aug 04 19:27:35.573167 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:35.573143    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-wwhmp_a6b893bc-1de6-40ec-a965-a26aece839eb/insights-operator/1.log"
Aug 04 19:27:35.597472 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:35.597431    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7wqnl_7e2e3352-35b1-4302-ae2a-03db9051b80c/kube-rbac-proxy/0.log"
Aug 04 19:27:35.639211 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:35.639180    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7wqnl_7e2e3352-35b1-4302-ae2a-03db9051b80c/exporter/0.log"
Aug 04 19:27:35.671224 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:35.671179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7wqnl_7e2e3352-35b1-4302-ae2a-03db9051b80c/extractor/0.log"
Aug 04 19:27:39.466452 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:39.466353    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5556d6485b-pmtlk_cb9ef714-ac26-4115-b67e-9082f6cba7e8/manager/0.log"
Aug 04 19:27:39.521296 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:39.521263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5556d6485b-pmtlk_cb9ef714-ac26-4115-b67e-9082f6cba7e8/copy-manifests/0.log"
Aug 04 19:27:39.908178 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:39.908144    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65f654896c-4g4fs_99e61928-ec71-4779-bbe1-5404c752c7d2/kube-auth-proxy/0.log"
Aug 04 19:27:41.050003 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:41.049965    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f7c986d68-xxgzw_af0d9701-e737-4987-9131-f5909b71d70d/manager/0.log"
Aug 04 19:27:41.926071 ip-10-0-137-145 kubenswrapper[2565]: I0804 19:27:41.926016    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65f654896c-4g4fs_99e61928-ec71-4779-bbe1-5404c752c7d2/kube-auth-proxy/0.log"