Jul 08 23:05:25.264165 ip-10-0-138-15 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 23:05:25.264175 ip-10-0-138-15 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 23:05:25.264182 ip-10-0-138-15 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 23:05:25.264521 ip-10-0-138-15 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 23:05:35.301999 ip-10-0-138-15 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 23:05:35.302023 ip-10-0-138-15 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c141cfd1e638448aaa7280101ff76650 --
Jul 08 23:07:35.110667 ip-10-0-138-15 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.529928    2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535725    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535736    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535740    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535744    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535747    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535751    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535754    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 23:07:35.571071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535757    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535760    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535762    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535765    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535767    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535770    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535772    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535775    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535778    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535782    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535784    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535799    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535802    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535806    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535808    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535811    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535813    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535816    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535821    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535825    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 23:07:35.572675 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535828    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535831    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535834    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535836    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535838    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535841    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535844    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535846    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535849    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535851    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535854    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535857    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535859    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535862    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535864    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535867    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535869    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535872    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535875    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535877    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 23:07:35.573478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535880    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535882    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535884    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535887    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535889    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535892    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535894    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535897    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535899    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535902    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535905    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535908    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535912    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535914    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535917    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535921    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535924    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535927    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535929    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 23:07:35.574365 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535932    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535934    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535937    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535939    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535942    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535944    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535947    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535949    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535952    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535954    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535957    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535960    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535963    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535966    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535969    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535972    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535974    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535977    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535979    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535982    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 23:07:35.575256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535985    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535987    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535990    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535992    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535995    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.535997    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.536000    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.536002    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.536005    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.536008    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.536011    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.536014    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.536018    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537628    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537635    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537638    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537641    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537644    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537647    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537650    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 23:07:35.576100 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537654    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537656    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537659    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537662    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537666    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537669    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537672    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537675    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537678    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537681    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537684    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537687    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537689    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537692    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537695    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537697    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537700    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537702    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537705    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537707    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 23:07:35.576885 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537710    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537713    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537716    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537718    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537720    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537723    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537725    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537728    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537730    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537733    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537735    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537738    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537740    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537743    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537745    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537748    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537751    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537754    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537758    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537762    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 23:07:35.577673 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537765    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537768    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537771    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537773    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537776    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537779    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537782    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537785    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537787    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537790    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537792    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537795    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537798    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537800    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537803    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537806    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537809    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537811    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537814    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537817    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 23:07:35.578478 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537819    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537822    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537824    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537827    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537830    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537832    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537835    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537838    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537840    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537843    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537846    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537849    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537852    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537855    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537857    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537860    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537862    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537865    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537869    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 23:07:35.582508 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537872    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537875    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537878    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537881    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537884    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537887    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537889    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537892    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537896    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537899    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537902    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537905    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.537907    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538285    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538290    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538295    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538299    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538302    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538305    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 23:07:35.583299 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538307    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538310    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538313    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538316    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538320    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538323    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538326    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538329    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538331    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538334    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538337    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538339    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538342    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538344    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538347    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538349    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538352    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538354    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538357    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 23:07:35.584099 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538361    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538364    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538367    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538370    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538372    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538375    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538378    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538380    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538383    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538400    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538404    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538407    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538410    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538413    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538415    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538419    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538422    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538425    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538427    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538430    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 23:07:35.585645 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538433    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538435    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538438    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538440    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538443    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538445    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538448    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538450    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538453    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538455    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538458    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538461    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538465    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538468    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538470    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538473    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538475    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538478    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538480    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 23:07:35.586434 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538483    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538485    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538488    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538490    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538493    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538495    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538498    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538500    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538503    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538507    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538509    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538512    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538515    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538517    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538519    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538522    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538524    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538527    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538529    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538532    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 23:07:35.587243 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538534    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538536    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538539    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538541    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538544    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538546    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538549    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538551    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538554    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538556    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538559    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538561    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538564    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538566    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.538569    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538634    2586 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538645    2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538650    2586 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538655    2586 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538659    2586 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538662    2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538666    2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 23:07:35.588395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538670    2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538673    2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538676    2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538680    2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538683    2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538687    2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538690    2586 flags.go:64] FLAG: --cgroup-root=""
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538704    2586 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538708    2586 flags.go:64] FLAG: --client-ca-file=""
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538711    2586 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538714    2586 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538719    2586 flags.go:64] FLAG: --cluster-domain=""
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538722    2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538725    2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538728    2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538731    2586 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538735    2586 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538739    2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538742    2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538745    2586 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538759    2586 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538763    2586 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538766    2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538770    2586 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 23:07:35.589156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538773    2586 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538776    2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538779    2586 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538782    2586 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538785    2586 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538788    2586 flags.go:64] FLAG: --enable-server="true"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538791    2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538795    2586 flags.go:64] FLAG: --event-burst="100"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538798    2586 flags.go:64] FLAG: --event-qps="50"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538801    2586 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538804    2586 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538806    2586 flags.go:64] FLAG: --eviction-hard=""
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538810    2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538813    2586 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538816    2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538819    2586 flags.go:64] FLAG: --eviction-soft=""
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538822    2586 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538825    2586 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538828    2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538831    2586 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538834    2586 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538837    2586 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538840    2586 flags.go:64] FLAG: --feature-gates=""
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538844    2586 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538847    2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 23:07:35.590735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538850    2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538853    2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538856    2586 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538860    2586 flags.go:64] FLAG: --help="false"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538862    2586 flags.go:64] FLAG: --hostname-override="ip-10-0-138-15.ec2.internal"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538866    2586 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538868    2586 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538871    2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538875    2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538878    2586 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538881    2586 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538884    2586 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538886    2586 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538889    2586 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538892    2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538895    2586 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538898    2586 flags.go:64] FLAG: --kube-reserved=""
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538901    2586 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538903    2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538908    2586 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538911    2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538914    2586 flags.go:64] FLAG: --lock-file=""
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538917    2586 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538920    2586 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 23:07:35.591491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538923    2586 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538928    2586 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538931    2586 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538933    2586 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538936    2586 flags.go:64] FLAG: --logging-format="text"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538939    2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538942    2586 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538945    2586 flags.go:64] FLAG: --manifest-url=""
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538948    2586 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538952    2586 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538956    2586 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538960    2586 flags.go:64] FLAG: --max-pods="110"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538962    2586 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538965    2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538968    2586 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538971    2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538974    2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538977    2586 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538980    2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538986    2586 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538989    2586 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538992    2586 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538995    2586 flags.go:64] FLAG: --pod-cidr=""
Jul 08 23:07:35.592654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.538998    2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539003    2586 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539006    2586 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539010    2586 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539013    2586 flags.go:64] FLAG: --port="10250"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539019    2586 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539022    2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-050773e0c3dbfa923"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539025    2586 flags.go:64] FLAG: --qos-reserved=""
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539028    2586 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539031    2586 flags.go:64] FLAG: --register-node="true"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539034    2586 flags.go:64] FLAG: --register-with-taints=""
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539037    2586 flags.go:64] FLAG: --registry-burst="10"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539040    2586 flags.go:64] FLAG: --registry-qps="5"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539043    2586 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539046    2586 flags.go:64] FLAG: --reserved-memory=""
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539049    2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539052    2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539055    2586 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539058    2586 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539061    2586 flags.go:64] FLAG: --runonce="false"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539063    2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539066    2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539069    2586 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539072    2586 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539075    2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539078    2586 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 23:07:35.593894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539080    2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539083    2586 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539086    2586 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539089    2586 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539092    2586 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539094    2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539097    2586 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539100    2586 flags.go:64] FLAG: --system-cgroups=""
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539103    2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539110    2586 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539113    2586 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539117    2586 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539121    2586 flags.go:64] FLAG: --tls-min-version=""
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539124    2586 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539127    2586 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539130    2586 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539132    2586 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539135    2586 flags.go:64] FLAG: --v="2"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539139    2586 flags.go:64] FLAG: --version="false"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539143    2586 flags.go:64] FLAG: --vmodule=""
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539146    2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.539150    2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539274    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539279    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 23:07:36.815567 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539282    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539285    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539289    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539292    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539294    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539297    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539300    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539302    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539305    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539307    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539310    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539313    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539315    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539318    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539320    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539323    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539325    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539330    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539332    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539336    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 23:07:36.816534 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539339    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539342    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539346    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539348    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539351    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539353    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539356    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539359    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539361    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539364    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539366    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539369    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539371    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539374    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539377    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539380    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539383    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539386    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539388    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539390    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 23:07:36.817736 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539393    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539395    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539398    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539400    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539403    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539405    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539408    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539410    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539413    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539416    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539419    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539423    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539425    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539428    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539431    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539434    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539436    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539439    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539442    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 23:07:36.818467 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539445    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539449    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539452    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539455    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539458    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539460    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539463    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539466    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539468    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539471    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539474    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539476    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539479    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539481    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539484    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539487    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539489    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539492    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539495    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 23:07:36.820159 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539498    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539502    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539504    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539509    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539511    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539515    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539518    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539520    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539523    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539525    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539528    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539531    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539533    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539535    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539538    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539540    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539543    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539545    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 23:07:36.821022 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.539548    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.540715    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.548306    2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.548323    2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.548339    2586 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.548352    2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548412    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548418    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548421    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548424    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548427    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548429    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548432    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548435    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 23:07:36.823583 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548438    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 23:07:36.823145 ip-10-0-138-15 systemd[1]: Started Kubernetes Kubelet.
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548440    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548443    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548445    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548449    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548453    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548456    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548459    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548462    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548465    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548468    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548470    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548473    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548476    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548478    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548481    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548483    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548486    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548488    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 23:07:36.824421 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548491    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548493    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548502    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548505    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548507    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548510    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548513    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548515    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548518    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548521    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548524    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548527    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548530    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548533    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548536    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548538    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548541    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548543    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548546    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 23:07:36.826946 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548549    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548552    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548554    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548557    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548560    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548563    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548565    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548568    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548570    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548573    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548575    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548578    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548581    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548583    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548590    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548592    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548600    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548603    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548606    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548608    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 23:07:36.926236 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548611    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548613    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548616    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548618    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548621    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548623    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548626    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548628    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548631    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548634    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548636    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548638    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548642    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548645    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548648    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548652    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548655    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548658    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548660    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548663    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 23:07:36.928455 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548665    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548668    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548670    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548673    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548675    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548678    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548682    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548684    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548687    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548695    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548697    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548700    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548702    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.548707    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548856    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 23:07:36.929642 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548861    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548864    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548867    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548870    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548873    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548875    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548878    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548880    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548883    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548886    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548888    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548891    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548893    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548898    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548903    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548906    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548909    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548912    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548914    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548917    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 23:07:36.930405 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548919    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548922    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548924    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548928    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548930    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548933    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548936    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548944    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548947    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548949    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548952    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548954    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548957    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548959    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548961    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548964    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548966    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548971    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548974    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 23:07:36.931190 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548977    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548981    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548984    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548986    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548988    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548991    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548995    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.548997    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549000    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549003    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549005    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549008    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549010    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549013    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549015    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549018    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549022    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549024    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549027    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 23:07:36.933909 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549029    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549032    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549040    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549043    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549045    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549048    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549051    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549053    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549056    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549058    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549061    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549063    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549066    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549068    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549071    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549073    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549075    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549078    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549080    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 23:07:36.935061 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549084    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549087    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549089    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549092    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549094    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549097    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549099    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549102    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549104    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549107    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549110    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549113    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549115    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549118    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549120    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549123    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549131    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549134    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549137    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549139    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 23:07:36.936618 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:35.549142    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.549146    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.549288    2586 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.551366    2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.552749    2586 server.go:1019] "Starting client certificate rotation"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.552841    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.552879    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.556076    2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.560092    2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.571777    2586 log.go:25] "Validated CRI v1 runtime API"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.574218    2586 log.go:25] "Validated CRI v1 image API"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.575878    2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 23:07:36.937392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.578384    2586 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8cba104c-b7e6-4122-b900-68df77f04d0c:/dev/nvme0n1p3 bb603377-7782-4e15-b317-cf3ba446063a:/dev/nvme0n1p4]
Jul 08 23:07:36.949021 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.578401    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 23:07:36.949021 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.578402    2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.583568    2586 manager.go:216] Machine: {Timestamp:2026-07-08 23:07:35.582148323 +0000 UTC m=+0.350551850 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100170 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28cf4199d83cfb9577e70efe25d7be SystemUUID:ec28cf41-99d8-3cfb-9577-e70efe25d7be BootID:c141cfd1-e638-448a-aa72-80101ff76650 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:f5:65:c2:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:f5:65:c2:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:76:ab:ef:7b:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.583671    2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.583743    2586 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.586969    2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.586997    2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-15.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.587857    2586 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.587869    2586 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.587879    2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.588578    2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.589839    2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.592799    2586 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.592943    2586 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.592983    2586 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.593003    2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.593022    2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.593039    2586 kubelet.go:398] "Adding apiserver pod source"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.593052    2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 23:07:36.950968 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.593477    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:35.593505    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.815360    2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.817265    2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.817292    2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818330    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818342    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818348    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818353    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818362    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818367    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818375    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818384    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818391    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818396    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818409    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.818415    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.819234    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.819242    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.821016    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vx2jl"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.822299    2586 server.go:1268] "Started kubelet"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.822383    2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-15.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.822389    2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:36.826735    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:36.826892    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-15.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.822392    2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.827572    2586 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.828966    2586 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.829057    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vx2jl"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.833005    2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:36.832793    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-15.ec2.internal.18c07325614f26cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-15.ec2.internal,UID:ip-10-0-138-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-15.ec2.internal,},FirstTimestamp:2026-07-08 23:07:36.822277835 +0000 UTC m=+0.371337418,LastTimestamp:2026-07-08 23:07:36.822277835 +0000 UTC m=+0.371337418,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-15.ec2.internal,}"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:36.836247    2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.838885    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.838886    2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:36.838970    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.839554    2586 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.839568    2586 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.839725    2586 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.839732    2586 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.839873    2586 factory.go:55] Registering systemd factory
Jul 08 23:07:36.951746 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.839890    2586 factory.go:223] Registration of the systemd container factory successfully
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.839957    2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.840121    2586 factory.go:153] Registering CRI-O factory
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.840132    2586 factory.go:223] Registration of the crio container factory successfully
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.840181    2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.840205    2586 factory.go:103] Registering Raw factory
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.840220    2586 manager.go:1196] Started watching for new ooms in manager
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.840869    2586 manager.go:349] Starting recovery of all containers
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.850667    2586 manager.go:354] Recovery completed
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.852197    2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.854707    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:36.855505    2586 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-15.ec2.internal\" not found" node="ip-10-0-138-15.ec2.internal"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.856589    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.856615    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.856625    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientPID"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.857064    2586 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.857072    2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.857087    2586 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.857065    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.858188    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.858213    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.858223    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientPID"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.858250    2586 policy_none.go:49] "None policy: Start"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.858262    2586 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.858273    2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:36.859348    2586 policy_none.go:47] "Start"
Jul 08 23:07:36.954478 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:36.939924    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.056868 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.040215    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.169169 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.140486    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.206126    2586 manager.go:337] "Starting Device Plugin manager"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.206328    2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.206341    2586 server.go:87] "Starting device plugin registration server"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.206600    2586 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.206612    2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.206684    2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.206751    2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.206757    2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.207247    2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 23:07:37.262237 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.207286    2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.379992 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.308163    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 23:07:37.379992 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.309547    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 23:07:37.379992 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.309580    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 23:07:37.379992 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.309593    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientPID"
Jul 08 23:07:37.379992 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.309618    2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.379992 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.321911    2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.379992 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.321928    2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-15.ec2.internal\": node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.379992 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.359228    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.459483 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.459469    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.525430 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.525398    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 23:07:37.526596 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.526581    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 23:07:37.526677 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.526619    2586 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 23:07:37.526677 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.526645    2586 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 23:07:37.526769 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.526685    2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 23:07:37.529043 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.529022    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 23:07:37.560397 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.560362    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.627582 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.627553    2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal"]
Jul 08 23:07:37.627658 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.627633    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 23:07:37.629217 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.629201    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 23:07:37.629290 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.629232    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 23:07:37.629290 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.629242    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientPID"
Jul 08 23:07:37.630513 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.630478    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 23:07:37.630616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.630603    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.630658 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.630632    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 23:07:37.631245 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.631226    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 23:07:37.631318 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.631260    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 23:07:37.631318 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.631271    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientPID"
Jul 08 23:07:37.631318 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.631231    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 23:07:37.631412 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.631320    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 23:07:37.631412 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.631330    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientPID"
Jul 08 23:07:37.632351 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.632336    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.632417 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.632362    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 23:07:37.632972 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.632957    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 23:07:37.633041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.632979    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 23:07:37.633041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.632988    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeHasSufficientPID"
Jul 08 23:07:37.644193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.644177    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d1aa91a25fa6212282656141f669b7b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-15.ec2.internal\" (UID: \"9d1aa91a25fa6212282656141f669b7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.644274 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.644199    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8abdfaf585e604c9dab6fd72802a3597-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal\" (UID: \"8abdfaf585e604c9dab6fd72802a3597\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.644274 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.644218    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8abdfaf585e604c9dab6fd72802a3597-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal\" (UID: \"8abdfaf585e604c9dab6fd72802a3597\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.657095 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.657075    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-15.ec2.internal\" not found" node="ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.661238 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.661222    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.661346 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.661332    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-15.ec2.internal\" not found" node="ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.745152 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.745122    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8abdfaf585e604c9dab6fd72802a3597-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal\" (UID: \"8abdfaf585e604c9dab6fd72802a3597\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.745152 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.745151    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8abdfaf585e604c9dab6fd72802a3597-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal\" (UID: \"8abdfaf585e604c9dab6fd72802a3597\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.745340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.745169    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d1aa91a25fa6212282656141f669b7b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-15.ec2.internal\" (UID: \"9d1aa91a25fa6212282656141f669b7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.745340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.745194    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8abdfaf585e604c9dab6fd72802a3597-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal\" (UID: \"8abdfaf585e604c9dab6fd72802a3597\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.745340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.745216    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d1aa91a25fa6212282656141f669b7b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-15.ec2.internal\" (UID: \"9d1aa91a25fa6212282656141f669b7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.745340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.745259    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8abdfaf585e604c9dab6fd72802a3597-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal\" (UID: \"8abdfaf585e604c9dab6fd72802a3597\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.762279 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.762242    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.771405 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.771388    2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 23:07:37.771552 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.771533    2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 23:07:37.771593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.771567    2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 23:07:37.836654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.836623    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 23:02:36 +0000 UTC" deadline="2028-01-04 14:04:41.213937353 +0000 UTC"
Jul 08 23:07:37.836654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.836648    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13070h57m3.377291876s"
Jul 08 23:07:37.862567 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.862532    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.960084 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.960021    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:37.962752 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:37.962737    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-15.ec2.internal\" not found"
Jul 08 23:07:37.964155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:37.963958    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:38.009868 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.009842    2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 23:07:38.039728 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.039705    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:38.050078 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.050060    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 23:07:38.051840 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.051828    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal"
Jul 08 23:07:38.059852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.059839    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 23:07:38.429193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.429126    2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 23:07:38.553385 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:38.553353    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abdfaf585e604c9dab6fd72802a3597.slice/crio-47c80d2fd34082e54cecc20e79f7861be8bade5a6eff97a22356a1a079b0f724 WatchSource:0}: Error finding container 47c80d2fd34082e54cecc20e79f7861be8bade5a6eff97a22356a1a079b0f724: Status 404 returned error can't find the container with id 47c80d2fd34082e54cecc20e79f7861be8bade5a6eff97a22356a1a079b0f724
Jul 08 23:07:38.557504 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.557491    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:07:38.581203 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:38.581179    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1aa91a25fa6212282656141f669b7b.slice/crio-e872c0ac0e18c9c3b5980269984c8c0a8ce18a13366e05b03e5eb5126447feac WatchSource:0}: Error finding container e872c0ac0e18c9c3b5980269984c8c0a8ce18a13366e05b03e5eb5126447feac: Status 404 returned error can't find the container with id e872c0ac0e18c9c3b5980269984c8c0a8ce18a13366e05b03e5eb5126447feac
Jul 08 23:07:38.718129 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.718057    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 23:07:38.813267 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.813244    2586 apiserver.go:52] "Watching apiserver"
Jul 08 23:07:38.821947 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.821921    2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 23:07:38.823826 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.823801    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs","openshift-image-registry/node-ca-d2kh5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal","openshift-network-diagnostics/network-check-target-w4r4g","openshift-network-operator/iptables-alerter-xpv5b","openshift-ovn-kubernetes/ovnkube-node-lhdh9","kube-system/global-pull-secret-syncer-p6sv7","kube-system/konnectivity-agent-cw9wl","openshift-cluster-node-tuning-operator/tuned-26l87","openshift-dns/node-resolver-sm9fr","openshift-multus/multus-additional-cni-plugins-vl9rq","openshift-multus/multus-gdknf","openshift-multus/network-metrics-daemon-txmkb"]
Jul 08 23:07:38.825547 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.825532    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.827399 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.827375    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.828140 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.828115    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 23:07:38.828382 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.828364    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9sls2\""
Jul 08 23:07:38.828444 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.828416    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 23:07:38.829485 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.829463    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 23:07:38.829963 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.829885    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 23:07:38.830073 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.829963    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 23:07:38.830073 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.829978    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c8x9n\""
Jul 08 23:07:38.830073 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.830012    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 23:07:38.830608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.830589    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.831964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.831947    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:38.832057 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.832011    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:38.832843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.832825    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 23:07:38.832932 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.832851    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 23:07:38.832980 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.832933    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 23:07:38.832980 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.832957    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lf6ss\""
Jul 08 23:07:38.833164 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.833151    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:38.833213 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.833197    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:38.834305 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.834290    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.835616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.835596    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:07:38.836641 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.836623    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 23:07:38.836641 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.836640    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 23:07:38.837326 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.836706    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qdjpd\""
Jul 08 23:07:38.837326 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.836760    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 23:07:38.837326 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.836837    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.837947 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.837930    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 23:07:38.838047 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.838022    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 23:07:38.838163 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.838147    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cm4j2\""
Jul 08 23:07:38.838406 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.838392    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.839139 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.839121    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 23:07:38.839773 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.839760    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.839825 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.839806    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:38.840155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840133    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 23:07:38.840243 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840165    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 23:07:38.840243 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840218    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 23:07:38.840349 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840254    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v7dqn\""
Jul 08 23:07:38.840349 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840136    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 23:07:38.840439 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840409    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 23:07:38.840488 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840467    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 23:07:38.840683 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840666    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 23:07:38.840758 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840708    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s5526\""
Jul 08 23:07:38.840818 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840809    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 23:07:38.840978 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.840894    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 23:07:38.841208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.841188    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.842564 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.842549    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.843376 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.843360    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 23:07:38.843504 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.843490    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7ltzd\""
Jul 08 23:07:38.843596 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.843566    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 23:07:38.844683 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.844638    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fmtgk\""
Jul 08 23:07:38.844782 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.844700    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 23:07:38.844782 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.844703    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 23:07:38.849663 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849646    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-cni-multus\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.849743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849668    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-kubelet\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.849743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849683    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd51c369-2f70-4c75-841c-9d7e762a70b4-host\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.849743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849700    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-log-socket\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.849743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849721    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-host\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849758    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-system-cni-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849781    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849797    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-socket-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849818    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849820    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849848    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysctl-conf\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849863    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-k8s-cni-cncf-io\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849891    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/296b201e-5790-46a7-be74-3d1e14013c81-iptables-alerter-script\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.849938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849937    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-systemd-units\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849961    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-kubernetes\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.849984    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b09f1d67-537f-4e5d-889e-6a5164aadf32-dbus\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850006    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-cni-bin\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850060    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-daemon-config\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850076    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-kubelet\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850089    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-systemd\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850102    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk8bc\" (UniqueName: \"kubernetes.io/projected/bd51c369-2f70-4c75-841c-9d7e762a70b4-kube-api-access-vk8bc\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850116    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b7f3241-2369-452d-be9d-b62f0c496956-tmp-dir\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850141    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-etc-kubernetes\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850167    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-var-lib-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850185    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-cni-netd\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850203    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06e98e17-863d-4dec-b390-1dcd328b465b-ovn-node-metrics-cert\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850226    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd51c369-2f70-4c75-841c-9d7e762a70b4-serviceca\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850250    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-slash\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850266    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-cni-bin\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850289    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-684mr\" (UniqueName: \"kubernetes.io/projected/06e98e17-863d-4dec-b390-1dcd328b465b-kube-api-access-684mr\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.850362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850323    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/502afacd-acff-4caa-a736-9291f37d4ecb-etc-tuned\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850343    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-cni-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850366    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850382    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b09f1d67-537f-4e5d-889e-6a5164aadf32-kubelet-config\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850413    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850854    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-modprobe-d\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850872    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-cnibin\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850891    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-device-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850907    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b7f3241-2369-452d-be9d-b62f0c496956-hosts-file\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850927    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/296b201e-5790-46a7-be74-3d1e14013c81-host-slash\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850942    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wht5n\" (UniqueName: \"kubernetes.io/projected/296b201e-5790-46a7-be74-3d1e14013c81-kube-api-access-wht5n\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850957    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrnwn\" (UniqueName: \"kubernetes.io/projected/59a33c2b-9f6a-4084-868f-32636e1cf0a8-kube-api-access-mrnwn\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850978    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-run-netns\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.850995    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-ovn\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851010    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-ovnkube-config\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851023    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-run\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851036    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-lib-modules\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.851167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851067    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cb739af-dcea-41ee-af74-e07c4b2c016b-agent-certs\") pod \"konnectivity-agent-cw9wl\" (UID: \"0cb739af-dcea-41ee-af74-e07c4b2c016b\") " pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851087    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysconfig\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851103    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-netns\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851116    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-hostroot\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851130    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-env-overrides\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851146    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-conf-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851172    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-etc-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851202    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysctl-d\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851228    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-multus-certs\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851255    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851278    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwlf\" (UniqueName: \"kubernetes.io/projected/fca408d9-ffeb-433e-bb52-eb2e3748a37a-kube-api-access-7mwlf\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851302    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk7sv\" (UniqueName: \"kubernetes.io/projected/5d90721e-9094-4a91-a701-0cfcfdeebf1f-kube-api-access-qk7sv\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851322    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cb739af-dcea-41ee-af74-e07c4b2c016b-konnectivity-ca\") pod \"konnectivity-agent-cw9wl\" (UID: \"0cb739af-dcea-41ee-af74-e07c4b2c016b\") " pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851339    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-node-log\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851367    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851398    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/502afacd-acff-4caa-a736-9291f37d4ecb-tmp\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.852001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851421    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m86wr\" (UniqueName: \"kubernetes.io/projected/502afacd-acff-4caa-a736-9291f37d4ecb-kube-api-access-m86wr\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851444    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-registration-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851466    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-sys-fs\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851487    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v5b4\" (UniqueName: \"kubernetes.io/projected/4b7f3241-2369-452d-be9d-b62f0c496956-kube-api-access-5v5b4\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851513    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-systemd\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851585    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-var-lib-kubelet\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851611    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-os-release\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851638    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-socket-dir-parent\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851660    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851681    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-ovnkube-script-lib\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851707    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-sys\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851720    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59a33c2b-9f6a-4084-868f-32636e1cf0a8-cni-binary-copy\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.852865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.851741    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.872926 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.872906    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lvpgp"
Jul 08 23:07:38.879909 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.879893    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lvpgp"
Jul 08 23:07:38.885232 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.885211    2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 23:07:38.940722 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.940703    2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 23:07:38.951942 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.951923    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.952023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.951947    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-ovnkube-script-lib\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.952023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.951962    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-sys\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.952023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.951976    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59a33c2b-9f6a-4084-868f-32636e1cf0a8-cni-binary-copy\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.952023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.951993    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-os-release\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.952023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952009    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.952023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952025    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952041    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhvfw\" (UniqueName: \"kubernetes.io/projected/681c6287-4fea-4dd1-90bc-cdb82b6a2591-kube-api-access-lhvfw\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952078    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-sys\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.952102    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952141    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-cni-multus\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952099    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.952168    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret podName:b09f1d67-537f-4e5d-889e-6a5164aadf32 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:39.452154266 +0000 UTC m=+3.001213839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret") pod "global-pull-secret-syncer-p6sv7" (UID: "b09f1d67-537f-4e5d-889e-6a5164aadf32") : object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952101    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-cni-multus\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952199    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-kubelet\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952225    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd51c369-2f70-4c75-841c-9d7e762a70b4-host\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952239    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-log-socket\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952275    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-kubelet\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.952293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952294    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd51c369-2f70-4c75-841c-9d7e762a70b4-host\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952280    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-log-socket\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952321    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-host\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952337    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-system-cni-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952359    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952372    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-host\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952382    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-socket-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952392    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-system-cni-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952406    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952428    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysctl-conf\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952442    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-k8s-cni-cncf-io\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952457    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/296b201e-5790-46a7-be74-3d1e14013c81-iptables-alerter-script\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952483    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cnibin\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952482    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952508    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-systemd-units\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952508    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-socket-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952569    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-kubernetes\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.952875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952602    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b09f1d67-537f-4e5d-889e-6a5164aadf32-dbus\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952615    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59a33c2b-9f6a-4084-868f-32636e1cf0a8-cni-binary-copy\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952512    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-k8s-cni-cncf-io\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952643    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-cni-bin\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952613    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-kubernetes\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952655    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysctl-conf\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952668    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-daemon-config\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952667    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-ovnkube-script-lib\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952574    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-systemd-units\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952691    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-var-lib-cni-bin\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952708    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952741    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-kubelet\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952764    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-systemd\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952791    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk8bc\" (UniqueName: \"kubernetes.io/projected/bd51c369-2f70-4c75-841c-9d7e762a70b4-kube-api-access-vk8bc\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952800    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-kubelet\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952808    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-systemd\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952815    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b7f3241-2369-452d-be9d-b62f0c496956-tmp-dir\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952817    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b09f1d67-537f-4e5d-889e-6a5164aadf32-dbus\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.953732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952839    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-etc-kubernetes\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952864    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-var-lib-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952886    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-cni-netd\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952907    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06e98e17-863d-4dec-b390-1dcd328b465b-ovn-node-metrics-cert\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952927    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-var-lib-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952934    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd51c369-2f70-4c75-841c-9d7e762a70b4-serviceca\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952947    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-etc-kubernetes\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952965    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.952993    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-slash\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953000    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-cni-netd\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953027    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/296b201e-5790-46a7-be74-3d1e14013c81-iptables-alerter-script\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953016    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-cni-bin\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953052    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-slash\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953077    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-684mr\" (UniqueName: \"kubernetes.io/projected/06e98e17-863d-4dec-b390-1dcd328b465b-kube-api-access-684mr\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953086    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b7f3241-2369-452d-be9d-b62f0c496956-tmp-dir\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953098    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/502afacd-acff-4caa-a736-9291f37d4ecb-etc-tuned\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953050    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-cni-bin\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953117    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-daemon-config\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.954616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953119    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-cni-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953168    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-cni-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953170    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953203    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b09f1d67-537f-4e5d-889e-6a5164aadf32-kubelet-config\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953226    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953243    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-modprobe-d\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953273    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-cnibin\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953272    2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953296    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-device-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953308    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.953317    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953318    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b7f3241-2369-452d-be9d-b62f0c496956-hosts-file\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953342    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-cnibin\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953278    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b09f1d67-537f-4e5d-889e-6a5164aadf32-kubelet-config\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953371    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-modprobe-d\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953376    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b7f3241-2369-452d-be9d-b62f0c496956-hosts-file\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953380    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-device-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953375    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd51c369-2f70-4c75-841c-9d7e762a70b4-serviceca\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.955256 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.953401    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:39.453385866 +0000 UTC m=+3.002445451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953423    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/296b201e-5790-46a7-be74-3d1e14013c81-host-slash\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953440    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/296b201e-5790-46a7-be74-3d1e14013c81-host-slash\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953451    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wht5n\" (UniqueName: \"kubernetes.io/projected/296b201e-5790-46a7-be74-3d1e14013c81-kube-api-access-wht5n\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953479    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cni-binary-copy\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953503    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrnwn\" (UniqueName: \"kubernetes.io/projected/59a33c2b-9f6a-4084-868f-32636e1cf0a8-kube-api-access-mrnwn\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953546    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-run-netns\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953571    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-ovn\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953593    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-ovnkube-config\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953630    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-run-netns\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953638    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-ovn\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953672    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-run\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953697    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-lib-modules\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953717    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cb739af-dcea-41ee-af74-e07c4b2c016b-agent-certs\") pod \"konnectivity-agent-cw9wl\" (UID: \"0cb739af-dcea-41ee-af74-e07c4b2c016b\") " pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953735    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-run\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953738    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysconfig\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953780    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-netns\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953799    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-hostroot\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.955832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953816    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysconfig\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953817    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-env-overrides\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953828    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-lib-modules\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953866    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-conf-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953882    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-netns\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953887    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-etc-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953907    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysctl-d\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953922    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-conf-dir\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953941    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-multus-certs\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953960    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-etc-openvswitch\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954011    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-host-run-multus-certs\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954059    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-hostroot\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954066    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-etc-sysctl-d\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954067    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-ovnkube-config\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.953963    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954104    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwlf\" (UniqueName: \"kubernetes.io/projected/fca408d9-ffeb-433e-bb52-eb2e3748a37a-kube-api-access-7mwlf\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954113    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954126    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk7sv\" (UniqueName: \"kubernetes.io/projected/5d90721e-9094-4a91-a701-0cfcfdeebf1f-kube-api-access-qk7sv\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:38.956339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954146    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06e98e17-863d-4dec-b390-1dcd328b465b-env-overrides\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954176    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cb739af-dcea-41ee-af74-e07c4b2c016b-konnectivity-ca\") pod \"konnectivity-agent-cw9wl\" (UID: \"0cb739af-dcea-41ee-af74-e07c4b2c016b\") " pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954285    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-node-log\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954308    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954329    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/502afacd-acff-4caa-a736-9291f37d4ecb-tmp\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954353    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m86wr\" (UniqueName: \"kubernetes.io/projected/502afacd-acff-4caa-a736-9291f37d4ecb-kube-api-access-m86wr\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954371    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-node-log\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954384    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-registration-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954388    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954422    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-sys-fs\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954445    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-registration-dir\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954451    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v5b4\" (UniqueName: \"kubernetes.io/projected/4b7f3241-2369-452d-be9d-b62f0c496956-kube-api-access-5v5b4\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954499    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-system-cni-dir\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954491    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fca408d9-ffeb-433e-bb52-eb2e3748a37a-sys-fs\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954544    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-systemd\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954569    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-var-lib-kubelet\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954592    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-os-release\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.956959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954614    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-socket-dir-parent\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954677    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06e98e17-863d-4dec-b390-1dcd328b465b-run-systemd\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954717    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-multus-socket-dir-parent\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954733    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/502afacd-acff-4caa-a736-9291f37d4ecb-var-lib-kubelet\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954747    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cb739af-dcea-41ee-af74-e07c4b2c016b-konnectivity-ca\") pod \"konnectivity-agent-cw9wl\" (UID: \"0cb739af-dcea-41ee-af74-e07c4b2c016b\") " pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.954777    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59a33c2b-9f6a-4084-868f-32636e1cf0a8-os-release\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.956490    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/502afacd-acff-4caa-a736-9291f37d4ecb-etc-tuned\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.956593    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/502afacd-acff-4caa-a736-9291f37d4ecb-tmp\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.956654    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06e98e17-863d-4dec-b390-1dcd328b465b-ovn-node-metrics-cert\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:38.957408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.956708    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cb739af-dcea-41ee-af74-e07c4b2c016b-agent-certs\") pod \"konnectivity-agent-cw9wl\" (UID: \"0cb739af-dcea-41ee-af74-e07c4b2c016b\") " pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:07:38.958146 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.958131    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 23:07:38.958214 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.958150    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 23:07:38.958214 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.958162    2586 projected.go:196] Error preparing data for projected volume kube-api-access-vp9ml for pod openshift-network-diagnostics/network-check-target-w4r4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:38.958287 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:38.958214    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml podName:8bc912f9-8d92-405e-9314-ea3b8050ab7d nodeName:}" failed. No retries permitted until 2026-07-08 23:07:39.458198891 +0000 UTC m=+3.007258484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vp9ml" (UniqueName: "kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml") pod "network-check-target-w4r4g" (UID: "8bc912f9-8d92-405e-9314-ea3b8050ab7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:38.965308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.965284    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrnwn\" (UniqueName: \"kubernetes.io/projected/59a33c2b-9f6a-4084-868f-32636e1cf0a8-kube-api-access-mrnwn\") pod \"multus-gdknf\" (UID: \"59a33c2b-9f6a-4084-868f-32636e1cf0a8\") " pod="openshift-multus/multus-gdknf"
Jul 08 23:07:38.967661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.967596    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwlf\" (UniqueName: \"kubernetes.io/projected/fca408d9-ffeb-433e-bb52-eb2e3748a37a-kube-api-access-7mwlf\") pod \"aws-ebs-csi-driver-node-r27cs\" (UID: \"fca408d9-ffeb-433e-bb52-eb2e3748a37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:38.968084 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.968041    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m86wr\" (UniqueName: \"kubernetes.io/projected/502afacd-acff-4caa-a736-9291f37d4ecb-kube-api-access-m86wr\") pod \"tuned-26l87\" (UID: \"502afacd-acff-4caa-a736-9291f37d4ecb\") " pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:38.968419 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.968363    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk7sv\" (UniqueName: \"kubernetes.io/projected/5d90721e-9094-4a91-a701-0cfcfdeebf1f-kube-api-access-qk7sv\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:38.968616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.968577    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk8bc\" (UniqueName: \"kubernetes.io/projected/bd51c369-2f70-4c75-841c-9d7e762a70b4-kube-api-access-vk8bc\") pod \"node-ca-d2kh5\" (UID: \"bd51c369-2f70-4c75-841c-9d7e762a70b4\") " pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:38.969325 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.969304    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v5b4\" (UniqueName: \"kubernetes.io/projected/4b7f3241-2369-452d-be9d-b62f0c496956-kube-api-access-5v5b4\") pod \"node-resolver-sm9fr\" (UID: \"4b7f3241-2369-452d-be9d-b62f0c496956\") " pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:38.969684 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.969657    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wht5n\" (UniqueName: \"kubernetes.io/projected/296b201e-5790-46a7-be74-3d1e14013c81-kube-api-access-wht5n\") pod \"iptables-alerter-xpv5b\" (UID: \"296b201e-5790-46a7-be74-3d1e14013c81\") " pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:38.969852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:38.969834    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-684mr\" (UniqueName: \"kubernetes.io/projected/06e98e17-863d-4dec-b390-1dcd328b465b-kube-api-access-684mr\") pod \"ovnkube-node-lhdh9\" (UID: \"06e98e17-863d-4dec-b390-1dcd328b465b\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:39.055415 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055384    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-system-cni-dir\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055562 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055441    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-os-release\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055562 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055465    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055562 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055489    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhvfw\" (UniqueName: \"kubernetes.io/projected/681c6287-4fea-4dd1-90bc-cdb82b6a2591-kube-api-access-lhvfw\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055562 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055558    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cnibin\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055569    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-os-release\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055588    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055624    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055626    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cnibin\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055667    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cni-binary-copy\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055492    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-system-cni-dir\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.055781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.055753    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/681c6287-4fea-4dd1-90bc-cdb82b6a2591-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.056176 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.056153    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.056252 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.056196    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cni-binary-copy\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.056304 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.056243    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/681c6287-4fea-4dd1-90bc-cdb82b6a2591-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.063689 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.063450    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhvfw\" (UniqueName: \"kubernetes.io/projected/681c6287-4fea-4dd1-90bc-cdb82b6a2591-kube-api-access-lhvfw\") pod \"multus-additional-cni-plugins-vl9rq\" (UID: \"681c6287-4fea-4dd1-90bc-cdb82b6a2591\") " pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.137500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.137472    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26l87"
Jul 08 23:07:39.143930 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.143905    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdknf"
Jul 08 23:07:39.147726 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.147702    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502afacd_acff_4caa_a736_9291f37d4ecb.slice/crio-4f49b71b5b3a265c1d1c0141ffeaa2d1e8fc13e5fc429a20b6124970908a5ec2 WatchSource:0}: Error finding container 4f49b71b5b3a265c1d1c0141ffeaa2d1e8fc13e5fc429a20b6124970908a5ec2: Status 404 returned error can't find the container with id 4f49b71b5b3a265c1d1c0141ffeaa2d1e8fc13e5fc429a20b6124970908a5ec2
Jul 08 23:07:39.149677 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.149656    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d2kh5"
Jul 08 23:07:39.152108 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.152090    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a33c2b_9f6a_4084_868f_32636e1cf0a8.slice/crio-60b2dd8f0ee02688a3b3aa6a8090c63a76d37c1b5969859081cd754187e157d0 WatchSource:0}: Error finding container 60b2dd8f0ee02688a3b3aa6a8090c63a76d37c1b5969859081cd754187e157d0: Status 404 returned error can't find the container with id 60b2dd8f0ee02688a3b3aa6a8090c63a76d37c1b5969859081cd754187e157d0
Jul 08 23:07:39.154945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.154927    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xpv5b"
Jul 08 23:07:39.158340 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.158316    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd51c369_2f70_4c75_841c_9d7e762a70b4.slice/crio-4428a5483eb124559453b2528d115f8c645f22953e7a0489be44cf780c558a5d WatchSource:0}: Error finding container 4428a5483eb124559453b2528d115f8c645f22953e7a0489be44cf780c558a5d: Status 404 returned error can't find the container with id 4428a5483eb124559453b2528d115f8c645f22953e7a0489be44cf780c558a5d
Jul 08 23:07:39.162859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.162839    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:07:39.164318 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.164294    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296b201e_5790_46a7_be74_3d1e14013c81.slice/crio-1e2f73524da164a7f2bc625959ed40dd9d96a1b502f228818b8be374e4f2a412 WatchSource:0}: Error finding container 1e2f73524da164a7f2bc625959ed40dd9d96a1b502f228818b8be374e4f2a412: Status 404 returned error can't find the container with id 1e2f73524da164a7f2bc625959ed40dd9d96a1b502f228818b8be374e4f2a412
Jul 08 23:07:39.168166 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.168104    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:07:39.172892 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.172826    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb739af_dcea_41ee_af74_e07c4b2c016b.slice/crio-19e3a55992547455d68bb09bbf9cb3118ddf37a1ead97ad7da8b188dc55b3e49 WatchSource:0}: Error finding container 19e3a55992547455d68bb09bbf9cb3118ddf37a1ead97ad7da8b188dc55b3e49: Status 404 returned error can't find the container with id 19e3a55992547455d68bb09bbf9cb3118ddf37a1ead97ad7da8b188dc55b3e49
Jul 08 23:07:39.172949 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.172910    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs"
Jul 08 23:07:39.176018 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.175994    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e98e17_863d_4dec_b390_1dcd328b465b.slice/crio-2b60eaaa48f5550a1c55bde318a43bf1fc463138d3a546cb269af986fef47a09 WatchSource:0}: Error finding container 2b60eaaa48f5550a1c55bde318a43bf1fc463138d3a546cb269af986fef47a09: Status 404 returned error can't find the container with id 2b60eaaa48f5550a1c55bde318a43bf1fc463138d3a546cb269af986fef47a09
Jul 08 23:07:39.178219 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.178152    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sm9fr"
Jul 08 23:07:39.182531 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.182502    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vl9rq"
Jul 08 23:07:39.182820 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.182788    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca408d9_ffeb_433e_bb52_eb2e3748a37a.slice/crio-00e396bcfd9ac1f6b7756c178ccbd9bd2da190ef2848be6503e778b9f86e957a WatchSource:0}: Error finding container 00e396bcfd9ac1f6b7756c178ccbd9bd2da190ef2848be6503e778b9f86e957a: Status 404 returned error can't find the container with id 00e396bcfd9ac1f6b7756c178ccbd9bd2da190ef2848be6503e778b9f86e957a
Jul 08 23:07:39.187269 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.187250    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7f3241_2369_452d_be9d_b62f0c496956.slice/crio-3b9e0c9c73564b9fa83fc4a63e4196ae9b7054f02e25f5c891aa5c01a81742bd WatchSource:0}: Error finding container 3b9e0c9c73564b9fa83fc4a63e4196ae9b7054f02e25f5c891aa5c01a81742bd: Status 404 returned error can't find the container with id 3b9e0c9c73564b9fa83fc4a63e4196ae9b7054f02e25f5c891aa5c01a81742bd
Jul 08 23:07:39.193050 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:07:39.193030    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681c6287_4fea_4dd1_90bc_cdb82b6a2591.slice/crio-df08dc9727b3f77f1bd8c769b06d8c2137b9f186f514d6891d2d4c40fd6795de WatchSource:0}: Error finding container df08dc9727b3f77f1bd8c769b06d8c2137b9f186f514d6891d2d4c40fd6795de: Status 404 returned error can't find the container with id df08dc9727b3f77f1bd8c769b06d8c2137b9f186f514d6891d2d4c40fd6795de
Jul 08 23:07:39.457952 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.457865    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:39.457952 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.457945    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:39.458167 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:39.458080    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:39.458167 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:39.458148    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:40.458129518 +0000 UTC m=+4.007189103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:39.458167 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:39.458154    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:39.458327 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:39.458189    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret podName:b09f1d67-537f-4e5d-889e-6a5164aadf32 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:40.458179368 +0000 UTC m=+4.007238942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret") pod "global-pull-secret-syncer-p6sv7" (UID: "b09f1d67-537f-4e5d-889e-6a5164aadf32") : object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:39.532474 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.532418    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" event={"ID":"681c6287-4fea-4dd1-90bc-cdb82b6a2591","Type":"ContainerStarted","Data":"df08dc9727b3f77f1bd8c769b06d8c2137b9f186f514d6891d2d4c40fd6795de"}
Jul 08 23:07:39.534120 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.534066    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sm9fr" event={"ID":"4b7f3241-2369-452d-be9d-b62f0c496956","Type":"ContainerStarted","Data":"3b9e0c9c73564b9fa83fc4a63e4196ae9b7054f02e25f5c891aa5c01a81742bd"}
Jul 08 23:07:39.536543 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.536502    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs" event={"ID":"fca408d9-ffeb-433e-bb52-eb2e3748a37a","Type":"ContainerStarted","Data":"00e396bcfd9ac1f6b7756c178ccbd9bd2da190ef2848be6503e778b9f86e957a"}
Jul 08 23:07:39.539724 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.539700    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cw9wl" event={"ID":"0cb739af-dcea-41ee-af74-e07c4b2c016b","Type":"ContainerStarted","Data":"19e3a55992547455d68bb09bbf9cb3118ddf37a1ead97ad7da8b188dc55b3e49"}
Jul 08 23:07:39.541663 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.541593    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xpv5b" event={"ID":"296b201e-5790-46a7-be74-3d1e14013c81","Type":"ContainerStarted","Data":"1e2f73524da164a7f2bc625959ed40dd9d96a1b502f228818b8be374e4f2a412"}
Jul 08 23:07:39.542889 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.542865    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d2kh5" event={"ID":"bd51c369-2f70-4c75-841c-9d7e762a70b4","Type":"ContainerStarted","Data":"4428a5483eb124559453b2528d115f8c645f22953e7a0489be44cf780c558a5d"}
Jul 08 23:07:39.544542 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.544486    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal" event={"ID":"9d1aa91a25fa6212282656141f669b7b","Type":"ContainerStarted","Data":"e872c0ac0e18c9c3b5980269984c8c0a8ce18a13366e05b03e5eb5126447feac"}
Jul 08 23:07:39.545903 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.545881    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"2b60eaaa48f5550a1c55bde318a43bf1fc463138d3a546cb269af986fef47a09"}
Jul 08 23:07:39.547293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.547250    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdknf" event={"ID":"59a33c2b-9f6a-4084-868f-32636e1cf0a8","Type":"ContainerStarted","Data":"60b2dd8f0ee02688a3b3aa6a8090c63a76d37c1b5969859081cd754187e157d0"}
Jul 08 23:07:39.549055 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.549032    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26l87" event={"ID":"502afacd-acff-4caa-a736-9291f37d4ecb","Type":"ContainerStarted","Data":"4f49b71b5b3a265c1d1c0141ffeaa2d1e8fc13e5fc429a20b6124970908a5ec2"}
Jul 08 23:07:39.550544 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.550507    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal" event={"ID":"8abdfaf585e604c9dab6fd72802a3597","Type":"ContainerStarted","Data":"47c80d2fd34082e54cecc20e79f7861be8bade5a6eff97a22356a1a079b0f724"}
Jul 08 23:07:39.559177 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.559148    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:39.559302 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:39.559285    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 23:07:39.559376 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:39.559307    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 23:07:39.559376 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:39.559316    2586 projected.go:196] Error preparing data for projected volume kube-api-access-vp9ml for pod openshift-network-diagnostics/network-check-target-w4r4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:39.559376 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:39.559358    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml podName:8bc912f9-8d92-405e-9314-ea3b8050ab7d nodeName:}" failed. No retries permitted until 2026-07-08 23:07:40.559344752 +0000 UTC m=+4.108404327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp9ml" (UniqueName: "kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml") pod "network-check-target-w4r4g" (UID: "8bc912f9-8d92-405e-9314-ea3b8050ab7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:39.882216 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.882117    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 23:02:38 +0000 UTC" deadline="2028-02-10 20:23:32.635423313 +0000 UTC"
Jul 08 23:07:39.882216 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:39.882169    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13965h15m52.753256696s"
Jul 08 23:07:40.467578 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:40.466784    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:40.467578 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:40.466921    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:40.467578 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.467046    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:40.467578 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.467119    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:42.467098288 +0000 UTC m=+6.016157861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:40.467578 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.467046    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:40.467578 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.467474    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret podName:b09f1d67-537f-4e5d-889e-6a5164aadf32 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:42.467458111 +0000 UTC m=+6.016517684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret") pod "global-pull-secret-syncer-p6sv7" (UID: "b09f1d67-537f-4e5d-889e-6a5164aadf32") : object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:40.528724 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:40.527907    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:40.528724 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.528041    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:40.528724 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:40.528456    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:40.528724 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.528554    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:40.528724 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:40.528617    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:40.528724 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.528687    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:40.567587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:40.567557    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:40.567753 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.567729    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 23:07:40.567753 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.567753    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 23:07:40.567854 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.567766    2586 projected.go:196] Error preparing data for projected volume kube-api-access-vp9ml for pod openshift-network-diagnostics/network-check-target-w4r4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:40.567854 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:40.567824    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml podName:8bc912f9-8d92-405e-9314-ea3b8050ab7d nodeName:}" failed. No retries permitted until 2026-07-08 23:07:42.567803303 +0000 UTC m=+6.116862899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp9ml" (UniqueName: "kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml") pod "network-check-target-w4r4g" (UID: "8bc912f9-8d92-405e-9314-ea3b8050ab7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:40.882528 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:40.882415    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 23:02:38 +0000 UTC" deadline="2027-12-28 03:01:49.712880561 +0000 UTC"
Jul 08 23:07:40.882528 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:40.882461    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12891h54m8.830424215s"
Jul 08 23:07:42.485664 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:42.484954    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:42.485664 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:42.485035    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:42.485664 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.485170    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:42.485664 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.485228    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:46.485210991 +0000 UTC m=+10.034270563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:42.485664 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.485290    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:42.485664 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.485324    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret podName:b09f1d67-537f-4e5d-889e-6a5164aadf32 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:46.485312901 +0000 UTC m=+10.034372477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret") pod "global-pull-secret-syncer-p6sv7" (UID: "b09f1d67-537f-4e5d-889e-6a5164aadf32") : object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:42.527722 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:42.527683    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:42.527869 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.527810    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:42.528160 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:42.528142    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:42.528259 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.528239    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:42.528326 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:42.528292    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:42.528387 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.528371    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:42.586183 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:42.586151    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:42.586354 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.586324    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 23:07:42.586426 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.586341    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 23:07:42.586426 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.586375    2586 projected.go:196] Error preparing data for projected volume kube-api-access-vp9ml for pod openshift-network-diagnostics/network-check-target-w4r4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:42.586553 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:42.586427    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml podName:8bc912f9-8d92-405e-9314-ea3b8050ab7d nodeName:}" failed. No retries permitted until 2026-07-08 23:07:46.586408443 +0000 UTC m=+10.135468031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp9ml" (UniqueName: "kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml") pod "network-check-target-w4r4g" (UID: "8bc912f9-8d92-405e-9314-ea3b8050ab7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:44.528653 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:44.527842    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:44.528653 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:44.527989    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:44.528653 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:44.528359    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:44.528653 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:44.528458    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:44.528653 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:44.528512    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:44.528653 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:44.528620    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:46.520656 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:46.520621    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:46.521090 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:46.520683    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:46.521090 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.520837    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:46.521090 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.520895    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret podName:b09f1d67-537f-4e5d-889e-6a5164aadf32 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:54.520876455 +0000 UTC m=+18.069936034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret") pod "global-pull-secret-syncer-p6sv7" (UID: "b09f1d67-537f-4e5d-889e-6a5164aadf32") : object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:46.521293 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.521273    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:46.521355 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.521331    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:54.521315463 +0000 UTC m=+18.070375046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:46.528058 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:46.527652    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:46.528058 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.527759    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:46.528058 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:46.527814    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:46.528058 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.527879    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:46.528058 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:46.527922    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:46.528058 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.527997    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:46.621588 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:46.621326    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:46.621588 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.621552    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 23:07:46.621588 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.621572    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 23:07:46.621588 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.621585    2586 projected.go:196] Error preparing data for projected volume kube-api-access-vp9ml for pod openshift-network-diagnostics/network-check-target-w4r4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:46.621952 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:46.621639    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml podName:8bc912f9-8d92-405e-9314-ea3b8050ab7d nodeName:}" failed. No retries permitted until 2026-07-08 23:07:54.621622275 +0000 UTC m=+18.170681860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp9ml" (UniqueName: "kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml") pod "network-check-target-w4r4g" (UID: "8bc912f9-8d92-405e-9314-ea3b8050ab7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:48.528079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:48.527819    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:48.528537 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:48.527891    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:48.528537 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:48.528180    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:48.528537 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:48.528263    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:48.528537 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:48.527894    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:48.528537 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:48.528367    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:50.527608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:50.527575    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:50.528035 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:50.527628    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:50.528035 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:50.527575    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:50.528035 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:50.527692    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:50.528035 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:50.527808    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:50.528035 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:50.527919    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:52.527843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:52.527806    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:52.528258 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:52.527806    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:52.528258 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:52.527918    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:52.528258 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:52.527806    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:52.528258 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:52.527989    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:52.528258 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:52.528069    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:54.527438 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:54.527404    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:54.527438 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:54.527438    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:54.527981 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:54.527456    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:54.527981 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.527548    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:54.527981 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.527594    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:54.527981 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.527664    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:54.582711 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:54.582670    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:54.582898 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:54.582727    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:54.582898 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.582797    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:54.582898 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.582823    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:54.582898 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.582858    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:08:10.582843058 +0000 UTC m=+34.131902628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:07:54.582898 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.582873    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret podName:b09f1d67-537f-4e5d-889e-6a5164aadf32 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:10.582866633 +0000 UTC m=+34.131926203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret") pod "global-pull-secret-syncer-p6sv7" (UID: "b09f1d67-537f-4e5d-889e-6a5164aadf32") : object "kube-system"/"original-pull-secret" not registered
Jul 08 23:07:54.683795 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:54.683755    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:54.684039 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.683946    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 23:07:54.684039 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.683974    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 23:07:54.684039 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.683988    2586 projected.go:196] Error preparing data for projected volume kube-api-access-vp9ml for pod openshift-network-diagnostics/network-check-target-w4r4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:54.684203 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:54.684045    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml podName:8bc912f9-8d92-405e-9314-ea3b8050ab7d nodeName:}" failed. No retries permitted until 2026-07-08 23:08:10.684028921 +0000 UTC m=+34.233088495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp9ml" (UniqueName: "kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml") pod "network-check-target-w4r4g" (UID: "8bc912f9-8d92-405e-9314-ea3b8050ab7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:07:56.527274 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:56.527235    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:56.527750 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:56.527247    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:56.527750 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:56.527363    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:56.527750 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:56.527248    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:56.527750 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:56.527425    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:56.527750 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:56.527497    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:58.527385 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.527252    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:07:58.528000 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.527258    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:07:58.528000 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:58.527483    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:07:58.528000 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:58.527562    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:07:58.528000 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.527329    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:07:58.528000 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:07:58.527647    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:07:58.603604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.603158    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal" event={"ID":"9d1aa91a25fa6212282656141f669b7b","Type":"ContainerStarted","Data":"851de66fee802e3cf3a209e721ee3e20c96a517dc2e1a6af9960e8fa5609279f"}
Jul 08 23:07:58.610116 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.610090    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:07:58.613613 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.613585    2586 generic.go:356] "Generic (PLEG): container finished" podID="06e98e17-863d-4dec-b390-1dcd328b465b" containerID="f947584c4678c00b937e9e6b113a70bbe5bbff3e9b21d0367d68020696dfe80e" exitCode=1
Jul 08 23:07:58.613722 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.613669    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"87d74931f2af4559fe0cc4dffe941bd50ec53847966746c42f85c6331f57f223"}
Jul 08 23:07:58.613777 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.613749    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"d96dff4ba08789fe724b62e79e8df953ef8f7acb1e2484665339d656009ce0b0"}
Jul 08 23:07:58.613832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.613804    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerDied","Data":"f947584c4678c00b937e9e6b113a70bbe5bbff3e9b21d0367d68020696dfe80e"}
Jul 08 23:07:58.613872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.613847    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"76ce3257f1fcac660844c61d6da86c1553b8ffe3ca1d24f6859b199a11ca7726"}
Jul 08 23:07:58.615601 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.615569    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdknf" event={"ID":"59a33c2b-9f6a-4084-868f-32636e1cf0a8","Type":"ContainerStarted","Data":"03367a37e1e09ae9d91aecacb5668f72df64123c2df6e0410f2f4bbd85dac185"}
Jul 08 23:07:58.617460 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.617409    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-15.ec2.internal" podStartSLOduration=20.617392925 podStartE2EDuration="20.617392925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:58.61706494 +0000 UTC m=+22.166124533" watchObservedRunningTime="2026-07-08 23:07:58.617392925 +0000 UTC m=+22.166452518"
Jul 08 23:07:58.618277 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.618249    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26l87" event={"ID":"502afacd-acff-4caa-a736-9291f37d4ecb","Type":"ContainerStarted","Data":"64a169692c204ee44f62c258b2d908482925676fd60b34a85ccc31f1cccf3903"}
Jul 08 23:07:58.633026 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:58.632982    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gdknf" podStartSLOduration=2.354046717 podStartE2EDuration="21.632968614s" totalImagesPullingTime="19.278921897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:58.632457313 +0000 UTC m=+22.181516933" watchObservedRunningTime="2026-07-08 23:07:58.632968614 +0000 UTC m=+22.182028211"
Jul 08 23:07:59.621356 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.621112    2586 generic.go:356] "Generic (PLEG): container finished" podID="8abdfaf585e604c9dab6fd72802a3597" containerID="fcf0531fcb09847bbfc0842daf96469dacba895b1f224a956d68df1663b649ef" exitCode=0
Jul 08 23:07:59.621356 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.621185    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal" event={"ID":"8abdfaf585e604c9dab6fd72802a3597","Type":"ContainerDied","Data":"fcf0531fcb09847bbfc0842daf96469dacba895b1f224a956d68df1663b649ef"}
Jul 08 23:07:59.622942 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.622921    2586 generic.go:356] "Generic (PLEG): container finished" podID="681c6287-4fea-4dd1-90bc-cdb82b6a2591" containerID="a885efc9aa4cb740d767e2e89c656cecd610d41d4afd91f28d0e24ce1b030d6e" exitCode=0
Jul 08 23:07:59.623046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.622987    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" event={"ID":"681c6287-4fea-4dd1-90bc-cdb82b6a2591","Type":"ContainerDied","Data":"a885efc9aa4cb740d767e2e89c656cecd610d41d4afd91f28d0e24ce1b030d6e"}
Jul 08 23:07:59.624356 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.624227    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sm9fr" event={"ID":"4b7f3241-2369-452d-be9d-b62f0c496956","Type":"ContainerStarted","Data":"c823535c5dab8407b2e01ad5e101cd8f432f258275ee0d33d34a024d5ef550b5"}
Jul 08 23:07:59.625621 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.625604    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs" event={"ID":"fca408d9-ffeb-433e-bb52-eb2e3748a37a","Type":"ContainerStarted","Data":"bd9c225d31eb337eac589450013318d441766007af3f9854e57910f4bc0073f7"}
Jul 08 23:07:59.626913 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.626893    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cw9wl" event={"ID":"0cb739af-dcea-41ee-af74-e07c4b2c016b","Type":"ContainerStarted","Data":"60f84dc9cca7d4b28476e780ae8e4790736328843e09aa393b01cc1d0a962f14"}
Jul 08 23:07:59.628178 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.628156    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xpv5b" event={"ID":"296b201e-5790-46a7-be74-3d1e14013c81","Type":"ContainerStarted","Data":"585fd10ef9c56d11fb851511de5be74a347f0def143cf162d23ac10fa0901295"}
Jul 08 23:07:59.629489 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.629465    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d2kh5" event={"ID":"bd51c369-2f70-4c75-841c-9d7e762a70b4","Type":"ContainerStarted","Data":"9a20e07544097466e4b0fef312cf9a243f564079d965687ee06f4489563f25bc"}
Jul 08 23:07:59.631913 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.631898    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:07:59.632301 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.632287    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"8f964139a703bc6c897c9539785745fb9e1b84a48147cee77b05c6686e12ed12"}
Jul 08 23:07:59.632407 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.632393    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"292c314fd63ed7eb2626795dc55ee76c8b3f55cbff9fd9e3a1e9e16f8893f5f7"}
Jul 08 23:07:59.636073 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.636036    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26l87" podStartSLOduration=3.724920731 podStartE2EDuration="22.63602167s" totalImagesPullingTime="18.911100939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:58.649447229 +0000 UTC m=+22.198506897" watchObservedRunningTime="2026-07-08 23:07:59.63602167 +0000 UTC m=+23.185081253"
Jul 08 23:07:59.649891 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.649859    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sm9fr" podStartSLOduration=3.7822781770000002 podStartE2EDuration="22.649847976s" totalImagesPullingTime="18.867569799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:59.649731699 +0000 UTC m=+23.198791302" watchObservedRunningTime="2026-07-08 23:07:59.649847976 +0000 UTC m=+23.198907567"
Jul 08 23:07:59.695178 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.695141    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d2kh5" podStartSLOduration=8.029395387 podStartE2EDuration="22.695128047s" totalImagesPullingTime="14.66573266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:59.694982913 +0000 UTC m=+23.244042516" watchObservedRunningTime="2026-07-08 23:07:59.695128047 +0000 UTC m=+23.244187639"
Jul 08 23:07:59.708722 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.708663    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xpv5b" podStartSLOduration=3.817148315 podStartE2EDuration="22.708651528s" totalImagesPullingTime="18.891503213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:59.708557534 +0000 UTC m=+23.257617126" watchObservedRunningTime="2026-07-08 23:07:59.708651528 +0000 UTC m=+23.257711122"
Jul 08 23:07:59.728448 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:07:59.728394    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cw9wl" podStartSLOduration=4.259641225 podStartE2EDuration="22.728380202s" totalImagesPullingTime="18.468738977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:59.727934323 +0000 UTC m=+23.276993918" watchObservedRunningTime="2026-07-08 23:07:59.728380202 +0000 UTC m=+23.277439793"
Jul 08 23:08:00.017576 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.017547    2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 23:08:00.218909 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.218755    2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T23:08:00.017570967Z","UUID":"2b443192-d6fe-4dc0-ad83-601b372015dd","Handler":null,"Name":"","Endpoint":""}
Jul 08 23:08:00.220266 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.220247    2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 23:08:00.220367 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.220279    2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 23:08:00.527139 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.527061    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:00.527139 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.527088    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:00.527139 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.527088    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:00.527375 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:00.527225    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:08:00.527375 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:00.527330    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:08:00.527484 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:00.527398    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:08:00.636509 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.636474    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal" event={"ID":"8abdfaf585e604c9dab6fd72802a3597","Type":"ContainerStarted","Data":"310e2d15edf75fcbe14a789e4466c8e615dd0ca195e2e00b7c292a331364ae8d"}
Jul 08 23:08:00.638794 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.638763    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs" event={"ID":"fca408d9-ffeb-433e-bb52-eb2e3748a37a","Type":"ContainerStarted","Data":"355a0184d38a8233a195700a714083776cb5774fbe306fc61fea4848486c8f0b"}
Jul 08 23:08:00.651321 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:00.651279    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-15.ec2.internal" podStartSLOduration=22.651260287 podStartE2EDuration="22.651260287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:00.650879593 +0000 UTC m=+24.199939187" watchObservedRunningTime="2026-07-08 23:08:00.651260287 +0000 UTC m=+24.200319880"
Jul 08 23:08:01.644689 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:01.644613    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:08:01.645124 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:01.645097    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"bb136706eddbb4c7fabd49b0ad98dae9baebdf0f83f69b41ec6837900154deb5"}
Jul 08 23:08:01.647564 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:01.647511    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs" event={"ID":"fca408d9-ffeb-433e-bb52-eb2e3748a37a","Type":"ContainerStarted","Data":"e915e87b422766e6884953b58a24c8547520d04f3cd5e39f200662b422c5cbcb"}
Jul 08 23:08:01.665840 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:01.665795    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r27cs" podStartSLOduration=3.761911595 podStartE2EDuration="24.665781356s" totalImagesPullingTime="20.903869761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:01.665274913 +0000 UTC m=+25.214334519" watchObservedRunningTime="2026-07-08 23:08:01.665781356 +0000 UTC m=+25.214840944"
Jul 08 23:08:02.483743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:02.483707    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:08:02.484323 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:02.484303    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:08:02.526846 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:02.526821    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:02.526960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:02.526917    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:02.526960 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:02.526919    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:08:02.526960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:02.526941    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:02.527112 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:02.527001    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:08:02.527112 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:02.527070    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:08:02.650305 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:02.650272    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:08:02.650748 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:02.650733    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cw9wl"
Jul 08 23:08:04.527866 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:04.527594    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:04.527866 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:04.527594    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:04.527866 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:04.527834    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:08:04.527866 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:04.527627    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:04.528357 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:04.527874    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:08:04.528357 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:04.527942    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:08:04.657066 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:04.657040    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:08:04.657488 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:04.657463    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"06091735b1286f6fdb6e249c918a4a1be79133330b0bcdd49c1342c4dc90abc7"}
Jul 08 23:08:04.657705 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:04.657684    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:08:04.657934 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:04.657919    2586 scope.go:117] "RemoveContainer" containerID="f947584c4678c00b937e9e6b113a70bbe5bbff3e9b21d0367d68020696dfe80e"
Jul 08 23:08:04.671712 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:04.671692    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:08:05.663076 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:05.662898    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:08:05.663581 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:05.663406    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" event={"ID":"06e98e17-863d-4dec-b390-1dcd328b465b","Type":"ContainerStarted","Data":"98825cc49b8cb8172ccb7d1045d7ac309ddb1699aabe09e466661a1d0f49be14"}
Jul 08 23:08:05.663581 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:05.663486    2586 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 23:08:05.663689 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:05.663631    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:08:05.665248 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:05.665222    2586 generic.go:356] "Generic (PLEG): container finished" podID="681c6287-4fea-4dd1-90bc-cdb82b6a2591" containerID="4a0044a8b5a7cb7d4686128e94aabc5785b7a17e9d5c73b1013e6d5f1529fc05" exitCode=0
Jul 08 23:08:05.665365 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:05.665262    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" event={"ID":"681c6287-4fea-4dd1-90bc-cdb82b6a2591","Type":"ContainerDied","Data":"4a0044a8b5a7cb7d4686128e94aabc5785b7a17e9d5c73b1013e6d5f1529fc05"}
Jul 08 23:08:05.678938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:05.678919    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:08:05.689323 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:05.689288    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9" podStartSLOduration=9.790432327 podStartE2EDuration="28.68927641s" totalImagesPullingTime="18.898844083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:05.68873399 +0000 UTC m=+29.237793582" watchObservedRunningTime="2026-07-08 23:08:05.68927641 +0000 UTC m=+29.238336001"
Jul 08 23:08:06.527006 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.526971    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:06.527182 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.527095    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:06.527182 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.527103    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:06.527182 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:06.527100    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:08:06.527343 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:06.527196    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:08:06.527343 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:06.527293    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:08:06.540186 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.540161    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w4r4g"]
Jul 08 23:08:06.543595 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.543513    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txmkb"]
Jul 08 23:08:06.544208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.544186    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p6sv7"]
Jul 08 23:08:06.667471 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.667399    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:06.667955 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.667470    2586 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 23:08:06.667955 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.667399    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:06.667955 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:06.667498    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:08:06.667955 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:06.667401    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:06.668142 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:06.667975    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:08:06.668142 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:06.668029    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:08:07.672381 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:07.672351    2586 generic.go:356] "Generic (PLEG): container finished" podID="681c6287-4fea-4dd1-90bc-cdb82b6a2591" containerID="10dfadee1b8f001eddf6fcd74ff0cb87d136b14c2815935e0c82137e6ca83f89" exitCode=0
Jul 08 23:08:07.672771 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:07.672448    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" event={"ID":"681c6287-4fea-4dd1-90bc-cdb82b6a2591","Type":"ContainerDied","Data":"10dfadee1b8f001eddf6fcd74ff0cb87d136b14c2815935e0c82137e6ca83f89"}
Jul 08 23:08:07.672771 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:07.672535    2586 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 23:08:08.199867 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:08.199827    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:08:08.527433 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:08.527365    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:08.527583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:08.527462    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:08.527583 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:08.527468    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:08:08.527583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:08.527487    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:08.527583 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:08.527572    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:08:08.527735 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:08.527637    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:08:09.679507 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:09.679330    2586 generic.go:356] "Generic (PLEG): container finished" podID="681c6287-4fea-4dd1-90bc-cdb82b6a2591" containerID="1d2ba038c3f6ca385f87ffd756f189593472f8a561d12397364c5403ad529f41" exitCode=0
Jul 08 23:08:09.679872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:09.679402    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" event={"ID":"681c6287-4fea-4dd1-90bc-cdb82b6a2591","Type":"ContainerDied","Data":"1d2ba038c3f6ca385f87ffd756f189593472f8a561d12397364c5403ad529f41"}
Jul 08 23:08:10.527659 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:10.527625    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:10.527659 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:10.527630    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:10.528046 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.527762    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:08:10.528046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:10.527630    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:10.528046 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.527874    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6sv7" podUID="b09f1d67-537f-4e5d-889e-6a5164aadf32"
Jul 08 23:08:10.528046 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.527897    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4r4g" podUID="8bc912f9-8d92-405e-9314-ea3b8050ab7d"
Jul 08 23:08:10.601396 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:10.601369    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:10.601558 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:10.601423    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:10.601558 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.601511    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:08:10.601558 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.601513    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 23:08:10.601674 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.601573    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:08:42.601559958 +0000 UTC m=+66.150619528 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 23:08:10.601674 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.601586    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret podName:b09f1d67-537f-4e5d-889e-6a5164aadf32 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:42.601580569 +0000 UTC m=+66.150640139 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret") pod "global-pull-secret-syncer-p6sv7" (UID: "b09f1d67-537f-4e5d-889e-6a5164aadf32") : object "kube-system"/"original-pull-secret" not registered
Jul 08 23:08:10.702495 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:10.702467    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:10.702947 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.702598    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 23:08:10.702947 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.702617    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 23:08:10.702947 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.702626    2586 projected.go:196] Error preparing data for projected volume kube-api-access-vp9ml for pod openshift-network-diagnostics/network-check-target-w4r4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:08:10.702947 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:10.702682    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml podName:8bc912f9-8d92-405e-9314-ea3b8050ab7d nodeName:}" failed. No retries permitted until 2026-07-08 23:08:42.702662826 +0000 UTC m=+66.251722396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vp9ml" (UniqueName: "kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml") pod "network-check-target-w4r4g" (UID: "8bc912f9-8d92-405e-9314-ea3b8050ab7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 23:08:11.254878 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.254806    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-15.ec2.internal" event="NodeReady"
Jul 08 23:08:11.255141 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.254933    2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 23:08:11.297610 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.297573    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gpfsz"]
Jul 08 23:08:11.319412 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.319376    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xcktj"]
Jul 08 23:08:11.319579 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.319502    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.322186 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.322163    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 23:08:11.322325 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.322212    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 23:08:11.322385 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.322166    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vhnmb\""
Jul 08 23:08:11.329607 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.329588    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xcktj"]
Jul 08 23:08:11.329712 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.329619    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gpfsz"]
Jul 08 23:08:11.329804 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.329708    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xcktj"
Jul 08 23:08:11.332175 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.332161    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 23:08:11.332270 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.332174    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 23:08:11.332270 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.332201    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 23:08:11.332376 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.332316    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mtwjf\""
Jul 08 23:08:11.407688 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.407660    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btnlq\" (UniqueName: \"kubernetes.io/projected/0972dfb7-4183-42cb-b206-f64251b15d45-kube-api-access-btnlq\") pod \"ingress-canary-xcktj\" (UID: \"0972dfb7-4183-42cb-b206-f64251b15d45\") " pod="openshift-ingress-canary/ingress-canary-xcktj"
Jul 08 23:08:11.407836 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.407694    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0972dfb7-4183-42cb-b206-f64251b15d45-cert\") pod \"ingress-canary-xcktj\" (UID: \"0972dfb7-4183-42cb-b206-f64251b15d45\") " pod="openshift-ingress-canary/ingress-canary-xcktj"
Jul 08 23:08:11.407836 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.407725    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db460404-b805-4b07-b594-e85ba66ea2e2-tmp-dir\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.407836 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.407783    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9txn\" (UniqueName: \"kubernetes.io/projected/db460404-b805-4b07-b594-e85ba66ea2e2-kube-api-access-t9txn\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.407836 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.407810    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.407962 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.407862    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db460404-b805-4b07-b594-e85ba66ea2e2-config-volume\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.509166 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.509098    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db460404-b805-4b07-b594-e85ba66ea2e2-tmp-dir\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.509166 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.509138    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9txn\" (UniqueName: \"kubernetes.io/projected/db460404-b805-4b07-b594-e85ba66ea2e2-kube-api-access-t9txn\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.509395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.509174    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.509395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.509219    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db460404-b805-4b07-b594-e85ba66ea2e2-config-volume\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.509395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.509263    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btnlq\" (UniqueName: \"kubernetes.io/projected/0972dfb7-4183-42cb-b206-f64251b15d45-kube-api-access-btnlq\") pod \"ingress-canary-xcktj\" (UID: \"0972dfb7-4183-42cb-b206-f64251b15d45\") " pod="openshift-ingress-canary/ingress-canary-xcktj"
Jul 08 23:08:11.509395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.509292    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0972dfb7-4183-42cb-b206-f64251b15d45-cert\") pod \"ingress-canary-xcktj\" (UID: \"0972dfb7-4183-42cb-b206-f64251b15d45\") " pod="openshift-ingress-canary/ingress-canary-xcktj"
Jul 08 23:08:11.509609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.509457    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db460404-b805-4b07-b594-e85ba66ea2e2-tmp-dir\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.509609 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:11.509538    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:08:11.509609 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:11.509608    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:12.009586863 +0000 UTC m=+35.558646447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:08:11.510057 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.510030    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db460404-b805-4b07-b594-e85ba66ea2e2-config-volume\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.513407 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.513387    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0972dfb7-4183-42cb-b206-f64251b15d45-cert\") pod \"ingress-canary-xcktj\" (UID: \"0972dfb7-4183-42cb-b206-f64251b15d45\") " pod="openshift-ingress-canary/ingress-canary-xcktj"
Jul 08 23:08:11.518054 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.518030    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9txn\" (UniqueName: \"kubernetes.io/projected/db460404-b805-4b07-b594-e85ba66ea2e2-kube-api-access-t9txn\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:11.518278 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.518262    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btnlq\" (UniqueName: \"kubernetes.io/projected/0972dfb7-4183-42cb-b206-f64251b15d45-kube-api-access-btnlq\") pod \"ingress-canary-xcktj\" (UID: \"0972dfb7-4183-42cb-b206-f64251b15d45\") " pod="openshift-ingress-canary/ingress-canary-xcktj"
Jul 08 23:08:11.639236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.639208    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xcktj"
Jul 08 23:08:11.826138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:11.826113    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xcktj"]
Jul 08 23:08:11.830067 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:08:11.829906    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0972dfb7_4183_42cb_b206_f64251b15d45.slice/crio-d37e7761fb84bc9aee437a50ca29f0ff80dfe761a1d8784adae35fd76e262b02 WatchSource:0}: Error finding container d37e7761fb84bc9aee437a50ca29f0ff80dfe761a1d8784adae35fd76e262b02: Status 404 returned error can't find the container with id d37e7761fb84bc9aee437a50ca29f0ff80dfe761a1d8784adae35fd76e262b02
Jul 08 23:08:12.011970 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.011930    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:12.012138 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:12.012100    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:08:12.012199 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:12.012169    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:13.012150489 +0000 UTC m=+36.561210063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:08:12.526870 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.526831    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:12.527028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.526873    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:12.527028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.526948    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:12.530098 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.530001    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 23:08:12.530098 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.530010    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 23:08:12.530098 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.530010    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 23:08:12.530098 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.530010    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 23:08:12.531404 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.531383    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dwbh8\""
Jul 08 23:08:12.531515 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.531431    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2g9tf\""
Jul 08 23:08:12.686959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:12.686915    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xcktj" event={"ID":"0972dfb7-4183-42cb-b206-f64251b15d45","Type":"ContainerStarted","Data":"d37e7761fb84bc9aee437a50ca29f0ff80dfe761a1d8784adae35fd76e262b02"}
Jul 08 23:08:13.020012 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:13.019914    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:13.020458 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:13.020086    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:08:13.020458 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:13.020172    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:15.020149046 +0000 UTC m=+38.569208632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:08:15.036890 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:15.036854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:15.037326 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:15.037027    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:08:15.037326 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:15.037090    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:19.037072782 +0000 UTC m=+42.586132352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:08:16.698170 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:16.698139    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xcktj" event={"ID":"0972dfb7-4183-42cb-b206-f64251b15d45","Type":"ContainerStarted","Data":"7cb3adf7b5f57bf8620f0ef0e771fc8e57ed3b505bcd70bd5ebe5ed7895e451a"}
Jul 08 23:08:16.700819 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:16.700794    2586 generic.go:356] "Generic (PLEG): container finished" podID="681c6287-4fea-4dd1-90bc-cdb82b6a2591" containerID="ed79fdf9eab5aa7df916468a0c7ad60c9a06495ff67e322ff8476dcc6e78184f" exitCode=0
Jul 08 23:08:16.700919 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:16.700845    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" event={"ID":"681c6287-4fea-4dd1-90bc-cdb82b6a2591","Type":"ContainerDied","Data":"ed79fdf9eab5aa7df916468a0c7ad60c9a06495ff67e322ff8476dcc6e78184f"}
Jul 08 23:08:16.721273 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:16.721229    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xcktj" podStartSLOduration=1.622396335 podStartE2EDuration="5.721215438s" totalImagesPullingTime="4.098819103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:16.720975638 +0000 UTC m=+40.270035244" watchObservedRunningTime="2026-07-08 23:08:16.721215438 +0000 UTC m=+40.270275029"
Jul 08 23:08:17.706400 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:17.706363    2586 generic.go:356] "Generic (PLEG): container finished" podID="681c6287-4fea-4dd1-90bc-cdb82b6a2591" containerID="8ee4fc7104c5467fe7916eaf9133b573babc6ffb955bfea4cdea478784b3a8c2" exitCode=0
Jul 08 23:08:17.706917 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:17.706447    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" event={"ID":"681c6287-4fea-4dd1-90bc-cdb82b6a2591","Type":"ContainerDied","Data":"8ee4fc7104c5467fe7916eaf9133b573babc6ffb955bfea4cdea478784b3a8c2"}
Jul 08 23:08:18.711417 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:18.711381    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" event={"ID":"681c6287-4fea-4dd1-90bc-cdb82b6a2591","Type":"ContainerStarted","Data":"6ad68b3ec66064258a2025a53e5310cae932dc18365215c76adee1658e904176"}
Jul 08 23:08:18.734279 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:18.734232    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vl9rq" podStartSLOduration=9.198601146 podStartE2EDuration="41.734217376s" totalImagesPullingTime="32.53561623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:18.732300929 +0000 UTC m=+42.281360521" watchObservedRunningTime="2026-07-08 23:08:18.734217376 +0000 UTC m=+42.283276968"
Jul 08 23:08:19.066395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:19.066324    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:19.066552 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:19.066462    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:08:19.066552 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:19.066531    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:27.066501894 +0000 UTC m=+50.615561465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:08:27.122088 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:27.122039    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:27.122628 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:27.122222    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:08:27.122628 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:27.122303    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:43.122283041 +0000 UTC m=+66.671342610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:08:34.104089 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.104053    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"]
Jul 08 23:08:34.107442 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.107420    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"
Jul 08 23:08:34.110223 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.110195    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 23:08:34.110322 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.110225    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 23:08:34.111675 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.111659    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 23:08:34.111771 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.111702    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sxsdl\""
Jul 08 23:08:34.111771 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.111736    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 23:08:34.119332 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.119313    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"]
Jul 08 23:08:34.171237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.171210    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8r88\" (UniqueName: \"kubernetes.io/projected/b8c9168b-f630-46b1-9c76-095b2d874091-kube-api-access-l8r88\") pod \"managed-serviceaccount-addon-agent-f9b89dc8-xq5sg\" (UID: \"b8c9168b-f630-46b1-9c76-095b2d874091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"
Jul 08 23:08:34.171328 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.171268    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8c9168b-f630-46b1-9c76-095b2d874091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f9b89dc8-xq5sg\" (UID: \"b8c9168b-f630-46b1-9c76-095b2d874091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"
Jul 08 23:08:34.271574 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.271552    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8c9168b-f630-46b1-9c76-095b2d874091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f9b89dc8-xq5sg\" (UID: \"b8c9168b-f630-46b1-9c76-095b2d874091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"
Jul 08 23:08:34.271682 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.271618    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8r88\" (UniqueName: \"kubernetes.io/projected/b8c9168b-f630-46b1-9c76-095b2d874091-kube-api-access-l8r88\") pod \"managed-serviceaccount-addon-agent-f9b89dc8-xq5sg\" (UID: \"b8c9168b-f630-46b1-9c76-095b2d874091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"
Jul 08 23:08:34.275322 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.275297    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8c9168b-f630-46b1-9c76-095b2d874091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f9b89dc8-xq5sg\" (UID: \"b8c9168b-f630-46b1-9c76-095b2d874091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"
Jul 08 23:08:34.279841 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.279821    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8r88\" (UniqueName: \"kubernetes.io/projected/b8c9168b-f630-46b1-9c76-095b2d874091-kube-api-access-l8r88\") pod \"managed-serviceaccount-addon-agent-f9b89dc8-xq5sg\" (UID: \"b8c9168b-f630-46b1-9c76-095b2d874091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"
Jul 08 23:08:34.424165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.424090    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"
Jul 08 23:08:34.540296 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.540266    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg"]
Jul 08 23:08:34.543172 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:08:34.543137    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8c9168b_f630_46b1_9c76_095b2d874091.slice/crio-4a9ee3eb8e0ddef0373f02bfa6f25766d3decb89ef07dd6b41190b98666d3ed3 WatchSource:0}: Error finding container 4a9ee3eb8e0ddef0373f02bfa6f25766d3decb89ef07dd6b41190b98666d3ed3: Status 404 returned error can't find the container with id 4a9ee3eb8e0ddef0373f02bfa6f25766d3decb89ef07dd6b41190b98666d3ed3
Jul 08 23:08:34.750308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:34.750226    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg" event={"ID":"b8c9168b-f630-46b1-9c76-095b2d874091","Type":"ContainerStarted","Data":"4a9ee3eb8e0ddef0373f02bfa6f25766d3decb89ef07dd6b41190b98666d3ed3"}
Jul 08 23:08:37.759646 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:37.759603    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg" event={"ID":"b8c9168b-f630-46b1-9c76-095b2d874091","Type":"ContainerStarted","Data":"2382c74e2643d6d834611fedf8193913de551142d2bac1e6f8418df923f9bffc"}
Jul 08 23:08:37.776938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:37.776845    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg" podStartSLOduration=0.793280108 podStartE2EDuration="3.77683106s" totalImagesPullingTime="2.983550952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:37.7762895 +0000 UTC m=+61.325349091" watchObservedRunningTime="2026-07-08 23:08:37.77683106 +0000 UTC m=+61.325890652"
Jul 08 23:08:38.685537 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:38.685499    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhdh9"
Jul 08 23:08:42.626561 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.626512    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:08:42.626966 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.626569    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:42.629165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.629148    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 23:08:42.629295 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.629276    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 23:08:42.637248 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:42.637230    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 23:08:42.637295 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:42.637289    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:09:46.637268297 +0000 UTC m=+130.186327870 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : secret "metrics-daemon-secret" not found
Jul 08 23:08:42.639353 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.639339    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b09f1d67-537f-4e5d-889e-6a5164aadf32-original-pull-secret\") pod \"global-pull-secret-syncer-p6sv7\" (UID: \"b09f1d67-537f-4e5d-889e-6a5164aadf32\") " pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:42.727171 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.727146    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:42.729663 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.729648    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 23:08:42.739546 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.739530    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 23:08:42.750455 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.750428    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp9ml\" (UniqueName: \"kubernetes.io/projected/8bc912f9-8d92-405e-9314-ea3b8050ab7d-kube-api-access-vp9ml\") pod \"network-check-target-w4r4g\" (UID: \"8bc912f9-8d92-405e-9314-ea3b8050ab7d\") " pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:42.843936 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.843914    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2g9tf\""
Jul 08 23:08:42.851880 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.851861    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:42.857149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.857132    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6sv7"
Jul 08 23:08:42.998960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:42.998924    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w4r4g"]
Jul 08 23:08:43.002017 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:08:43.001984    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc912f9_8d92_405e_9314_ea3b8050ab7d.slice/crio-d92f937229cee12f30e050f72fcbd941a529ba86c6fef0c5f6d0e13d98b05ecb WatchSource:0}: Error finding container d92f937229cee12f30e050f72fcbd941a529ba86c6fef0c5f6d0e13d98b05ecb: Status 404 returned error can't find the container with id d92f937229cee12f30e050f72fcbd941a529ba86c6fef0c5f6d0e13d98b05ecb
Jul 08 23:08:43.014048 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:43.014023    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p6sv7"]
Jul 08 23:08:43.017353 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:08:43.017332    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09f1d67_537f_4e5d_889e_6a5164aadf32.slice/crio-4f97cea7de76f51b86ea839e57b387cd284652c64387e6958fa6c29873916d24 WatchSource:0}: Error finding container 4f97cea7de76f51b86ea839e57b387cd284652c64387e6958fa6c29873916d24: Status 404 returned error can't find the container with id 4f97cea7de76f51b86ea839e57b387cd284652c64387e6958fa6c29873916d24
Jul 08 23:08:43.130052 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:43.130017    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:08:43.130231 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:43.130185    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:08:43.130292 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:08:43.130260    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:09:15.130236794 +0000 UTC m=+98.679296375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:08:43.775241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:43.775172    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p6sv7" event={"ID":"b09f1d67-537f-4e5d-889e-6a5164aadf32","Type":"ContainerStarted","Data":"4f97cea7de76f51b86ea839e57b387cd284652c64387e6958fa6c29873916d24"}
Jul 08 23:08:43.776743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:43.776714    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w4r4g" event={"ID":"8bc912f9-8d92-405e-9314-ea3b8050ab7d","Type":"ContainerStarted","Data":"d92f937229cee12f30e050f72fcbd941a529ba86c6fef0c5f6d0e13d98b05ecb"}
Jul 08 23:08:47.794072 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:47.794037    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p6sv7" event={"ID":"b09f1d67-537f-4e5d-889e-6a5164aadf32","Type":"ContainerStarted","Data":"fca7db402c2da4dd055f63a1c6a089f3d285f8fbb0f297b2e749515cbd4f0f49"}
Jul 08 23:08:47.795570 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:47.795546    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w4r4g" event={"ID":"8bc912f9-8d92-405e-9314-ea3b8050ab7d","Type":"ContainerStarted","Data":"bd193483b8bc979520925f282202ea67809f9242d88e85bda3e459e711b4d400"}
Jul 08 23:08:47.795681 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:47.795668    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:08:47.809371 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:47.809291    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p6sv7" podStartSLOduration=66.263747967 podStartE2EDuration="1m10.809277621s" totalImagesPullingTime="4.545529654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:47.808212639 +0000 UTC m=+71.357272406" watchObservedRunningTime="2026-07-08 23:08:47.809277621 +0000 UTC m=+71.358337250"
Jul 08 23:08:47.822477 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:08:47.822438    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w4r4g" podStartSLOduration=66.266160526 podStartE2EDuration="1m10.822428826s" totalImagesPullingTime="4.5562683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:47.821834056 +0000 UTC m=+71.370893657" watchObservedRunningTime="2026-07-08 23:08:47.822428826 +0000 UTC m=+71.371488418"
Jul 08 23:09:15.139894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:09:15.139763    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:09:15.139894 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:09:15.139887    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:09:15.140320 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:09:15.139945    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:10:19.139932286 +0000 UTC m=+162.688991857 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:09:18.800944 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:09:18.800914    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w4r4g"
Jul 08 23:09:46.651705 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:09:46.651649    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:09:46.652227 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:09:46.651794    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 23:09:46.652227 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:09:46.651861    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:11:48.651845838 +0000 UTC m=+252.200905407 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : secret "metrics-daemon-secret" not found
Jul 08 23:10:14.331248 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:10:14.331205    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gpfsz" podUID="db460404-b805-4b07-b594-e85ba66ea2e2"
Jul 08 23:10:14.996937 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:10:14.996911    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:10:15.550755 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:10:15.550725    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:10:19.169363 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:10:19.169310    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:10:19.169853 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:10:19.169456    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 23:10:19.169853 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:10:19.169550    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls podName:db460404-b805-4b07-b594-e85ba66ea2e2 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:21.169514528 +0000 UTC m=+284.718574099 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls") pod "dns-default-gpfsz" (UID: "db460404-b805-4b07-b594-e85ba66ea2e2") : secret "dns-default-metrics-tls" not found
Jul 08 23:10:26.527287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:10:26.527250    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:10:38.054651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:10:38.054542    2586 generic.go:356] "Generic (PLEG): container finished" podID="b8c9168b-f630-46b1-9c76-095b2d874091" containerID="2382c74e2643d6d834611fedf8193913de551142d2bac1e6f8418df923f9bffc" exitCode=255
Jul 08 23:10:38.054651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:10:38.054610    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg" event={"ID":"b8c9168b-f630-46b1-9c76-095b2d874091","Type":"ContainerDied","Data":"2382c74e2643d6d834611fedf8193913de551142d2bac1e6f8418df923f9bffc"}
Jul 08 23:10:38.059984 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:10:38.059965    2586 scope.go:117] "RemoveContainer" containerID="2382c74e2643d6d834611fedf8193913de551142d2bac1e6f8418df923f9bffc"
Jul 08 23:10:39.059946 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:10:39.059899    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f9b89dc8-xq5sg" event={"ID":"b8c9168b-f630-46b1-9c76-095b2d874091","Type":"ContainerStarted","Data":"049d44e9d1feb571da4889ccf6f46b3c7b95d6f37c767c771e3042c62185dcd5"}
Jul 08 23:11:48.663740 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:48.663704    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:11:48.664191 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:48.663860    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 23:11:48.664191 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:48.663924    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs podName:5d90721e-9094-4a91-a701-0cfcfdeebf1f nodeName:}" failed. No retries permitted until 2026-07-08 23:13:50.663908421 +0000 UTC m=+374.212967995 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs") pod "network-metrics-daemon-txmkb" (UID: "5d90721e-9094-4a91-a701-0cfcfdeebf1f") : secret "metrics-daemon-secret" not found
Jul 08 23:11:53.746703 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.746667    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn"]
Jul 08 23:11:53.749607 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.749582    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-tbn49"]
Jul 08 23:11:53.749764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.749725    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn"
Jul 08 23:11:53.752074 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.752055    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hmdh5"]
Jul 08 23:11:53.752199 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.752183    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.752452 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.752378    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9q9ss\""
Jul 08 23:11:53.754329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.754311    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 23:11:53.754432 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.754411    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 08 23:11:53.754651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.754635    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58fff4f6f5-rhps2"]
Jul 08 23:11:53.754824 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.754736    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.754824 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.754803    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sgjnh\""
Jul 08 23:11:53.754963 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.754858    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 23:11:53.755111 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.755078    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 08 23:11:53.757269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.757252    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.758020 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.758001    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 08 23:11:53.758099 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.758010    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 08 23:11:53.758165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.758102    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 08 23:11:53.758232 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.758214    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 08 23:11:53.758444 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.758427    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7dsf7\""
Jul 08 23:11:53.760438 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.760404    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 08 23:11:53.760438 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.760415    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mz6rh\""
Jul 08 23:11:53.760438 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.760428    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 23:11:53.760697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.760459    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 08 23:11:53.760697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.760577    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 23:11:53.760835 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.760726    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 08 23:11:53.760965 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.760950    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 08 23:11:53.766587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.766567    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn"]
Jul 08 23:11:53.767263 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.767247    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 08 23:11:53.771046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.769295    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 08 23:11:53.771046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.770860    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-tbn49"]
Jul 08 23:11:53.772514 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.772495    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58fff4f6f5-rhps2"]
Jul 08 23:11:53.779322 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.779303    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hmdh5"]
Jul 08 23:11:53.841612 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.841586    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx"]
Jul 08 23:11:53.844390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.844376    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx"
Jul 08 23:11:53.847028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.847009    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n27bd\""
Jul 08 23:11:53.847290 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.847272    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"]
Jul 08 23:11:53.847766 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.847750    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 08 23:11:53.848147 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.848130    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 08 23:11:53.849948 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.849927    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-748f69b746-gx7xh"]
Jul 08 23:11:53.850048 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.850034    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:53.852069 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.852053    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 08 23:11:53.852287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.852272    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 08 23:11:53.852365 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.852293    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 08 23:11:53.852471 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.852457    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 08 23:11:53.852753 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.852736    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-87d9l\""
Jul 08 23:11:53.852867 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.852807    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.854749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.854732    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx"]
Jul 08 23:11:53.855014 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.854994    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sq6cw\""
Jul 08 23:11:53.855300 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.855279    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 23:11:53.855389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.855310    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 23:11:53.855451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.855412    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 23:11:53.861801 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.861781    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"]
Jul 08 23:11:53.862382 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.862349    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 23:11:53.863570 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.863539    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-748f69b746-gx7xh"]
Jul 08 23:11:53.896948 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.896922    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwnwm\" (UniqueName: \"kubernetes.io/projected/3cbb5858-5c08-4167-b623-0227ff467fc0-kube-api-access-wwnwm\") pod \"network-check-source-989f8b8dc-dhvvn\" (UID: \"3cbb5858-5c08-4167-b623-0227ff467fc0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn"
Jul 08 23:11:53.896948 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.896950    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06f33d43-cab9-4703-8fe0-320176063683-tmp\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.896966    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn2dk\" (UniqueName: \"kubernetes.io/projected/06f33d43-cab9-4703-8fe0-320176063683-kube-api-access-dn2dk\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.896985    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-stats-auth\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897051    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/06f33d43-cab9-4703-8fe0-320176063683-snapshots\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897080    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897100    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f33d43-cab9-4703-8fe0-320176063683-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897116    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897132    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-config\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897188    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-default-certificate\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897208    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qfmz\" (UniqueName: \"kubernetes.io/projected/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-kube-api-access-2qfmz\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897225    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l5l8\" (UniqueName: \"kubernetes.io/projected/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-kube-api-access-4l5l8\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897238    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-serving-cert\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.897249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897253    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-trusted-ca\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.897648 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897269    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f33d43-cab9-4703-8fe0-320176063683-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.897648 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.897286    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06f33d43-cab9-4703-8fe0-320176063683-serving-cert\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.997923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.997834    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/06f33d43-cab9-4703-8fe0-320176063683-snapshots\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.997923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.997871    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-bound-sa-token\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.997923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.997892    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-image-registry-private-configuration\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.997923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.997919    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-default-certificate\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.998236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.997943    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mx5v\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-kube-api-access-6mx5v\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.998236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.997971    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06f33d43-cab9-4703-8fe0-320176063683-serving-cert\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.998236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998003    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ef29118-3f96-440b-bb5b-ab884e67b8bc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:53.998236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998043    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-certificates\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.998236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998109    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-installation-pull-secrets\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.998236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998147    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwnwm\" (UniqueName: \"kubernetes.io/projected/3cbb5858-5c08-4167-b623-0227ff467fc0-kube-api-access-wwnwm\") pod \"network-check-source-989f8b8dc-dhvvn\" (UID: \"3cbb5858-5c08-4167-b623-0227ff467fc0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn"
Jul 08 23:11:53.998236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998173    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5l8\" (UniqueName: \"kubernetes.io/projected/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-kube-api-access-4l5l8\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.998236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998189    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-serving-cert\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.998661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998312    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-trusted-ca\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.998661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998370    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-stats-auth\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.998661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998406    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qfmz\" (UniqueName: \"kubernetes.io/projected/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-kube-api-access-2qfmz\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.998661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998457    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.998661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998477    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-config\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.998661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998621    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-ca-trust-extracted\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.998661 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:53.998660    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:54.498638908 +0000 UTC m=+258.047698481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : configmap references non-existent config key: service-ca.crt
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998665    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/06f33d43-cab9-4703-8fe0-320176063683-snapshots\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998794    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f33d43-cab9-4703-8fe0-320176063683-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998827    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f33d43-cab9-4703-8fe0-320176063683-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998869    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhttg\" (UniqueName: \"kubernetes.io/projected/95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376-kube-api-access-nhttg\") pod \"volume-data-source-validator-5d456fdbcd-ghgjx\" (UID: \"95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998916    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn2dk\" (UniqueName: \"kubernetes.io/projected/06f33d43-cab9-4703-8fe0-320176063683-kube-api-access-dn2dk\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998946    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-trusted-ca\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.998973    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06f33d43-cab9-4703-8fe0-320176063683-tmp\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999000    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ef29118-3f96-440b-bb5b-ab884e67b8bc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999027    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlf2z\" (UniqueName: \"kubernetes.io/projected/0ef29118-3f96-440b-bb5b-ab884e67b8bc-kube-api-access-tlf2z\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:53.999065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999062    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:53.999586 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999091    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:53.999586 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:53.999199    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 23:11:53.999586 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:53.999256    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:54.499239697 +0000 UTC m=+258.048299274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : secret "router-metrics-certs-default" not found
Jul 08 23:11:53.999586 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999342    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-config\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.999586 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999419    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-trusted-ca\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:53.999833 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999622    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06f33d43-cab9-4703-8fe0-320176063683-tmp\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.999833 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999637    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f33d43-cab9-4703-8fe0-320176063683-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:53.999942 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:53.999886    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f33d43-cab9-4703-8fe0-320176063683-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:54.000722 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.000701    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06f33d43-cab9-4703-8fe0-320176063683-serving-cert\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:54.000834 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.000732    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-default-certificate\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:54.001219 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.001202    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-serving-cert\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:54.001594 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.001576    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-stats-auth\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:54.008627 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.008595    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwnwm\" (UniqueName: \"kubernetes.io/projected/3cbb5858-5c08-4167-b623-0227ff467fc0-kube-api-access-wwnwm\") pod \"network-check-source-989f8b8dc-dhvvn\" (UID: \"3cbb5858-5c08-4167-b623-0227ff467fc0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn"
Jul 08 23:11:54.009122 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.009100    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l5l8\" (UniqueName: \"kubernetes.io/projected/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-kube-api-access-4l5l8\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:54.009218 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.009196    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qfmz\" (UniqueName: \"kubernetes.io/projected/b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed-kube-api-access-2qfmz\") pod \"console-operator-68b757fb67-hmdh5\" (UID: \"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed\") " pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:54.010971 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.010951    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn2dk\" (UniqueName: \"kubernetes.io/projected/06f33d43-cab9-4703-8fe0-320176063683-kube-api-access-dn2dk\") pod \"insights-operator-5c847dcfc4-tbn49\" (UID: \"06f33d43-cab9-4703-8fe0-320176063683\") " pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:54.060873 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.060852    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn"
Jul 08 23:11:54.071822 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.071800    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-tbn49"
Jul 08 23:11:54.078805 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.078790    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.099871    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhttg\" (UniqueName: \"kubernetes.io/projected/95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376-kube-api-access-nhttg\") pod \"volume-data-source-validator-5d456fdbcd-ghgjx\" (UID: \"95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.099941    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-trusted-ca\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.099969    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ef29118-3f96-440b-bb5b-ab884e67b8bc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.099994    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlf2z\" (UniqueName: \"kubernetes.io/projected/0ef29118-3f96-440b-bb5b-ab884e67b8bc-kube-api-access-tlf2z\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100018    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100058    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-bound-sa-token\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100081    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-image-registry-private-configuration\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100109    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mx5v\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-kube-api-access-6mx5v\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100151    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ef29118-3f96-440b-bb5b-ab884e67b8bc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100174    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-certificates\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100198    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-installation-pull-secrets\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.100377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100272    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-ca-trust-extracted\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.101107 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.100717    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-ca-trust-extracted\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.101107 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.100960    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 23:11:54.101107 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.100979    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748f69b746-gx7xh: secret "image-registry-tls" not found
Jul 08 23:11:54.101107 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.101018    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ef29118-3f96-440b-bb5b-ab884e67b8bc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:54.101107 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.101045    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls podName:ddefe202-aa7d-4e74-bb9a-429f8b576d4b nodeName:}" failed. No retries permitted until 2026-07-08 23:11:54.601027368 +0000 UTC m=+258.150086950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls") pod "image-registry-748f69b746-gx7xh" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b") : secret "image-registry-tls" not found
Jul 08 23:11:54.101996 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.101947    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-trusted-ca\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.101996 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.101987    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-certificates\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.104255 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.104230    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-image-registry-private-configuration\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.104378 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.104236    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-installation-pull-secrets\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.104696 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.104668    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ef29118-3f96-440b-bb5b-ab884e67b8bc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:54.114185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.114100    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mx5v\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-kube-api-access-6mx5v\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.114801 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.114535    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-bound-sa-token\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.114990 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.114948    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlf2z\" (UniqueName: \"kubernetes.io/projected/0ef29118-3f96-440b-bb5b-ab884e67b8bc-kube-api-access-tlf2z\") pod \"kube-storage-version-migrator-operator-846bf668f7-56k62\" (UID: \"0ef29118-3f96-440b-bb5b-ab884e67b8bc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:54.114990 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.114957    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhttg\" (UniqueName: \"kubernetes.io/projected/95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376-kube-api-access-nhttg\") pod \"volume-data-source-validator-5d456fdbcd-ghgjx\" (UID: \"95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx"
Jul 08 23:11:54.154147 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.153869    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx"
Jul 08 23:11:54.163455 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.163431    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"
Jul 08 23:11:54.205308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.205236    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn"]
Jul 08 23:11:54.209304 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:11:54.209274    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbb5858_5c08_4167_b623_0227ff467fc0.slice/crio-c65b8acfaeff99bdc1f8e9b59fe62fc77ba0b73a4d1417789c0bcddb29192d7c WatchSource:0}: Error finding container c65b8acfaeff99bdc1f8e9b59fe62fc77ba0b73a4d1417789c0bcddb29192d7c: Status 404 returned error can't find the container with id c65b8acfaeff99bdc1f8e9b59fe62fc77ba0b73a4d1417789c0bcddb29192d7c
Jul 08 23:11:54.218138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.218070    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-tbn49"]
Jul 08 23:11:54.224830 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:11:54.224803    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f33d43_cab9_4703_8fe0_320176063683.slice/crio-e581dc2082b21c6c5ba8121f288d7d41d040920ff97e973ac8d7824be6e51830 WatchSource:0}: Error finding container e581dc2082b21c6c5ba8121f288d7d41d040920ff97e973ac8d7824be6e51830: Status 404 returned error can't find the container with id e581dc2082b21c6c5ba8121f288d7d41d040920ff97e973ac8d7824be6e51830
Jul 08 23:11:54.242883 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.242854    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hmdh5"]
Jul 08 23:11:54.249106 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:11:54.249077    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a2b0d2_ad03_40f9_9bb6_b3c8d17e93ed.slice/crio-d508dd9e98986d27b9439138831406631e59a22ab0393299c0b7ef760b868fa9 WatchSource:0}: Error finding container d508dd9e98986d27b9439138831406631e59a22ab0393299c0b7ef760b868fa9: Status 404 returned error can't find the container with id d508dd9e98986d27b9439138831406631e59a22ab0393299c0b7ef760b868fa9
Jul 08 23:11:54.261375 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.261321    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn" event={"ID":"3cbb5858-5c08-4167-b623-0227ff467fc0","Type":"ContainerStarted","Data":"c65b8acfaeff99bdc1f8e9b59fe62fc77ba0b73a4d1417789c0bcddb29192d7c"}
Jul 08 23:11:54.262632 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.262563    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" event={"ID":"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed","Type":"ContainerStarted","Data":"d508dd9e98986d27b9439138831406631e59a22ab0393299c0b7ef760b868fa9"}
Jul 08 23:11:54.263915 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.263886    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-tbn49" event={"ID":"06f33d43-cab9-4703-8fe0-320176063683","Type":"ContainerStarted","Data":"e581dc2082b21c6c5ba8121f288d7d41d040920ff97e973ac8d7824be6e51830"}
Jul 08 23:11:54.306299 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.306256    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx"]
Jul 08 23:11:54.309493 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:11:54.309467    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a9f4ca_d35d_4b00_bcd2_aaca8cf5d376.slice/crio-dd073af697ce3655c956a0ec17cafead0d446bd1e471eb758302896e60e64c1f WatchSource:0}: Error finding container dd073af697ce3655c956a0ec17cafead0d446bd1e471eb758302896e60e64c1f: Status 404 returned error can't find the container with id dd073af697ce3655c956a0ec17cafead0d446bd1e471eb758302896e60e64c1f
Jul 08 23:11:54.322990 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.322963    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62"]
Jul 08 23:11:54.326747 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:11:54.326722    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef29118_3f96_440b_bb5b_ab884e67b8bc.slice/crio-e5ee00db1762b51a701077ff641a80f7402eab3b7b1e6fc1af6f4141f76f1605 WatchSource:0}: Error finding container e5ee00db1762b51a701077ff641a80f7402eab3b7b1e6fc1af6f4141f76f1605: Status 404 returned error can't find the container with id e5ee00db1762b51a701077ff641a80f7402eab3b7b1e6fc1af6f4141f76f1605
Jul 08 23:11:54.504181 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.504114    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:54.504181 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.504171    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:54.504379 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.504262    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 23:11:54.504379 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.504269    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:55.504256383 +0000 UTC m=+259.053315952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : configmap references non-existent config key: service-ca.crt
Jul 08 23:11:54.504379 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.504315    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:55.504302381 +0000 UTC m=+259.053361951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : secret "router-metrics-certs-default" not found
Jul 08 23:11:54.605012 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:54.604975    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:54.605185 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.605081    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 23:11:54.605185 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.605092    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748f69b746-gx7xh: secret "image-registry-tls" not found
Jul 08 23:11:54.605185 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:54.605136    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls podName:ddefe202-aa7d-4e74-bb9a-429f8b576d4b nodeName:}" failed. No retries permitted until 2026-07-08 23:11:55.605123987 +0000 UTC m=+259.154183558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls") pod "image-registry-748f69b746-gx7xh" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b") : secret "image-registry-tls" not found
Jul 08 23:11:55.278128 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:55.277742    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn" event={"ID":"3cbb5858-5c08-4167-b623-0227ff467fc0","Type":"ContainerStarted","Data":"6ebac6ef1a00db50f558d327c1b9636affda25c42527f3d90bb7621d4ffd8f69"}
Jul 08 23:11:55.280285 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:55.280219    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx" event={"ID":"95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376","Type":"ContainerStarted","Data":"dd073af697ce3655c956a0ec17cafead0d446bd1e471eb758302896e60e64c1f"}
Jul 08 23:11:55.282299 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:55.282268    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62" event={"ID":"0ef29118-3f96-440b-bb5b-ab884e67b8bc","Type":"ContainerStarted","Data":"e5ee00db1762b51a701077ff641a80f7402eab3b7b1e6fc1af6f4141f76f1605"}
Jul 08 23:11:55.294196 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:55.293053    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dhvvn" podStartSLOduration=2.293036562 podStartE2EDuration="2.293036562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:11:55.292196024 +0000 UTC m=+258.841255616" watchObservedRunningTime="2026-07-08 23:11:55.293036562 +0000 UTC m=+258.842096157"
Jul 08 23:11:55.513927 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:55.513847    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:55.514098 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:55.513963    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:55.514178 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:55.514094    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 23:11:55.514178 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:55.514159    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:57.514139707 +0000 UTC m=+261.063199278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : secret "router-metrics-certs-default" not found
Jul 08 23:11:55.514479 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:55.514400    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:57.514384234 +0000 UTC m=+261.063443824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : configmap references non-existent config key: service-ca.crt
Jul 08 23:11:55.614921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:55.614873    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:55.615091 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:55.614994    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 23:11:55.615091 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:55.615014    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748f69b746-gx7xh: secret "image-registry-tls" not found
Jul 08 23:11:55.615091 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:55.615073    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls podName:ddefe202-aa7d-4e74-bb9a-429f8b576d4b nodeName:}" failed. No retries permitted until 2026-07-08 23:11:57.615054587 +0000 UTC m=+261.164114165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls") pod "image-registry-748f69b746-gx7xh" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b") : secret "image-registry-tls" not found
Jul 08 23:11:56.287753 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:56.287718    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx" event={"ID":"95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376","Type":"ContainerStarted","Data":"4b28039346b667b939c7f0e6789d61c839943cefa6424f9d2a4807de7f8ca9b9"}
Jul 08 23:11:56.303329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:56.303276    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-ghgjx" podStartSLOduration=1.859843246 podStartE2EDuration="3.30325788s" totalImagesPullingTime="1.443414634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:11:56.302373972 +0000 UTC m=+259.851433568" watchObservedRunningTime="2026-07-08 23:11:56.30325788 +0000 UTC m=+259.852317506"
Jul 08 23:11:57.532050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:57.532022    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:57.532405 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:57.532126    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:11:57.532405 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:57.532172    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 23:11:57.532405 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:57.532238    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.53221949 +0000 UTC m=+265.081279062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : secret "router-metrics-certs-default" not found
Jul 08 23:11:57.532405 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:57.532258    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.532247957 +0000 UTC m=+265.081307533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : configmap references non-existent config key: service-ca.crt
Jul 08 23:11:57.632912 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:57.632879    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:11:57.633038 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:57.633019    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 23:11:57.633093 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:57.633040    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748f69b746-gx7xh: secret "image-registry-tls" not found
Jul 08 23:11:57.633138 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:57.633092    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls podName:ddefe202-aa7d-4e74-bb9a-429f8b576d4b nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.633075656 +0000 UTC m=+265.182135227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls") pod "image-registry-748f69b746-gx7xh" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b") : secret "image-registry-tls" not found
Jul 08 23:11:58.172269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.172237    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ptcvp"]
Jul 08 23:11:58.176075 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.176053    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.181769 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.181745    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 23:11:58.182056 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.181761    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 23:11:58.182281 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.181820    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f5gd8\""
Jul 08 23:11:58.184682 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.184663    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ptcvp"]
Jul 08 23:11:58.294745 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.294721    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/0.log"
Jul 08 23:11:58.294892 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.294759    2586 generic.go:356] "Generic (PLEG): container finished" podID="b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed" containerID="814db720c7f00603a58f627c524a5db31f3f9e5fb380e33314bf4710426a68d8" exitCode=255
Jul 08 23:11:58.294892 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.294830    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" event={"ID":"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed","Type":"ContainerDied","Data":"814db720c7f00603a58f627c524a5db31f3f9e5fb380e33314bf4710426a68d8"}
Jul 08 23:11:58.295081 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.295068    2586 scope.go:117] "RemoveContainer" containerID="814db720c7f00603a58f627c524a5db31f3f9e5fb380e33314bf4710426a68d8"
Jul 08 23:11:58.296418 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.296395    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-tbn49" event={"ID":"06f33d43-cab9-4703-8fe0-320176063683","Type":"ContainerStarted","Data":"a8be4a0f610469e067d4efc155ac5d5c7b5dd7c4e2b23c12a4cc397ba0033f0d"}
Jul 08 23:11:58.297894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.297870    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62" event={"ID":"0ef29118-3f96-440b-bb5b-ab884e67b8bc","Type":"ContainerStarted","Data":"eaf0a5b7973f2bcf32e7d27ba7d2eb45f8cc800c00a7addf1a1146c2fb945a7a"}
Jul 08 23:11:58.325111 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.325074    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-tbn49" podStartSLOduration=2.102658427 podStartE2EDuration="5.325060178s" totalImagesPullingTime="3.222401751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:11:58.324068424 +0000 UTC m=+261.873128037" watchObservedRunningTime="2026-07-08 23:11:58.325060178 +0000 UTC m=+261.874119782"
Jul 08 23:11:58.338388 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.338348    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62" podStartSLOduration=2.213507286 podStartE2EDuration="5.338333433s" totalImagesPullingTime="3.124826147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:11:58.33709309 +0000 UTC m=+261.886152683" watchObservedRunningTime="2026-07-08 23:11:58.338333433 +0000 UTC m=+261.887393027"
Jul 08 23:11:58.338503 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.338419    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66e2e7ee-e66e-46b3-805e-a87d0169e79e-crio-socket\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.338503 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.338481    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.338663 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.338532    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66e2e7ee-e66e-46b3-805e-a87d0169e79e-data-volume\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.338663 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.338592    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.338781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.338731    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6h55\" (UniqueName: \"kubernetes.io/projected/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-api-access-g6h55\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.439358 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.439299    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6h55\" (UniqueName: \"kubernetes.io/projected/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-api-access-g6h55\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.439358 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.439338    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66e2e7ee-e66e-46b3-805e-a87d0169e79e-crio-socket\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.439635 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.439617    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66e2e7ee-e66e-46b3-805e-a87d0169e79e-crio-socket\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.439752 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.439727    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.439927 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:58.439786    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 23:11:58.439993 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.439930    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66e2e7ee-e66e-46b3-805e-a87d0169e79e-data-volume\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.439993 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:58.439965    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:11:58.939943954 +0000 UTC m=+262.489003525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : configmap "kube-rbac-proxy" not found
Jul 08 23:11:58.440074 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.440064    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.440208 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:58.440192    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 23:11:58.440208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.440201    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66e2e7ee-e66e-46b3-805e-a87d0169e79e-data-volume\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.440317 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:58.440247    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:11:58.940235355 +0000 UTC m=+262.489294928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : secret "insights-runtime-extractor-tls" not found
Jul 08 23:11:58.446920 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.446903    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6h55\" (UniqueName: \"kubernetes.io/projected/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-api-access-g6h55\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.944392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.944357    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.944815 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:58.944424    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:58.944815 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:58.944481    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 23:11:58.944815 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:58.944513    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 23:11:58.944815 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:58.944583    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:11:59.944567191 +0000 UTC m=+263.493626781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : configmap "kube-rbac-proxy" not found
Jul 08 23:11:58.944815 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:58.944616    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:11:59.944602391 +0000 UTC m=+263.493661961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : secret "insights-runtime-extractor-tls" not found
Jul 08 23:11:59.302240 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:59.302174    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:11:59.302555 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:59.302539    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/0.log"
Jul 08 23:11:59.302669 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:59.302576    2586 generic.go:356] "Generic (PLEG): container finished" podID="b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed" containerID="228d84f2e71ddb478ee9b1544ca637caf73d962c9bc41c85fe5c1c40deeea130" exitCode=255
Jul 08 23:11:59.302669 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:59.302658    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" event={"ID":"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed","Type":"ContainerDied","Data":"228d84f2e71ddb478ee9b1544ca637caf73d962c9bc41c85fe5c1c40deeea130"}
Jul 08 23:11:59.302774 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:59.302709    2586 scope.go:117] "RemoveContainer" containerID="814db720c7f00603a58f627c524a5db31f3f9e5fb380e33314bf4710426a68d8"
Jul 08 23:11:59.302986 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:59.302971    2586 scope.go:117] "RemoveContainer" containerID="228d84f2e71ddb478ee9b1544ca637caf73d962c9bc41c85fe5c1c40deeea130"
Jul 08 23:11:59.303142 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:59.303123    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hmdh5_openshift-console-operator(b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed)\"" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" podUID="b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed"
Jul 08 23:11:59.952636 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:59.952602    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:59.952995 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:11:59.952658    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:11:59.952995 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:59.952728    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 23:11:59.952995 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:59.952762    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 23:11:59.952995 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:59.952795    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.952779792 +0000 UTC m=+265.501839362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : configmap "kube-rbac-proxy" not found
Jul 08 23:11:59.952995 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:11:59.952808    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.95280252 +0000 UTC m=+265.501862090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : secret "insights-runtime-extractor-tls" not found
Jul 08 23:12:00.019029 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.018998    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vxhnk"]
Jul 08 23:12:00.022848 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.022834    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.025298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.025276    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 23:12:00.026635 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.026616    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 23:12:00.026758 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.026640    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 23:12:00.026758 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.026656    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-r2k7t\""
Jul 08 23:12:00.026758 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.026656    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 23:12:00.028542 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.028509    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vxhnk"]
Jul 08 23:12:00.153594 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.153560    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e9d10987-54b8-45e4-96d6-e0af3385b5a8-signing-cabundle\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.153733 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.153603    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e9d10987-54b8-45e4-96d6-e0af3385b5a8-signing-key\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.153797 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.153782    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhsm6\" (UniqueName: \"kubernetes.io/projected/e9d10987-54b8-45e4-96d6-e0af3385b5a8-kube-api-access-qhsm6\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.255077 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.254987    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhsm6\" (UniqueName: \"kubernetes.io/projected/e9d10987-54b8-45e4-96d6-e0af3385b5a8-kube-api-access-qhsm6\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.255077 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.255037    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e9d10987-54b8-45e4-96d6-e0af3385b5a8-signing-cabundle\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.255077 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.255058    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e9d10987-54b8-45e4-96d6-e0af3385b5a8-signing-key\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.255720 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.255697    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e9d10987-54b8-45e4-96d6-e0af3385b5a8-signing-cabundle\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.257455 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.257434    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e9d10987-54b8-45e4-96d6-e0af3385b5a8-signing-key\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.262950 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.262931    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhsm6\" (UniqueName: \"kubernetes.io/projected/e9d10987-54b8-45e4-96d6-e0af3385b5a8-kube-api-access-qhsm6\") pod \"service-ca-758f599c5-vxhnk\" (UID: \"e9d10987-54b8-45e4-96d6-e0af3385b5a8\") " pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.308740 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.308713    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:12:00.309545 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.309212    2586 scope.go:117] "RemoveContainer" containerID="228d84f2e71ddb478ee9b1544ca637caf73d962c9bc41c85fe5c1c40deeea130"
Jul 08 23:12:00.309545 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:00.309435    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hmdh5_openshift-console-operator(b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed)\"" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" podUID="b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed"
Jul 08 23:12:00.332437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.332415    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vxhnk"
Jul 08 23:12:00.352000 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.351877    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sm9fr_4b7f3241-2369-452d-be9d-b62f0c496956/dns-node-resolver/0.log"
Jul 08 23:12:00.451872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:00.451844    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vxhnk"]
Jul 08 23:12:00.454428 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:00.454395    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d10987_54b8_45e4_96d6_e0af3385b5a8.slice/crio-4a309c0e0782db3d714180bb32be29a9db46f0c1429c50615e56f589ae604e88 WatchSource:0}: Error finding container 4a309c0e0782db3d714180bb32be29a9db46f0c1429c50615e56f589ae604e88: Status 404 returned error can't find the container with id 4a309c0e0782db3d714180bb32be29a9db46f0c1429c50615e56f589ae604e88
Jul 08 23:12:01.314039 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:01.314001    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vxhnk" event={"ID":"e9d10987-54b8-45e4-96d6-e0af3385b5a8","Type":"ContainerStarted","Data":"4a309c0e0782db3d714180bb32be29a9db46f0c1429c50615e56f589ae604e88"}
Jul 08 23:12:01.355153 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:01.355132    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d2kh5_bd51c369-2f70-4c75-841c-9d7e762a70b4/node-ca/0.log"
Jul 08 23:12:01.565941 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:01.565871    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:01.566094 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:01.565938    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:01.566094 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.566035    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:09.566018168 +0000 UTC m=+273.115077738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : configmap references non-existent config key: service-ca.crt
Jul 08 23:12:01.566094 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.566066    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 23:12:01.566213 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.566112    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:09.566099961 +0000 UTC m=+273.115159538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : secret "router-metrics-certs-default" not found
Jul 08 23:12:01.667511 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:01.667466    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:12:01.667721 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.667622    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 23:12:01.667721 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.667639    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748f69b746-gx7xh: secret "image-registry-tls" not found
Jul 08 23:12:01.667721 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.667720    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls podName:ddefe202-aa7d-4e74-bb9a-429f8b576d4b nodeName:}" failed. No retries permitted until 2026-07-08 23:12:09.667698015 +0000 UTC m=+273.216757588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls") pod "image-registry-748f69b746-gx7xh" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b") : secret "image-registry-tls" not found
Jul 08 23:12:01.951721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:01.951688    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xcktj_0972dfb7-4183-42cb-b206-f64251b15d45/serve-healthcheck-canary/0.log"
Jul 08 23:12:01.970907 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:01.970847    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:01.971066 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.970973    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 23:12:01.971066 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.971050    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:12:05.971029144 +0000 UTC m=+269.520088718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : configmap "kube-rbac-proxy" not found
Jul 08 23:12:01.971172 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:01.971078    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:01.971293 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.971252    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 23:12:01.971403 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:01.971307    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:12:05.971292033 +0000 UTC m=+269.520351602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : secret "insights-runtime-extractor-tls" not found
Jul 08 23:12:03.321538 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:03.321483    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vxhnk" event={"ID":"e9d10987-54b8-45e4-96d6-e0af3385b5a8","Type":"ContainerStarted","Data":"fbb18b1f4f25dd0393f161a5639f519fc8e9f5183a7f41244daec7066807bc72"}
Jul 08 23:12:03.335856 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:03.335810    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-vxhnk" podStartSLOduration=1.271107513 podStartE2EDuration="3.335793978s" totalImagesPullingTime="2.064686465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:03.334465534 +0000 UTC m=+266.883525129" watchObservedRunningTime="2026-07-08 23:12:03.335793978 +0000 UTC m=+266.884853569"
Jul 08 23:12:04.079244 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:04.079150    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:12:04.079540 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:04.079503    2586 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:12:04.080088 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:04.080035    2586 scope.go:117] "RemoveContainer" containerID="228d84f2e71ddb478ee9b1544ca637caf73d962c9bc41c85fe5c1c40deeea130"
Jul 08 23:12:04.080362 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:04.080335    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hmdh5_openshift-console-operator(b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed)\"" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" podUID="b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed"
Jul 08 23:12:04.324847 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:04.324823    2586 scope.go:117] "RemoveContainer" containerID="228d84f2e71ddb478ee9b1544ca637caf73d962c9bc41c85fe5c1c40deeea130"
Jul 08 23:12:04.325196 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:04.324952    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hmdh5_openshift-console-operator(b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed)\"" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" podUID="b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed"
Jul 08 23:12:06.007137 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:06.007098    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:06.007480 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:06.007158    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:06.007480 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:06.007231    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 23:12:06.007480 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:06.007249    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 23:12:06.007480 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:06.007299    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:12:14.007286821 +0000 UTC m=+277.556346391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : secret "insights-runtime-extractor-tls" not found
Jul 08 23:12:06.007480 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:06.007313    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm podName:66e2e7ee-e66e-46b3-805e-a87d0169e79e nodeName:}" failed. No retries permitted until 2026-07-08 23:12:14.007306449 +0000 UTC m=+277.556366019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptcvp" (UID: "66e2e7ee-e66e-46b3-805e-a87d0169e79e") : configmap "kube-rbac-proxy" not found
Jul 08 23:12:09.637132 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:09.637099    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:09.637621 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:09.637170    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:09.637621 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:09.637288    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle podName:8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:25.637274269 +0000 UTC m=+289.186333838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle") pod "router-default-58fff4f6f5-rhps2" (UID: "8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5") : configmap references non-existent config key: service-ca.crt
Jul 08 23:12:09.639560 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:09.639536    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-metrics-certs\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:09.738152 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:09.738113    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:12:09.740550 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:09.740507    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"image-registry-748f69b746-gx7xh\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") " pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:12:09.769111 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:09.769080    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:12:09.897202 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:09.897123    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-748f69b746-gx7xh"]
Jul 08 23:12:09.899975 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:09.899947    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddefe202_aa7d_4e74_bb9a_429f8b576d4b.slice/crio-c471f254887bd8e5dadc4b5739749fe1963cbfef9e46ca80020a675f8dc4c7b4 WatchSource:0}: Error finding container c471f254887bd8e5dadc4b5739749fe1963cbfef9e46ca80020a675f8dc4c7b4: Status 404 returned error can't find the container with id c471f254887bd8e5dadc4b5739749fe1963cbfef9e46ca80020a675f8dc4c7b4
Jul 08 23:12:10.348723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:10.348685    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748f69b746-gx7xh" event={"ID":"ddefe202-aa7d-4e74-bb9a-429f8b576d4b","Type":"ContainerStarted","Data":"084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6"}
Jul 08 23:12:10.348889 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:10.348743    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748f69b746-gx7xh" event={"ID":"ddefe202-aa7d-4e74-bb9a-429f8b576d4b","Type":"ContainerStarted","Data":"c471f254887bd8e5dadc4b5739749fe1963cbfef9e46ca80020a675f8dc4c7b4"}
Jul 08 23:12:10.348889 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:10.348780    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:12:10.365144 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:10.365030    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-748f69b746-gx7xh" podStartSLOduration=17.365014738 podStartE2EDuration="17.365014738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:10.364869247 +0000 UTC m=+273.913928841" watchObservedRunningTime="2026-07-08 23:12:10.365014738 +0000 UTC m=+273.914074380"
Jul 08 23:12:14.070811 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:14.070782    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:14.071173 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:14.070854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:14.071343 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:14.071326    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66e2e7ee-e66e-46b3-805e-a87d0169e79e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:14.073156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:14.073116    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66e2e7ee-e66e-46b3-805e-a87d0169e79e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptcvp\" (UID: \"66e2e7ee-e66e-46b3-805e-a87d0169e79e\") " pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:14.092101 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:14.092073    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ptcvp"
Jul 08 23:12:14.216763 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:14.216722    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ptcvp"]
Jul 08 23:12:14.219447 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:14.219417    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e2e7ee_e66e_46b3_805e_a87d0169e79e.slice/crio-556b5180d3842e66c773c49994d73a76c0636882514edbe22b2e50ae1e509846 WatchSource:0}: Error finding container 556b5180d3842e66c773c49994d73a76c0636882514edbe22b2e50ae1e509846: Status 404 returned error can't find the container with id 556b5180d3842e66c773c49994d73a76c0636882514edbe22b2e50ae1e509846
Jul 08 23:12:14.361039 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:14.361011    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ptcvp" event={"ID":"66e2e7ee-e66e-46b3-805e-a87d0169e79e","Type":"ContainerStarted","Data":"556b5180d3842e66c773c49994d73a76c0636882514edbe22b2e50ae1e509846"}
Jul 08 23:12:16.988859 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:16.988824    2586 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:b660a06f204ae25d4c5be3f87b9e284f56d272d9d562bcf9ec439b33be050ea4: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift/origin-kube-rbac-proxy:latest"
Jul 08 23:12:16.989239 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:16.988932    2586 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy start failed in pod insights-runtime-extractor-ptcvp_openshift-insights(66e2e7ee-e66e-46b3-805e-a87d0169e79e): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:b660a06f204ae25d4c5be3f87b9e284f56d272d9d562bcf9ec439b33be050ea4: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 08 23:12:17.997822 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:17.997779    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gpfsz" podUID="db460404-b805-4b07-b594-e85ba66ea2e2"
Jul 08 23:12:18.374176 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:18.374145    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:12:18.528028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:18.527996    2586 scope.go:117] "RemoveContainer" containerID="228d84f2e71ddb478ee9b1544ca637caf73d962c9bc41c85fe5c1c40deeea130"
Jul 08 23:12:19.379913 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:19.379882    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:12:19.380365 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:19.379987    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" event={"ID":"b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed","Type":"ContainerStarted","Data":"18214a5483b5604e25d2eae8a9184e596353244541a920a0b3e9918601e73ce6"}
Jul 08 23:12:19.380365 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:19.380355    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:12:19.381913 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:19.381885    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ptcvp" event={"ID":"66e2e7ee-e66e-46b3-805e-a87d0169e79e","Type":"ContainerStarted","Data":"7ac39517e9bf5756aecc2f97d239ef0ae71c3cbecae738147554b4b03eb4fc92"}
Jul 08 23:12:19.385692 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:19.385673    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5"
Jul 08 23:12:19.397251 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:19.397210    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-hmdh5" podStartSLOduration=23.19292673 podStartE2EDuration="26.397192384s" totalImagesPullingTime="3.204265654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:19.396365366 +0000 UTC m=+282.945424951" watchObservedRunningTime="2026-07-08 23:12:19.397192384 +0000 UTC m=+282.946251976"
Jul 08 23:12:21.229815 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:21.229776    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:12:21.232072 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:21.232051    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db460404-b805-4b07-b594-e85ba66ea2e2-metrics-tls\") pod \"dns-default-gpfsz\" (UID: \"db460404-b805-4b07-b594-e85ba66ea2e2\") " pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:12:21.377295 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:21.377271    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vhnmb\""
Jul 08 23:12:21.386211 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:21.386189    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:12:21.544960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:21.544928    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gpfsz"]
Jul 08 23:12:21.613302 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:21.613257    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb460404_b805_4b07_b594_e85ba66ea2e2.slice/crio-76421fb65d7f0819393862ca31790448590020e0ed24088e15aece79dce00f19 WatchSource:0}: Error finding container 76421fb65d7f0819393862ca31790448590020e0ed24088e15aece79dce00f19: Status 404 returned error can't find the container with id 76421fb65d7f0819393862ca31790448590020e0ed24088e15aece79dce00f19
Jul 08 23:12:21.754107 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:21.754031    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:b660a06f204ae25d4c5be3f87b9e284f56d272d9d562bcf9ec439b33be050ea4: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-ptcvp" podUID="66e2e7ee-e66e-46b3-805e-a87d0169e79e"
Jul 08 23:12:22.087777 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:22.087700    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-748f69b746-gx7xh"]
Jul 08 23:12:22.394152 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:22.394112    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ptcvp" event={"ID":"66e2e7ee-e66e-46b3-805e-a87d0169e79e","Type":"ContainerStarted","Data":"82da6a9d7fa3ec8a0e9c61764a27a1c152b208584e60d52b085dad34ef867803"}
Jul 08 23:12:22.395385 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:22.395342    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:b660a06f204ae25d4c5be3f87b9e284f56d272d9d562bcf9ec439b33be050ea4: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-ptcvp" podUID="66e2e7ee-e66e-46b3-805e-a87d0169e79e"
Jul 08 23:12:22.397798 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:22.397327    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpfsz" event={"ID":"db460404-b805-4b07-b594-e85ba66ea2e2","Type":"ContainerStarted","Data":"76421fb65d7f0819393862ca31790448590020e0ed24088e15aece79dce00f19"}
Jul 08 23:12:23.402370 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:23.402339    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpfsz" event={"ID":"db460404-b805-4b07-b594-e85ba66ea2e2","Type":"ContainerStarted","Data":"4ee86e806855beef2fd09319a9f2f48f179b6c294ff4bac5fc27b54eedfc60f7"}
Jul 08 23:12:23.402710 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:23.402401    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpfsz" event={"ID":"db460404-b805-4b07-b594-e85ba66ea2e2","Type":"ContainerStarted","Data":"11dda70b307960283a0138ab603e7b29d8791090742b2086955a20e6ad023084"}
Jul 08 23:12:23.402710 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:23.402563    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:12:23.402987 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:23.402964    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:b660a06f204ae25d4c5be3f87b9e284f56d272d9d562bcf9ec439b33be050ea4: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-ptcvp" podUID="66e2e7ee-e66e-46b3-805e-a87d0169e79e"
Jul 08 23:12:23.418423 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:23.418384    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gpfsz" podStartSLOduration=250.840264906 podStartE2EDuration="4m12.418371848s" totalImagesPullingTime="1.578106942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:23.416334873 +0000 UTC m=+286.965394464" watchObservedRunningTime="2026-07-08 23:12:23.418371848 +0000 UTC m=+286.967431417"
Jul 08 23:12:25.662616 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:25.662575    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:25.663130 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:25.663111    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5-service-ca-bundle\") pod \"router-default-58fff4f6f5-rhps2\" (UID: \"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5\") " pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:25.883759 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:25.883708    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:26.009494 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:26.009468    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58fff4f6f5-rhps2"]
Jul 08 23:12:26.011252 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:26.011226    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec5ac05_7ffb_4fab_adc6_4fd83ae018d5.slice/crio-b6c822c69d426c9c4cd677082b7b72def00a76dbdd5a974ad9ead2b6cc3a9ca9 WatchSource:0}: Error finding container b6c822c69d426c9c4cd677082b7b72def00a76dbdd5a974ad9ead2b6cc3a9ca9: Status 404 returned error can't find the container with id b6c822c69d426c9c4cd677082b7b72def00a76dbdd5a974ad9ead2b6cc3a9ca9
Jul 08 23:12:26.412582 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:26.412549    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58fff4f6f5-rhps2" event={"ID":"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5","Type":"ContainerStarted","Data":"79bcd900023c0a5e1aed8d6d33a943d79d0dd4565aa6e2f07288f19f5b95aab5"}
Jul 08 23:12:26.412732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:26.412601    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58fff4f6f5-rhps2" event={"ID":"8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5","Type":"ContainerStarted","Data":"b6c822c69d426c9c4cd677082b7b72def00a76dbdd5a974ad9ead2b6cc3a9ca9"}
Jul 08 23:12:26.431311 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:26.431265    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-58fff4f6f5-rhps2" podStartSLOduration=33.431250747 podStartE2EDuration="33.431250747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:26.429247801 +0000 UTC m=+289.978307394" watchObservedRunningTime="2026-07-08 23:12:26.431250747 +0000 UTC m=+289.980310339"
Jul 08 23:12:26.884204 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:26.884172    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:26.886364 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:26.886347    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:27.416226 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.416197    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:27.417392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.417372    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58fff4f6f5-rhps2"
Jul 08 23:12:27.608919 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.608893    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fc5d575d-2vrld"]
Jul 08 23:12:27.610936 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.610921    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.615759 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.615737    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 23:12:27.615906 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.615887    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 23:12:27.615981 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.615759    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 23:12:27.615981 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.615759    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 23:12:27.615981 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.615961    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 23:12:27.616133 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.615816    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 23:12:27.616413 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.616395    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dx4jk\""
Jul 08 23:12:27.616603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.616532    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 23:12:27.620397 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.620372    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc5d575d-2vrld"]
Jul 08 23:12:27.677988 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.677923    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvt89\" (UniqueName: \"kubernetes.io/projected/55b82186-d9ca-4c1d-973e-fd33635cf1f6-kube-api-access-zvt89\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.677988 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.677956    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-oauth-config\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.677988 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.677984    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-serving-cert\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.678146 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.678044    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-oauth-serving-cert\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.678146 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.678119    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-service-ca\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.678209 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.678173    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-config\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.779406 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.779378    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvt89\" (UniqueName: \"kubernetes.io/projected/55b82186-d9ca-4c1d-973e-fd33635cf1f6-kube-api-access-zvt89\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.779406 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.779410    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-oauth-config\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.779620 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.779430    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-serving-cert\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.779620 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.779456    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-oauth-serving-cert\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.779620 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.779567    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-service-ca\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.779620 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.779612    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-config\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.780265 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.780241    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-oauth-serving-cert\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.780365 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.780241    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-service-ca\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.780365 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.780291    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-config\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.781912 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.781894    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-serving-cert\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.782010 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.781991    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-oauth-config\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.786500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.786476    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvt89\" (UniqueName: \"kubernetes.io/projected/55b82186-d9ca-4c1d-973e-fd33635cf1f6-kube-api-access-zvt89\") pod \"console-6fc5d575d-2vrld\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") " pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:27.919461 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:27.919423    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:28.048488 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:28.048457    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc5d575d-2vrld"]
Jul 08 23:12:28.051432 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:28.051407    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b82186_d9ca_4c1d_973e_fd33635cf1f6.slice/crio-fdbe1961d721440046b49a7af46de47fe97d92f15f281150c4d4d1c42dc6875a WatchSource:0}: Error finding container fdbe1961d721440046b49a7af46de47fe97d92f15f281150c4d4d1c42dc6875a: Status 404 returned error can't find the container with id fdbe1961d721440046b49a7af46de47fe97d92f15f281150c4d4d1c42dc6875a
Jul 08 23:12:28.420359 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:28.420330    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc5d575d-2vrld" event={"ID":"55b82186-d9ca-4c1d-973e-fd33635cf1f6","Type":"ContainerStarted","Data":"fdbe1961d721440046b49a7af46de47fe97d92f15f281150c4d4d1c42dc6875a"}
Jul 08 23:12:29.527910 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:29.527874    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-txmkb" podUID="5d90721e-9094-4a91-a701-0cfcfdeebf1f"
Jul 08 23:12:29.803823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.803751    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-779df5c5bb-th6v7"]
Jul 08 23:12:29.807144 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.807117    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:29.815216 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.815189    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 23:12:29.818929 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.818908    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-779df5c5bb-th6v7"]
Jul 08 23:12:29.898688 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.898659    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-service-ca\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:29.898804 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.898728    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-trusted-ca-bundle\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:29.898804 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.898758    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-config\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:29.898804 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.898793    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-oauth-serving-cert\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:29.898929 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.898813    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrjfk\" (UniqueName: \"kubernetes.io/projected/dd350b7c-2c43-4e72-9087-40a0953d3aa8-kube-api-access-wrjfk\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:29.898929 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.898889    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-serving-cert\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:29.898929 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:29.898912    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-oauth-config\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.000134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.000101    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-oauth-serving-cert\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.000283 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.000157    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrjfk\" (UniqueName: \"kubernetes.io/projected/dd350b7c-2c43-4e72-9087-40a0953d3aa8-kube-api-access-wrjfk\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.000283 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.000188    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-serving-cert\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.000283 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.000216    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-oauth-config\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.000283 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.000245    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-service-ca\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.000493 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.000304    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-trusted-ca-bundle\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.000493 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.000334    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-config\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.001068 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.000922    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-oauth-serving-cert\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.001068 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.001001    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-config\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.001409 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.001389    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-service-ca\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.001729 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.001702    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-trusted-ca-bundle\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.003310 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.003291    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-oauth-config\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.003612 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.003589    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-serving-cert\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.008500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.008479    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrjfk\" (UniqueName: \"kubernetes.io/projected/dd350b7c-2c43-4e72-9087-40a0953d3aa8-kube-api-access-wrjfk\") pod \"console-779df5c5bb-th6v7\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") " pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.119269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.119243    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:30.261609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.261578    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-779df5c5bb-th6v7"]
Jul 08 23:12:30.265232 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:30.265200    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd350b7c_2c43_4e72_9087_40a0953d3aa8.slice/crio-4e0456bf09233e3b367144c7485560c44d9ab84d2905147af696cc0d3dab4334 WatchSource:0}: Error finding container 4e0456bf09233e3b367144c7485560c44d9ab84d2905147af696cc0d3dab4334: Status 404 returned error can't find the container with id 4e0456bf09233e3b367144c7485560c44d9ab84d2905147af696cc0d3dab4334
Jul 08 23:12:30.433006 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:30.432921    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779df5c5bb-th6v7" event={"ID":"dd350b7c-2c43-4e72-9087-40a0953d3aa8","Type":"ContainerStarted","Data":"4e0456bf09233e3b367144c7485560c44d9ab84d2905147af696cc0d3dab4334"}
Jul 08 23:12:32.093675 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:32.093604    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:12:32.443206 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:32.443176    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc5d575d-2vrld" event={"ID":"55b82186-d9ca-4c1d-973e-fd33635cf1f6","Type":"ContainerStarted","Data":"fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51"}
Jul 08 23:12:32.444718 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:32.444695    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779df5c5bb-th6v7" event={"ID":"dd350b7c-2c43-4e72-9087-40a0953d3aa8","Type":"ContainerStarted","Data":"3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0"}
Jul 08 23:12:32.459782 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:32.459742    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fc5d575d-2vrld" podStartSLOduration=1.900155812 podStartE2EDuration="5.459728679s" totalImagesPullingTime="3.559572867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:32.458998219 +0000 UTC m=+296.008057810" watchObservedRunningTime="2026-07-08 23:12:32.459728679 +0000 UTC m=+296.008788271"
Jul 08 23:12:32.480180 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:32.480137    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-779df5c5bb-th6v7" podStartSLOduration=2.133910711 podStartE2EDuration="3.480122815s" totalImagesPullingTime="1.346212104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:32.479439685 +0000 UTC m=+296.028499282" watchObservedRunningTime="2026-07-08 23:12:32.480122815 +0000 UTC m=+296.029182406"
Jul 08 23:12:33.407599 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:33.407569    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gpfsz"
Jul 08 23:12:36.848418 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:36.848386    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:12:36.848873 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:36.848829    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:12:36.855550 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:36.855510    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:12:36.856120 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:36.856097    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:12:36.859497 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:36.859481    2586 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 23:12:37.919861 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:37.919832    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:37.922149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:37.919885    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:37.924641 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:37.924621    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:38.467729 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:38.467704    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:12:40.119666 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:40.119636    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:40.120061 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:40.119720    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:40.124558 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:40.124539    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:40.472647 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:40.472543    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ptcvp" event={"ID":"66e2e7ee-e66e-46b3-805e-a87d0169e79e","Type":"ContainerStarted","Data":"2c71d4f0f8f02293854279dd9c5e6032b4fc0c3983fd269e3b577df064be0b25"}
Jul 08 23:12:40.476506 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:40.476484    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:12:40.492780 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:40.492737    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ptcvp" podStartSLOduration=16.995145548 podStartE2EDuration="42.492722224s" totalImagesPullingTime="25.497576676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:11:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-08 23:12:40.491303435 +0000 UTC m=+304.040363027" watchObservedRunningTime="2026-07-08 23:12:40.492722224 +0000 UTC m=+304.041781816"
Jul 08 23:12:40.534423 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:40.534396    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc5d575d-2vrld"]
Jul 08 23:12:42.689173 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.689144    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qfwbj"]
Jul 08 23:12:42.692429 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.692412    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.694880 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.694856    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 23:12:42.695002 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.694907    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 23:12:42.695303 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.695285    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 23:12:42.696100 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.696078    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q8zt5\""
Jul 08 23:12:42.696235 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.696221    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 23:12:42.696331 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.696314    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 23:12:42.696485 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.696465    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 23:12:42.807130 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807093    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-sys\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.807130 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807135    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-root\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.807334 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807175    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8hvz\" (UniqueName: \"kubernetes.io/projected/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-kube-api-access-n8hvz\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.807334 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807198    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-textfile\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.807334 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807216    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.807334 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807245    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-tls\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.807334 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807298    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-metrics-client-ca\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.807506 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807351    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-wtmp\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.807506 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.807411    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-accelerators-collector-config\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908363 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908330    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-accelerators-collector-config\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908395    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-sys\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908427    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-root\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908465    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8hvz\" (UniqueName: \"kubernetes.io/projected/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-kube-api-access-n8hvz\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908468    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-sys\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908533    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-textfile\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908805 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908563    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908805 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908564    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-root\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908805 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908591    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-tls\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908805 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908617    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-metrics-client-ca\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.908805 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908642    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-wtmp\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.909062 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908848    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-wtmp\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.909062 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.908893    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-textfile\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.909062 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.909037    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-accelerators-collector-config\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.909358 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.909338    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-metrics-client-ca\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.911035 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.911012    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.911128 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.911066    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-node-exporter-tls\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:42.917593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:42.917573    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8hvz\" (UniqueName: \"kubernetes.io/projected/c2f0c9c7-7ca9-418d-8b68-4aebff383aed-kube-api-access-n8hvz\") pod \"node-exporter-qfwbj\" (UID: \"c2f0c9c7-7ca9-418d-8b68-4aebff383aed\") " pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:43.006928 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:43.006851    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qfwbj"
Jul 08 23:12:43.019063 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:43.019016    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f0c9c7_7ca9_418d_8b68_4aebff383aed.slice/crio-f1eb337b8c4d836363a5f8fd88f4e92b8da20cb61ee17054fe119278c6fd07b8 WatchSource:0}: Error finding container f1eb337b8c4d836363a5f8fd88f4e92b8da20cb61ee17054fe119278c6fd07b8: Status 404 returned error can't find the container with id f1eb337b8c4d836363a5f8fd88f4e92b8da20cb61ee17054fe119278c6fd07b8
Jul 08 23:12:43.022133 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:43.022039    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:12:43.484693 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:43.484654    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qfwbj" event={"ID":"c2f0c9c7-7ca9-418d-8b68-4aebff383aed","Type":"ContainerStarted","Data":"f1eb337b8c4d836363a5f8fd88f4e92b8da20cb61ee17054fe119278c6fd07b8"}
Jul 08 23:12:44.490459 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.490371    2586 generic.go:356] "Generic (PLEG): container finished" podID="c2f0c9c7-7ca9-418d-8b68-4aebff383aed" containerID="9db838fa35f2e44017dc742a5fc2270f8d0a1de7da4362d254e161779b1d83ec" exitCode=0
Jul 08 23:12:44.490897 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.490460    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qfwbj" event={"ID":"c2f0c9c7-7ca9-418d-8b68-4aebff383aed","Type":"ContainerDied","Data":"9db838fa35f2e44017dc742a5fc2270f8d0a1de7da4362d254e161779b1d83ec"}
Jul 08 23:12:44.527225 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.527203    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:12:44.688253 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.688228    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68fd587b-p8zdf"]
Jul 08 23:12:44.691643 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.691624    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.695687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.695670    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 23:12:44.696718 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.696684    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 23:12:44.697230 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.697209    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9j9ia27b04kps\""
Jul 08 23:12:44.697339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.697258    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 23:12:44.697339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.697304    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 23:12:44.698445 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.698432    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-scbh9\""
Jul 08 23:12:44.713766 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.713749    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 23:12:44.717830 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.717811    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68fd587b-p8zdf"]
Jul 08 23:12:44.825468 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.825397    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.825468 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.825434    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-metrics-client-ca\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.825468 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.825465    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.825692 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.825562    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.825692 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.825604    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.825692 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.825630    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb285\" (UniqueName: \"kubernetes.io/projected/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-kube-api-access-mb285\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.825692 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.825679    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-grpc-tls\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.825830 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.825700    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-tls\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.926558 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.926509    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-metrics-client-ca\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.926704 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.926573    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.926704 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.926604    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.926704 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.926652    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.926704 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.926683    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb285\" (UniqueName: \"kubernetes.io/projected/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-kube-api-access-mb285\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.926943 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.926723    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-grpc-tls\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.926943 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.926755    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-tls\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.926943 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.926821    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.927342 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.927309    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-metrics-client-ca\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.929709 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.929680    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.929801 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.929711    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.929843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.929814    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-grpc-tls\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.929878 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.929834    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.929878 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.929845    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-tls\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.930026 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.930007    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:44.934090 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:44.934071    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb285\" (UniqueName: \"kubernetes.io/projected/a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a-kube-api-access-mb285\") pod \"thanos-querier-68fd587b-p8zdf\" (UID: \"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a\") " pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:45.000117 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:45.000089    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:45.129406 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:45.129379    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68fd587b-p8zdf"]
Jul 08 23:12:45.132453 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:45.132425    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d3ad5d_b6cd_46b5_aed9_10d9cc3a5f9a.slice/crio-c7088fae073d6037b81979b67f224ea53bd8451ad03d19cbca3512e6b74b1162 WatchSource:0}: Error finding container c7088fae073d6037b81979b67f224ea53bd8451ad03d19cbca3512e6b74b1162: Status 404 returned error can't find the container with id c7088fae073d6037b81979b67f224ea53bd8451ad03d19cbca3512e6b74b1162
Jul 08 23:12:45.494558 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:45.494513    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf" event={"ID":"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a","Type":"ContainerStarted","Data":"c7088fae073d6037b81979b67f224ea53bd8451ad03d19cbca3512e6b74b1162"}
Jul 08 23:12:45.496660 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:45.496634    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qfwbj" event={"ID":"c2f0c9c7-7ca9-418d-8b68-4aebff383aed","Type":"ContainerStarted","Data":"b4a204735eaece50a3c025b6a06feb49e558287fed3bd59dfd07693ad66d5907"}
Jul 08 23:12:45.496766 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:45.496686    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qfwbj" event={"ID":"c2f0c9c7-7ca9-418d-8b68-4aebff383aed","Type":"ContainerStarted","Data":"acdd5b3fa9ec4b130c6237600660d980d0defd1262cd8dcd3bf25a02b79afda3"}
Jul 08 23:12:45.516100 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:45.516059    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qfwbj" podStartSLOduration=2.281816378 podStartE2EDuration="3.516045294s" totalImagesPullingTime="1.170633339s" totalInitContainerRuntime="63.595577ms" isStatefulPod=true podCreationTimestamp="2026-07-08 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:45.515290049 +0000 UTC m=+309.064349642" watchObservedRunningTime="2026-07-08 23:12:45.516045294 +0000 UTC m=+309.065104887"
Jul 08 23:12:47.117762 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.117714    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-748f69b746-gx7xh" podUID="ddefe202-aa7d-4e74-bb9a-429f8b576d4b" containerName="registry" containerID="cri-o://084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6" gracePeriod=30
Jul 08 23:12:47.432453 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.432427    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:12:47.446820 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.446796    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"]
Jul 08 23:12:47.447089 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.447078    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddefe202-aa7d-4e74-bb9a-429f8b576d4b" containerName="registry"
Jul 08 23:12:47.447135 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.447090    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddefe202-aa7d-4e74-bb9a-429f8b576d4b" containerName="registry"
Jul 08 23:12:47.447173 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.447144    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddefe202-aa7d-4e74-bb9a-429f8b576d4b" containerName="registry"
Jul 08 23:12:47.449993 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.449974    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:47.452265 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.452212    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d94xf\""
Jul 08 23:12:47.452391 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.452366    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 23:12:47.456276 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.455672    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"]
Jul 08 23:12:47.508214 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.508188    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf" event={"ID":"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a","Type":"ContainerStarted","Data":"221fb4a187c46a28cfc7c16d87e4b5181e29c8f77c95d85e710d93d7833530b1"}
Jul 08 23:12:47.508332 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.508269    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf" event={"ID":"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a","Type":"ContainerStarted","Data":"2d1ceaf8887f6436bbb394622604dad037c64a9f14252d55c657569725dced2c"}
Jul 08 23:12:47.509491 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.509470    2586 generic.go:356] "Generic (PLEG): container finished" podID="ddefe202-aa7d-4e74-bb9a-429f8b576d4b" containerID="084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6" exitCode=0
Jul 08 23:12:47.509608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.509504    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748f69b746-gx7xh" event={"ID":"ddefe202-aa7d-4e74-bb9a-429f8b576d4b","Type":"ContainerDied","Data":"084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6"}
Jul 08 23:12:47.509608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.509531    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748f69b746-gx7xh"
Jul 08 23:12:47.509608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.509550    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748f69b746-gx7xh" event={"ID":"ddefe202-aa7d-4e74-bb9a-429f8b576d4b","Type":"ContainerDied","Data":"c471f254887bd8e5dadc4b5739749fe1963cbfef9e46ca80020a675f8dc4c7b4"}
Jul 08 23:12:47.509608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.509575    2586 scope.go:117] "RemoveContainer" containerID="084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6"
Jul 08 23:12:47.518487 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.518466    2586 scope.go:117] "RemoveContainer" containerID="084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6"
Jul 08 23:12:47.518769 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:47.518753    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6\": container with ID starting with 084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6 not found: ID does not exist" containerID="084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6"
Jul 08 23:12:47.518836 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.518777    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6"} err="failed to get container status \"084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6\": rpc error: code = NotFound desc = could not find container \"084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6\": container with ID starting with 084c9218b39ae02f1a92f4a669be61ea5e796f580750ac062cba1ec77e3c2df6 not found: ID does not exist"
Jul 08 23:12:47.549790 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.549768    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-trusted-ca\") pod \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") "
Jul 08 23:12:47.549895 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.549828    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") pod \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") "
Jul 08 23:12:47.549895 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.549855    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-ca-trust-extracted\") pod \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") "
Jul 08 23:12:47.550153 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550124    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-certificates\") pod \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") "
Jul 08 23:12:47.550232 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550221    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mx5v\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-kube-api-access-6mx5v\") pod \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") "
Jul 08 23:12:47.550287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550232    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ddefe202-aa7d-4e74-bb9a-429f8b576d4b" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:12:47.550287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550253    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-installation-pull-secrets\") pod \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") "
Jul 08 23:12:47.550380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550289    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-bound-sa-token\") pod \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") "
Jul 08 23:12:47.550380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550317    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-image-registry-private-configuration\") pod \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\" (UID: \"ddefe202-aa7d-4e74-bb9a-429f8b576d4b\") "
Jul 08 23:12:47.550768 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550491    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-trrth\" (UID: \"833aa9c8-2900-4ad7-b09d-f89317da05f5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:47.550768 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550591    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ddefe202-aa7d-4e74-bb9a-429f8b576d4b" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:12:47.550768 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550632    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpmn2\" (UniqueName: \"kubernetes.io/projected/833aa9c8-2900-4ad7-b09d-f89317da05f5-kube-api-access-hpmn2\") pod \"monitoring-plugin-d5dcff7cf-trrth\" (UID: \"833aa9c8-2900-4ad7-b09d-f89317da05f5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:47.550768 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550690    2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-certificates\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:12:47.550768 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.550708    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-trusted-ca\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:12:47.553184 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.553158    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ddefe202-aa7d-4e74-bb9a-429f8b576d4b" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:12:47.553459 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.553441    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-kube-api-access-6mx5v" (OuterVolumeSpecName: "kube-api-access-6mx5v") pod "ddefe202-aa7d-4e74-bb9a-429f8b576d4b" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b"). InnerVolumeSpecName "kube-api-access-6mx5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:12:47.553954 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.553887    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ddefe202-aa7d-4e74-bb9a-429f8b576d4b" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:12:47.553954 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.553925    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ddefe202-aa7d-4e74-bb9a-429f8b576d4b" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:12:47.554293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.554259    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ddefe202-aa7d-4e74-bb9a-429f8b576d4b" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:12:47.561158 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.561132    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ddefe202-aa7d-4e74-bb9a-429f8b576d4b" (UID: "ddefe202-aa7d-4e74-bb9a-429f8b576d4b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:12:47.652029 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.651936    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpmn2\" (UniqueName: \"kubernetes.io/projected/833aa9c8-2900-4ad7-b09d-f89317da05f5-kube-api-access-hpmn2\") pod \"monitoring-plugin-d5dcff7cf-trrth\" (UID: \"833aa9c8-2900-4ad7-b09d-f89317da05f5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:47.652168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.652043    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-trrth\" (UID: \"833aa9c8-2900-4ad7-b09d-f89317da05f5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:47.652168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.652080    2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-ca-trust-extracted\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:12:47.652168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.652095    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mx5v\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-kube-api-access-6mx5v\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:12:47.652168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.652109    2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-installation-pull-secrets\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:12:47.652168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.652122    2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-bound-sa-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:12:47.652168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.652136    2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-image-registry-private-configuration\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:12:47.652168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.652149    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddefe202-aa7d-4e74-bb9a-429f8b576d4b-registry-tls\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:12:47.652378 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:47.652178    2586 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 23:12:47.652378 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:47.652248    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert podName:833aa9c8-2900-4ad7-b09d-f89317da05f5 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:48.152227837 +0000 UTC m=+311.701287411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-trrth" (UID: "833aa9c8-2900-4ad7-b09d-f89317da05f5") : secret "monitoring-plugin-cert" not found
Jul 08 23:12:47.659980 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.659952    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpmn2\" (UniqueName: \"kubernetes.io/projected/833aa9c8-2900-4ad7-b09d-f89317da05f5-kube-api-access-hpmn2\") pod \"monitoring-plugin-d5dcff7cf-trrth\" (UID: \"833aa9c8-2900-4ad7-b09d-f89317da05f5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:47.829605 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.829573    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-748f69b746-gx7xh"]
Jul 08 23:12:47.834747 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:47.834724    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-748f69b746-gx7xh"]
Jul 08 23:12:48.156576 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:48.156512    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-trrth\" (UID: \"833aa9c8-2900-4ad7-b09d-f89317da05f5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:48.157044 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:48.156696    2586 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 23:12:48.157044 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:12:48.156775    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert podName:833aa9c8-2900-4ad7-b09d-f89317da05f5 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:49.156753215 +0000 UTC m=+312.705812802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-trrth" (UID: "833aa9c8-2900-4ad7-b09d-f89317da05f5") : secret "monitoring-plugin-cert" not found
Jul 08 23:12:48.516317 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:48.516282    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf" event={"ID":"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a","Type":"ContainerStarted","Data":"b2f6b31554643b1a2da09367a3e549b42929b6f731254a82ba6637bc2a292dcb"}
Jul 08 23:12:48.516429 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:48.516353    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf" event={"ID":"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a","Type":"ContainerStarted","Data":"004981d32659abec4151240c2016b16a999dc509446e36eaeed518cf8a53dd36"}
Jul 08 23:12:49.001792 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.001756    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5449cc44c9-28rxn"]
Jul 08 23:12:49.008794 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.008775    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.016754 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.016731    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5449cc44c9-28rxn"]
Jul 08 23:12:49.166426 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.166398    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ghq\" (UniqueName: \"kubernetes.io/projected/518442bd-816a-489d-8118-7539124dff96-kube-api-access-j2ghq\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.166825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.166475    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-service-ca\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.166825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.166510    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-trrth\" (UID: \"833aa9c8-2900-4ad7-b09d-f89317da05f5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:49.166825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.166572    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-console-config\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.166825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.166597    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-oauth-serving-cert\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.166825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.166637    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-serving-cert\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.166825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.166677    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-oauth-config\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.166825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.166758    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-trusted-ca-bundle\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.169057 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.169033    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/833aa9c8-2900-4ad7-b09d-f89317da05f5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-trrth\" (UID: \"833aa9c8-2900-4ad7-b09d-f89317da05f5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:49.262652 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.262593    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:49.267869 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.267851    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-console-config\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.267971 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.267877    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-oauth-serving-cert\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.267971 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.267906    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-serving-cert\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.267971 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.267922    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-oauth-config\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.268207 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.267962    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-trusted-ca-bundle\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.268207 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.268080    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ghq\" (UniqueName: \"kubernetes.io/projected/518442bd-816a-489d-8118-7539124dff96-kube-api-access-j2ghq\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.268207 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.268162    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-service-ca\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.268667 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.268645    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-oauth-serving-cert\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.268918 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.268900    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-trusted-ca-bundle\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.268991 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.268938    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-console-config\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.268991 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.268943    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-service-ca\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.270408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.270384    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-oauth-config\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.270736 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.270717    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-serving-cert\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.275775 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.275751    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ghq\" (UniqueName: \"kubernetes.io/projected/518442bd-816a-489d-8118-7539124dff96-kube-api-access-j2ghq\") pod \"console-5449cc44c9-28rxn\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") " pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.318625 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.318596    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:12:49.432667 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.432589    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"]
Jul 08 23:12:49.434945 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:49.434921    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833aa9c8_2900_4ad7_b09d_f89317da05f5.slice/crio-9341355a1b5995ea03e63bd52a0d25ab2a306178eba6aab130b2db1e5027d433 WatchSource:0}: Error finding container 9341355a1b5995ea03e63bd52a0d25ab2a306178eba6aab130b2db1e5027d433: Status 404 returned error can't find the container with id 9341355a1b5995ea03e63bd52a0d25ab2a306178eba6aab130b2db1e5027d433
Jul 08 23:12:49.485303 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.485266    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5449cc44c9-28rxn"]
Jul 08 23:12:49.487947 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:49.487926    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518442bd_816a_489d_8118_7539124dff96.slice/crio-afd40bd9e0af00e762e3e31ee0bf364ed8fbc81ca16b37f2d4e79238348ffcfe WatchSource:0}: Error finding container afd40bd9e0af00e762e3e31ee0bf364ed8fbc81ca16b37f2d4e79238348ffcfe: Status 404 returned error can't find the container with id afd40bd9e0af00e762e3e31ee0bf364ed8fbc81ca16b37f2d4e79238348ffcfe
Jul 08 23:12:49.524389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.524364    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth" event={"ID":"833aa9c8-2900-4ad7-b09d-f89317da05f5","Type":"ContainerStarted","Data":"9341355a1b5995ea03e63bd52a0d25ab2a306178eba6aab130b2db1e5027d433"}
Jul 08 23:12:49.525500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.525476    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5449cc44c9-28rxn" event={"ID":"518442bd-816a-489d-8118-7539124dff96","Type":"ContainerStarted","Data":"afd40bd9e0af00e762e3e31ee0bf364ed8fbc81ca16b37f2d4e79238348ffcfe"}
Jul 08 23:12:49.531629 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.531607    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddefe202-aa7d-4e74-bb9a-429f8b576d4b" path="/var/lib/kubelet/pods/ddefe202-aa7d-4e74-bb9a-429f8b576d4b/volumes"
Jul 08 23:12:49.531898 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.531879    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf" event={"ID":"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a","Type":"ContainerStarted","Data":"e6a6e7afc0fdd7b5f132304e369d63a2561ad0471ded425d5481af16145cf7b4"}
Jul 08 23:12:49.532022 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.531997    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf" event={"ID":"a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a","Type":"ContainerStarted","Data":"e241a2fa2b57559dea30e58015caec485b69a21753fac79bc6049a33943cbe71"}
Jul 08 23:12:49.532135 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.532040    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:49.548168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:49.548130    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf" podStartSLOduration=2.503707193 podStartE2EDuration="5.548117662s" totalImagesPullingTime="3.044410469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:49.546988723 +0000 UTC m=+313.096048348" watchObservedRunningTime="2026-07-08 23:12:49.548117662 +0000 UTC m=+313.097177284"
Jul 08 23:12:50.534399 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:50.534319    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5449cc44c9-28rxn" event={"ID":"518442bd-816a-489d-8118-7539124dff96","Type":"ContainerStarted","Data":"0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9"}
Jul 08 23:12:50.550555 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:50.550495    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5449cc44c9-28rxn" podStartSLOduration=2.550478288 podStartE2EDuration="2.550478288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:50.549604214 +0000 UTC m=+314.098663808" watchObservedRunningTime="2026-07-08 23:12:50.550478288 +0000 UTC m=+314.099537887"
Jul 08 23:12:51.538440 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:51.538407    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth" event={"ID":"833aa9c8-2900-4ad7-b09d-f89317da05f5","Type":"ContainerStarted","Data":"8c8d2299f2964b17fa9039673dd00173b82acb32405ccc82506484789ac961e0"}
Jul 08 23:12:51.538813 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:51.538693    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:51.543390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:51.543361    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth"
Jul 08 23:12:51.553389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:51.553345    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-trrth" podStartSLOduration=3.016033649 podStartE2EDuration="4.553331267s" totalImagesPullingTime="1.537297618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:51.552130556 +0000 UTC m=+315.101190147" watchObservedRunningTime="2026-07-08 23:12:51.553331267 +0000 UTC m=+315.102390859"
Jul 08 23:12:51.937779 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:51.937743    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5449cc44c9-28rxn"]
Jul 08 23:12:51.961213 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:51.961178    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f746b9647-5lddc"]
Jul 08 23:12:51.964390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:51.964369    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:51.977053 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:51.977032    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f746b9647-5lddc"]
Jul 08 23:12:52.094680 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.094646    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7z7t\" (UniqueName: \"kubernetes.io/projected/ba4afc36-06e3-452a-a7fa-866f317c1427-kube-api-access-r7z7t\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.094828 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.094690    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-oauth-serving-cert\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.094828 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.094726    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-trusted-ca-bundle\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.094828 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.094763    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-oauth-config\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.094828 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.094779    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-console-config\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.094975 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.094851    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-serving-cert\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.094975 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.094944    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-service-ca\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.195486 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.195409    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-service-ca\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.195486 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.195456    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z7t\" (UniqueName: \"kubernetes.io/projected/ba4afc36-06e3-452a-a7fa-866f317c1427-kube-api-access-r7z7t\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.195486 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.195478    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-oauth-serving-cert\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.195729 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.195595    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-trusted-ca-bundle\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.195729 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.195648    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-oauth-config\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.195729 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.195672    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-console-config\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.195729 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.195707    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-serving-cert\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.196263 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.196235    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-service-ca\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.196396 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.196263    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-oauth-serving-cert\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.196396 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.196331    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-console-config\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.196592 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.196575    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-trusted-ca-bundle\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.198035 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.198018    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-serving-cert\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.198121 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.198068    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-oauth-config\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.202625 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.202598    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7z7t\" (UniqueName: \"kubernetes.io/projected/ba4afc36-06e3-452a-a7fa-866f317c1427-kube-api-access-r7z7t\") pod \"console-f746b9647-5lddc\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") " pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.273988 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.273965    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:12:52.395449 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.395426    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f746b9647-5lddc"]
Jul 08 23:12:52.397957 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:12:52.397932    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4afc36_06e3_452a_a7fa_866f317c1427.slice/crio-6549019b9162037aa4a49298b71e38f4d5beb8623d0651f3923f4b8f0953cb0a WatchSource:0}: Error finding container 6549019b9162037aa4a49298b71e38f4d5beb8623d0651f3923f4b8f0953cb0a: Status 404 returned error can't find the container with id 6549019b9162037aa4a49298b71e38f4d5beb8623d0651f3923f4b8f0953cb0a
Jul 08 23:12:52.543878 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.543835    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f746b9647-5lddc" event={"ID":"ba4afc36-06e3-452a-a7fa-866f317c1427","Type":"ContainerStarted","Data":"deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7"}
Jul 08 23:12:52.544310 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.543894    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f746b9647-5lddc" event={"ID":"ba4afc36-06e3-452a-a7fa-866f317c1427","Type":"ContainerStarted","Data":"6549019b9162037aa4a49298b71e38f4d5beb8623d0651f3923f4b8f0953cb0a"}
Jul 08 23:12:52.574651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:52.574598    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f746b9647-5lddc" podStartSLOduration=1.574583263 podStartE2EDuration="1.574583263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:52.573395178 +0000 UTC m=+316.122454770" watchObservedRunningTime="2026-07-08 23:12:52.574583263 +0000 UTC m=+316.123642855"
Jul 08 23:12:55.540058 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:55.540032    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68fd587b-p8zdf"
Jul 08 23:12:59.319764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:12:59.319720    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:13:02.274863 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:02.274834    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:13:02.275233 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:02.274914    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:13:02.281731 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:02.281706    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:13:02.585810 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:02.585727    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:13:02.629383 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:02.629353    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-779df5c5bb-th6v7"]
Jul 08 23:13:05.562358 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.562304    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fc5d575d-2vrld" podUID="55b82186-d9ca-4c1d-973e-fd33635cf1f6" containerName="console" containerID="cri-o://fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51" gracePeriod=15
Jul 08 23:13:05.800391 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.800365    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:13:05.813991 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.813948    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-serving-cert\") pod \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") "
Jul 08 23:13:05.813991 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.813984    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-oauth-serving-cert\") pod \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") "
Jul 08 23:13:05.814134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.814008    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvt89\" (UniqueName: \"kubernetes.io/projected/55b82186-d9ca-4c1d-973e-fd33635cf1f6-kube-api-access-zvt89\") pod \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") "
Jul 08 23:13:05.814134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.814023    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-service-ca\") pod \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") "
Jul 08 23:13:05.814134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.814057    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-oauth-config\") pod \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") "
Jul 08 23:13:05.814134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.814100    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-config\") pod \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\" (UID: \"55b82186-d9ca-4c1d-973e-fd33635cf1f6\") "
Jul 08 23:13:05.814431 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.814402    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "55b82186-d9ca-4c1d-973e-fd33635cf1f6" (UID: "55b82186-d9ca-4c1d-973e-fd33635cf1f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:05.814512 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.814412    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "55b82186-d9ca-4c1d-973e-fd33635cf1f6" (UID: "55b82186-d9ca-4c1d-973e-fd33635cf1f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:05.814512 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.814480    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-config" (OuterVolumeSpecName: "console-config") pod "55b82186-d9ca-4c1d-973e-fd33635cf1f6" (UID: "55b82186-d9ca-4c1d-973e-fd33635cf1f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:05.816460 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.816408    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "55b82186-d9ca-4c1d-973e-fd33635cf1f6" (UID: "55b82186-d9ca-4c1d-973e-fd33635cf1f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:13:05.818300 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.817283    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b82186-d9ca-4c1d-973e-fd33635cf1f6-kube-api-access-zvt89" (OuterVolumeSpecName: "kube-api-access-zvt89") pod "55b82186-d9ca-4c1d-973e-fd33635cf1f6" (UID: "55b82186-d9ca-4c1d-973e-fd33635cf1f6"). InnerVolumeSpecName "kube-api-access-zvt89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:13:05.818300 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.817492    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "55b82186-d9ca-4c1d-973e-fd33635cf1f6" (UID: "55b82186-d9ca-4c1d-973e-fd33635cf1f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:13:05.914939 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.914915    2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-oauth-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:05.914939 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.914936    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvt89\" (UniqueName: \"kubernetes.io/projected/55b82186-d9ca-4c1d-973e-fd33635cf1f6-kube-api-access-zvt89\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:05.915101 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.914946    2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-service-ca\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:05.915101 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.914955    2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-oauth-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:05.915101 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.914963    2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:05.915101 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:05.914972    2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55b82186-d9ca-4c1d-973e-fd33635cf1f6-console-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:06.596303 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.596270    2586 generic.go:356] "Generic (PLEG): container finished" podID="55b82186-d9ca-4c1d-973e-fd33635cf1f6" containerID="fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51" exitCode=0
Jul 08 23:13:06.596788 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.596349    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc5d575d-2vrld"
Jul 08 23:13:06.596788 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.596378    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc5d575d-2vrld" event={"ID":"55b82186-d9ca-4c1d-973e-fd33635cf1f6","Type":"ContainerDied","Data":"fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51"}
Jul 08 23:13:06.596788 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.596429    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc5d575d-2vrld" event={"ID":"55b82186-d9ca-4c1d-973e-fd33635cf1f6","Type":"ContainerDied","Data":"fdbe1961d721440046b49a7af46de47fe97d92f15f281150c4d4d1c42dc6875a"}
Jul 08 23:13:06.596788 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.596446    2586 scope.go:117] "RemoveContainer" containerID="fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51"
Jul 08 23:13:06.605239 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.605218    2586 scope.go:117] "RemoveContainer" containerID="fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51"
Jul 08 23:13:06.605486 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:13:06.605467    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51\": container with ID starting with fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51 not found: ID does not exist" containerID="fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51"
Jul 08 23:13:06.605577 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.605500    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51"} err="failed to get container status \"fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51\": rpc error: code = NotFound desc = could not find container \"fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51\": container with ID starting with fa556e0edf86004142f7a3bc9653e1c20a08ec6bd09c097632fb76e021810c51 not found: ID does not exist"
Jul 08 23:13:06.616895 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.616873    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc5d575d-2vrld"]
Jul 08 23:13:06.621916 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:06.621886    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fc5d575d-2vrld"]
Jul 08 23:13:07.532390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:07.532361    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55b82186-d9ca-4c1d-973e-fd33635cf1f6" path="/var/lib/kubelet/pods/55b82186-d9ca-4c1d-973e-fd33635cf1f6/volumes"
Jul 08 23:13:08.605089 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:08.605056    2586 generic.go:356] "Generic (PLEG): container finished" podID="06f33d43-cab9-4703-8fe0-320176063683" containerID="a8be4a0f610469e067d4efc155ac5d5c7b5dd7c4e2b23c12a4cc397ba0033f0d" exitCode=0
Jul 08 23:13:08.605444 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:08.605128    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-tbn49" event={"ID":"06f33d43-cab9-4703-8fe0-320176063683","Type":"ContainerDied","Data":"a8be4a0f610469e067d4efc155ac5d5c7b5dd7c4e2b23c12a4cc397ba0033f0d"}
Jul 08 23:13:08.605444 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:08.605425    2586 scope.go:117] "RemoveContainer" containerID="a8be4a0f610469e067d4efc155ac5d5c7b5dd7c4e2b23c12a4cc397ba0033f0d"
Jul 08 23:13:09.609931 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:09.609901    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-tbn49" event={"ID":"06f33d43-cab9-4703-8fe0-320176063683","Type":"ContainerStarted","Data":"e98346357b18c9a604dbad63312ea2f636131e004c341778b15ca262642151c2"}
Jul 08 23:13:13.626466 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:13.626386    2586 generic.go:356] "Generic (PLEG): container finished" podID="0ef29118-3f96-440b-bb5b-ab884e67b8bc" containerID="eaf0a5b7973f2bcf32e7d27ba7d2eb45f8cc800c00a7addf1a1146c2fb945a7a" exitCode=0
Jul 08 23:13:13.626837 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:13.626459    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62" event={"ID":"0ef29118-3f96-440b-bb5b-ab884e67b8bc","Type":"ContainerDied","Data":"eaf0a5b7973f2bcf32e7d27ba7d2eb45f8cc800c00a7addf1a1146c2fb945a7a"}
Jul 08 23:13:13.626837 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:13.626828    2586 scope.go:117] "RemoveContainer" containerID="eaf0a5b7973f2bcf32e7d27ba7d2eb45f8cc800c00a7addf1a1146c2fb945a7a"
Jul 08 23:13:14.631846 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:14.631814    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-56k62" event={"ID":"0ef29118-3f96-440b-bb5b-ab884e67b8bc","Type":"ContainerStarted","Data":"3b9f146032a2749667ceccd7b3639a66f3e28a6ef3f8fe24e7c58afbc8662b68"}
Jul 08 23:13:17.563652 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.563612    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5449cc44c9-28rxn" podUID="518442bd-816a-489d-8118-7539124dff96" containerName="console" containerID="cri-o://0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9" gracePeriod=15
Jul 08 23:13:17.814155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.814089    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:13:17.908798 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.908765    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-serving-cert\") pod \"518442bd-816a-489d-8118-7539124dff96\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") "
Jul 08 23:13:17.908976 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.908819    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-console-config\") pod \"518442bd-816a-489d-8118-7539124dff96\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") "
Jul 08 23:13:17.908976 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.908840    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-oauth-config\") pod \"518442bd-816a-489d-8118-7539124dff96\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") "
Jul 08 23:13:17.908976 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.908890    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2ghq\" (UniqueName: \"kubernetes.io/projected/518442bd-816a-489d-8118-7539124dff96-kube-api-access-j2ghq\") pod \"518442bd-816a-489d-8118-7539124dff96\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") "
Jul 08 23:13:17.908976 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.908907    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-service-ca\") pod \"518442bd-816a-489d-8118-7539124dff96\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") "
Jul 08 23:13:17.908976 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.908922    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-oauth-serving-cert\") pod \"518442bd-816a-489d-8118-7539124dff96\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") "
Jul 08 23:13:17.908976 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.908938    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-trusted-ca-bundle\") pod \"518442bd-816a-489d-8118-7539124dff96\" (UID: \"518442bd-816a-489d-8118-7539124dff96\") "
Jul 08 23:13:17.909394 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.909363    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-service-ca" (OuterVolumeSpecName: "service-ca") pod "518442bd-816a-489d-8118-7539124dff96" (UID: "518442bd-816a-489d-8118-7539124dff96"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:17.909516 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.909361    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "518442bd-816a-489d-8118-7539124dff96" (UID: "518442bd-816a-489d-8118-7539124dff96"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:17.909516 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.909430    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-console-config" (OuterVolumeSpecName: "console-config") pod "518442bd-816a-489d-8118-7539124dff96" (UID: "518442bd-816a-489d-8118-7539124dff96"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:17.909516 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.909436    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "518442bd-816a-489d-8118-7539124dff96" (UID: "518442bd-816a-489d-8118-7539124dff96"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:17.910935 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.910911    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "518442bd-816a-489d-8118-7539124dff96" (UID: "518442bd-816a-489d-8118-7539124dff96"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:13:17.911449 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.911430    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "518442bd-816a-489d-8118-7539124dff96" (UID: "518442bd-816a-489d-8118-7539124dff96"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:13:17.911538 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:17.911461    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/518442bd-816a-489d-8118-7539124dff96-kube-api-access-j2ghq" (OuterVolumeSpecName: "kube-api-access-j2ghq") pod "518442bd-816a-489d-8118-7539124dff96" (UID: "518442bd-816a-489d-8118-7539124dff96"). InnerVolumeSpecName "kube-api-access-j2ghq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:13:18.010188 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.010150    2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-console-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:18.010188 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.010180    2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-oauth-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:18.010188 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.010191    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2ghq\" (UniqueName: \"kubernetes.io/projected/518442bd-816a-489d-8118-7539124dff96-kube-api-access-j2ghq\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:18.010188 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.010202    2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-service-ca\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:18.010443 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.010210    2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-oauth-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:18.010443 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.010218    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/518442bd-816a-489d-8118-7539124dff96-trusted-ca-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:18.010443 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.010227    2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/518442bd-816a-489d-8118-7539124dff96-console-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:18.648299 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.648263    2586 generic.go:356] "Generic (PLEG): container finished" podID="518442bd-816a-489d-8118-7539124dff96" containerID="0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9" exitCode=0
Jul 08 23:13:18.648721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.648309    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5449cc44c9-28rxn"
Jul 08 23:13:18.648721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.648315    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5449cc44c9-28rxn" event={"ID":"518442bd-816a-489d-8118-7539124dff96","Type":"ContainerDied","Data":"0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9"}
Jul 08 23:13:18.648721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.648412    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5449cc44c9-28rxn" event={"ID":"518442bd-816a-489d-8118-7539124dff96","Type":"ContainerDied","Data":"afd40bd9e0af00e762e3e31ee0bf364ed8fbc81ca16b37f2d4e79238348ffcfe"}
Jul 08 23:13:18.648721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.648432    2586 scope.go:117] "RemoveContainer" containerID="0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9"
Jul 08 23:13:18.657721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.657702    2586 scope.go:117] "RemoveContainer" containerID="0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9"
Jul 08 23:13:18.657979 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:13:18.657958    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9\": container with ID starting with 0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9 not found: ID does not exist" containerID="0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9"
Jul 08 23:13:18.658029 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.657988    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9"} err="failed to get container status \"0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9\": rpc error: code = NotFound desc = could not find container \"0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9\": container with ID starting with 0b0e4da4d512f9c13e2d123d69a8ea3e694ebdc174118036c14236f03f415cc9 not found: ID does not exist"
Jul 08 23:13:18.667961 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.667934    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5449cc44c9-28rxn"]
Jul 08 23:13:18.669958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:18.669938    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5449cc44c9-28rxn"]
Jul 08 23:13:19.533195 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:19.533162    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="518442bd-816a-489d-8118-7539124dff96" path="/var/lib/kubelet/pods/518442bd-816a-489d-8118-7539124dff96/volumes"
Jul 08 23:13:27.650574 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.650510    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-779df5c5bb-th6v7" podUID="dd350b7c-2c43-4e72-9087-40a0953d3aa8" containerName="console" containerID="cri-o://3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0" gracePeriod=15
Jul 08 23:13:27.892601 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.892579    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:13:27.990770 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.990695    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-config\") pod \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") "
Jul 08 23:13:27.990770 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.990757    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrjfk\" (UniqueName: \"kubernetes.io/projected/dd350b7c-2c43-4e72-9087-40a0953d3aa8-kube-api-access-wrjfk\") pod \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") "
Jul 08 23:13:27.990973 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.990780    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-oauth-config\") pod \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") "
Jul 08 23:13:27.990973 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.990812    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-oauth-serving-cert\") pod \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") "
Jul 08 23:13:27.990973 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.990869    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-service-ca\") pod \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") "
Jul 08 23:13:27.990973 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.990904    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-serving-cert\") pod \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") "
Jul 08 23:13:27.990973 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.990932    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-trusted-ca-bundle\") pod \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\" (UID: \"dd350b7c-2c43-4e72-9087-40a0953d3aa8\") "
Jul 08 23:13:27.991241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.991014    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-config" (OuterVolumeSpecName: "console-config") pod "dd350b7c-2c43-4e72-9087-40a0953d3aa8" (UID: "dd350b7c-2c43-4e72-9087-40a0953d3aa8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:27.991241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.991179    2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:27.991335 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.991286    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dd350b7c-2c43-4e72-9087-40a0953d3aa8" (UID: "dd350b7c-2c43-4e72-9087-40a0953d3aa8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:27.991335 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.991293    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-service-ca" (OuterVolumeSpecName: "service-ca") pod "dd350b7c-2c43-4e72-9087-40a0953d3aa8" (UID: "dd350b7c-2c43-4e72-9087-40a0953d3aa8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:27.991498 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.991481    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dd350b7c-2c43-4e72-9087-40a0953d3aa8" (UID: "dd350b7c-2c43-4e72-9087-40a0953d3aa8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:13:27.992887 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.992858    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dd350b7c-2c43-4e72-9087-40a0953d3aa8" (UID: "dd350b7c-2c43-4e72-9087-40a0953d3aa8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:13:27.993329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.993308    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dd350b7c-2c43-4e72-9087-40a0953d3aa8" (UID: "dd350b7c-2c43-4e72-9087-40a0953d3aa8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:13:27.993386 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:27.993324    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd350b7c-2c43-4e72-9087-40a0953d3aa8-kube-api-access-wrjfk" (OuterVolumeSpecName: "kube-api-access-wrjfk") pod "dd350b7c-2c43-4e72-9087-40a0953d3aa8" (UID: "dd350b7c-2c43-4e72-9087-40a0953d3aa8"). InnerVolumeSpecName "kube-api-access-wrjfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:13:28.092337 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.092306    2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-service-ca\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:28.092337 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.092331    2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:28.092337 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.092340    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-trusted-ca-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:28.092580 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.092350    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrjfk\" (UniqueName: \"kubernetes.io/projected/dd350b7c-2c43-4e72-9087-40a0953d3aa8-kube-api-access-wrjfk\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:28.092580 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.092358    2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd350b7c-2c43-4e72-9087-40a0953d3aa8-console-oauth-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:28.092580 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.092366    2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd350b7c-2c43-4e72-9087-40a0953d3aa8-oauth-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:13:28.690815 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.690785    2586 generic.go:356] "Generic (PLEG): container finished" podID="dd350b7c-2c43-4e72-9087-40a0953d3aa8" containerID="3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0" exitCode=0
Jul 08 23:13:28.691176 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.690839    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779df5c5bb-th6v7"
Jul 08 23:13:28.691176 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.690875    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779df5c5bb-th6v7" event={"ID":"dd350b7c-2c43-4e72-9087-40a0953d3aa8","Type":"ContainerDied","Data":"3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0"}
Jul 08 23:13:28.691176 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.690927    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779df5c5bb-th6v7" event={"ID":"dd350b7c-2c43-4e72-9087-40a0953d3aa8","Type":"ContainerDied","Data":"4e0456bf09233e3b367144c7485560c44d9ab84d2905147af696cc0d3dab4334"}
Jul 08 23:13:28.691176 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.690948    2586 scope.go:117] "RemoveContainer" containerID="3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0"
Jul 08 23:13:28.699679 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.699664    2586 scope.go:117] "RemoveContainer" containerID="3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0"
Jul 08 23:13:28.699923 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:13:28.699904    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0\": container with ID starting with 3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0 not found: ID does not exist" containerID="3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0"
Jul 08 23:13:28.699963 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.699931    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0"} err="failed to get container status \"3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0\": rpc error: code = NotFound desc = could not find container \"3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0\": container with ID starting with 3468879b394b3143abe507a4e21028f0e9b431d2d1db091a584b628298990ac0 not found: ID does not exist"
Jul 08 23:13:28.710248 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.710223    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-779df5c5bb-th6v7"]
Jul 08 23:13:28.714094 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:28.714077    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-779df5c5bb-th6v7"]
Jul 08 23:13:29.532172 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:29.532141    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd350b7c-2c43-4e72-9087-40a0953d3aa8" path="/var/lib/kubelet/pods/dd350b7c-2c43-4e72-9087-40a0953d3aa8/volumes"
Jul 08 23:13:50.685907 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:50.685869    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:13:50.688111 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:50.688093    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d90721e-9094-4a91-a701-0cfcfdeebf1f-metrics-certs\") pod \"network-metrics-daemon-txmkb\" (UID: \"5d90721e-9094-4a91-a701-0cfcfdeebf1f\") " pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:13:50.830389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:50.830354    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dwbh8\""
Jul 08 23:13:50.838444 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:50.838421    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txmkb"
Jul 08 23:13:50.965153 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:50.965054    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txmkb"]
Jul 08 23:13:50.967395 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:13:50.967363    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d90721e_9094_4a91_a701_0cfcfdeebf1f.slice/crio-2f95a8f556f42a21dd93eeb5cd0ed2acfed3dd09477f124a9b32140a1bd59571 WatchSource:0}: Error finding container 2f95a8f556f42a21dd93eeb5cd0ed2acfed3dd09477f124a9b32140a1bd59571: Status 404 returned error can't find the container with id 2f95a8f556f42a21dd93eeb5cd0ed2acfed3dd09477f124a9b32140a1bd59571
Jul 08 23:13:51.776258 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:51.776224    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txmkb" event={"ID":"5d90721e-9094-4a91-a701-0cfcfdeebf1f","Type":"ContainerStarted","Data":"2f95a8f556f42a21dd93eeb5cd0ed2acfed3dd09477f124a9b32140a1bd59571"}
Jul 08 23:13:52.781394 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:52.781358    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txmkb" event={"ID":"5d90721e-9094-4a91-a701-0cfcfdeebf1f","Type":"ContainerStarted","Data":"f536f78fa21d96a6c4c0118db1d02fffd85c0da3b7c5f989d70db8282fae9177"}
Jul 08 23:13:52.781846 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:52.781411    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txmkb" event={"ID":"5d90721e-9094-4a91-a701-0cfcfdeebf1f","Type":"ContainerStarted","Data":"0fc9416bf8d1d7575600bcd4fb12cddac5f2917e36a974a369cc4b71dbfdc0bb"}
Jul 08 23:13:52.796386 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:13:52.796343    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-txmkb" podStartSLOduration=374.748524315 podStartE2EDuration="6m15.796329815s" totalImagesPullingTime="1.0478055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:13:52.794837226 +0000 UTC m=+376.343896829" watchObservedRunningTime="2026-07-08 23:13:52.796329815 +0000 UTC m=+376.345389406"
Jul 08 23:14:01.763801 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.763771    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66cc4449fd-kg5gh"]
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764026    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd350b7c-2c43-4e72-9087-40a0953d3aa8" containerName="console"
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764037    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd350b7c-2c43-4e72-9087-40a0953d3aa8" containerName="console"
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764055    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="518442bd-816a-489d-8118-7539124dff96" containerName="console"
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764061    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="518442bd-816a-489d-8118-7539124dff96" containerName="console"
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764069    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b82186-d9ca-4c1d-973e-fd33635cf1f6" containerName="console"
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764075    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b82186-d9ca-4c1d-973e-fd33635cf1f6" containerName="console"
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764127    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="55b82186-d9ca-4c1d-973e-fd33635cf1f6" containerName="console"
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764136    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd350b7c-2c43-4e72-9087-40a0953d3aa8" containerName="console"
Jul 08 23:14:01.764156 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.764142    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="518442bd-816a-489d-8118-7539124dff96" containerName="console"
Jul 08 23:14:01.766531 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.766501    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.778588 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.778563    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66cc4449fd-kg5gh"]
Jul 08 23:14:01.868689 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.868661    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vn28\" (UniqueName: \"kubernetes.io/projected/d215a3d1-342e-4321-9050-233601e6f56f-kube-api-access-8vn28\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.868835 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.868693    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-oauth-config\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.868835 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.868712    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-serving-cert\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.868835 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.868747    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-trusted-ca-bundle\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.868835 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.868784    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-oauth-serving-cert\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.868835 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.868809    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-service-ca\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.868835 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.868832    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-console-config\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.969794 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.969758    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vn28\" (UniqueName: \"kubernetes.io/projected/d215a3d1-342e-4321-9050-233601e6f56f-kube-api-access-8vn28\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.969794 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.969795    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-oauth-config\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.969811    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-serving-cert\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.969830    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-trusted-ca-bundle\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.969879    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-oauth-serving-cert\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.969908    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-service-ca\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.969934    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-console-config\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970724 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.970699    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-oauth-serving-cert\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.970790    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-console-config\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970904 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.970842    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-service-ca\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.970960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.970913    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-trusted-ca-bundle\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.972308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.972286    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-oauth-config\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.972422 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.972387    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-serving-cert\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:01.976921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:01.976901    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vn28\" (UniqueName: \"kubernetes.io/projected/d215a3d1-342e-4321-9050-233601e6f56f-kube-api-access-8vn28\") pod \"console-66cc4449fd-kg5gh\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") " pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:02.076141 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:02.076064    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:02.201472 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:02.201385    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66cc4449fd-kg5gh"]
Jul 08 23:14:02.203838 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:14:02.203811    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd215a3d1_342e_4321_9050_233601e6f56f.slice/crio-3d201484c8dc6185f60d7f048261d8a3598673f09d081a434d139b87a4801c48 WatchSource:0}: Error finding container 3d201484c8dc6185f60d7f048261d8a3598673f09d081a434d139b87a4801c48: Status 404 returned error can't find the container with id 3d201484c8dc6185f60d7f048261d8a3598673f09d081a434d139b87a4801c48
Jul 08 23:14:02.819463 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:02.819431    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cc4449fd-kg5gh" event={"ID":"d215a3d1-342e-4321-9050-233601e6f56f","Type":"ContainerStarted","Data":"98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045"}
Jul 08 23:14:02.819463 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:02.819478    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cc4449fd-kg5gh" event={"ID":"d215a3d1-342e-4321-9050-233601e6f56f","Type":"ContainerStarted","Data":"3d201484c8dc6185f60d7f048261d8a3598673f09d081a434d139b87a4801c48"}
Jul 08 23:14:02.835840 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:02.835773    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66cc4449fd-kg5gh" podStartSLOduration=1.835756306 podStartE2EDuration="1.835756306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:14:02.83524105 +0000 UTC m=+386.384300643" watchObservedRunningTime="2026-07-08 23:14:02.835756306 +0000 UTC m=+386.384815899"
Jul 08 23:14:12.076996 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:12.076942    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:12.077576 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:12.077029    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:12.082062 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:12.082030    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:12.859825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:12.859796    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:14:12.903918 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:12.903881    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f746b9647-5lddc"]
Jul 08 23:14:37.931465 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:37.931409    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f746b9647-5lddc" podUID="ba4afc36-06e3-452a-a7fa-866f317c1427" containerName="console" containerID="cri-o://deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7" gracePeriod=15
Jul 08 23:14:38.172378 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.172355    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:14:38.251760 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.251684    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-trusted-ca-bundle\") pod \"ba4afc36-06e3-452a-a7fa-866f317c1427\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") "
Jul 08 23:14:38.251760 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.251722    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-service-ca\") pod \"ba4afc36-06e3-452a-a7fa-866f317c1427\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") "
Jul 08 23:14:38.251967 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.251766    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-serving-cert\") pod \"ba4afc36-06e3-452a-a7fa-866f317c1427\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") "
Jul 08 23:14:38.251967 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.251796    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-console-config\") pod \"ba4afc36-06e3-452a-a7fa-866f317c1427\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") "
Jul 08 23:14:38.251967 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.251820    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-oauth-serving-cert\") pod \"ba4afc36-06e3-452a-a7fa-866f317c1427\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") "
Jul 08 23:14:38.251967 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.251840    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7z7t\" (UniqueName: \"kubernetes.io/projected/ba4afc36-06e3-452a-a7fa-866f317c1427-kube-api-access-r7z7t\") pod \"ba4afc36-06e3-452a-a7fa-866f317c1427\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") "
Jul 08 23:14:38.251967 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.251873    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-oauth-config\") pod \"ba4afc36-06e3-452a-a7fa-866f317c1427\" (UID: \"ba4afc36-06e3-452a-a7fa-866f317c1427\") "
Jul 08 23:14:38.252213 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.252144    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba4afc36-06e3-452a-a7fa-866f317c1427" (UID: "ba4afc36-06e3-452a-a7fa-866f317c1427"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:14:38.252302 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.252271    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba4afc36-06e3-452a-a7fa-866f317c1427" (UID: "ba4afc36-06e3-452a-a7fa-866f317c1427"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:14:38.252302 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.252285    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba4afc36-06e3-452a-a7fa-866f317c1427" (UID: "ba4afc36-06e3-452a-a7fa-866f317c1427"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:14:38.252447 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.252323    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-console-config" (OuterVolumeSpecName: "console-config") pod "ba4afc36-06e3-452a-a7fa-866f317c1427" (UID: "ba4afc36-06e3-452a-a7fa-866f317c1427"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:14:38.254134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.254110    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba4afc36-06e3-452a-a7fa-866f317c1427" (UID: "ba4afc36-06e3-452a-a7fa-866f317c1427"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:14:38.254134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.254128    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba4afc36-06e3-452a-a7fa-866f317c1427" (UID: "ba4afc36-06e3-452a-a7fa-866f317c1427"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:14:38.254244 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.254114    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba4afc36-06e3-452a-a7fa-866f317c1427-kube-api-access-r7z7t" (OuterVolumeSpecName: "kube-api-access-r7z7t") pod "ba4afc36-06e3-452a-a7fa-866f317c1427" (UID: "ba4afc36-06e3-452a-a7fa-866f317c1427"). InnerVolumeSpecName "kube-api-access-r7z7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:14:38.352376 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.352346    2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-console-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:14:38.352376 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.352374    2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-oauth-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:14:38.352630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.352387    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7z7t\" (UniqueName: \"kubernetes.io/projected/ba4afc36-06e3-452a-a7fa-866f317c1427-kube-api-access-r7z7t\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:14:38.352630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.352400    2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-oauth-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:14:38.352630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.352413    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-trusted-ca-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:14:38.352630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.352425    2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba4afc36-06e3-452a-a7fa-866f317c1427-service-ca\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:14:38.352630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.352436    2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba4afc36-06e3-452a-a7fa-866f317c1427-console-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:14:38.958489 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.958452    2586 generic.go:356] "Generic (PLEG): container finished" podID="ba4afc36-06e3-452a-a7fa-866f317c1427" containerID="deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7" exitCode=0
Jul 08 23:14:38.958945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.958500    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f746b9647-5lddc"
Jul 08 23:14:38.958945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.958548    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f746b9647-5lddc" event={"ID":"ba4afc36-06e3-452a-a7fa-866f317c1427","Type":"ContainerDied","Data":"deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7"}
Jul 08 23:14:38.958945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.958597    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f746b9647-5lddc" event={"ID":"ba4afc36-06e3-452a-a7fa-866f317c1427","Type":"ContainerDied","Data":"6549019b9162037aa4a49298b71e38f4d5beb8623d0651f3923f4b8f0953cb0a"}
Jul 08 23:14:38.958945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.958626    2586 scope.go:117] "RemoveContainer" containerID="deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7"
Jul 08 23:14:38.967241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.967224    2586 scope.go:117] "RemoveContainer" containerID="deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7"
Jul 08 23:14:38.967478 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:14:38.967460    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7\": container with ID starting with deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7 not found: ID does not exist" containerID="deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7"
Jul 08 23:14:38.967539 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.967487    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7"} err="failed to get container status \"deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7\": rpc error: code = NotFound desc = could not find container \"deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7\": container with ID starting with deaed5ad0e14959198bf3d1ae9641e06a79887f194cdb0f1d2a980de41cf0ce7 not found: ID does not exist"
Jul 08 23:14:38.984178 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.979740    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f746b9647-5lddc"]
Jul 08 23:14:38.985920 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:38.985901    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f746b9647-5lddc"]
Jul 08 23:14:39.531319 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:14:39.531286    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba4afc36-06e3-452a-a7fa-866f317c1427" path="/var/lib/kubelet/pods/ba4afc36-06e3-452a-a7fa-866f317c1427/volumes"
Jul 08 23:15:11.800221 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.800192    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"]
Jul 08 23:15:11.800671 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.800459    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4afc36-06e3-452a-a7fa-866f317c1427" containerName="console"
Jul 08 23:15:11.800671 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.800470    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4afc36-06e3-452a-a7fa-866f317c1427" containerName="console"
Jul 08 23:15:11.800671 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.800515    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba4afc36-06e3-452a-a7fa-866f317c1427" containerName="console"
Jul 08 23:15:11.803249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.803234    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:11.805940 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.805919    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 23:15:11.806073 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.805973    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 23:15:11.806951 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.806932    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lqpd2\""
Jul 08 23:15:11.811381 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.811347    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"]
Jul 08 23:15:11.888902 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.888881    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:11.889025 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.888914    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c476v\" (UniqueName: \"kubernetes.io/projected/6814cae4-8f93-4f99-aff3-380eca1ce465-kube-api-access-c476v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:11.889025 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.888933    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:11.990252 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.990210    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c476v\" (UniqueName: \"kubernetes.io/projected/6814cae4-8f93-4f99-aff3-380eca1ce465-kube-api-access-c476v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:11.990352 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.990260    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:11.990389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.990350    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:11.990663 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.990647    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:11.990717 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.990701    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:12.001098 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:11.999751    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c476v\" (UniqueName: \"kubernetes.io/projected/6814cae4-8f93-4f99-aff3-380eca1ce465-kube-api-access-c476v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:12.112208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:12.112183    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:12.235178 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:12.235154    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"]
Jul 08 23:15:12.237479 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:15:12.237452    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6814cae4_8f93_4f99_aff3_380eca1ce465.slice/crio-67f22a1bb4ece0639bcf8b2375efb75d5287e01e46dfb2caa0f5004f5b860959 WatchSource:0}: Error finding container 67f22a1bb4ece0639bcf8b2375efb75d5287e01e46dfb2caa0f5004f5b860959: Status 404 returned error can't find the container with id 67f22a1bb4ece0639bcf8b2375efb75d5287e01e46dfb2caa0f5004f5b860959
Jul 08 23:15:13.086420 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:13.086386    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq" event={"ID":"6814cae4-8f93-4f99-aff3-380eca1ce465","Type":"ContainerStarted","Data":"67f22a1bb4ece0639bcf8b2375efb75d5287e01e46dfb2caa0f5004f5b860959"}
Jul 08 23:15:19.111500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:19.111466    2586 generic.go:356] "Generic (PLEG): container finished" podID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerID="e42e080c141a94fb109dba69b2b8e108680a3d07f46be44e19fdc0e411e91d98" exitCode=0
Jul 08 23:15:19.111500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:19.111502    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq" event={"ID":"6814cae4-8f93-4f99-aff3-380eca1ce465","Type":"ContainerDied","Data":"e42e080c141a94fb109dba69b2b8e108680a3d07f46be44e19fdc0e411e91d98"}
Jul 08 23:15:21.121105 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:21.121080    2586 generic.go:356] "Generic (PLEG): container finished" podID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerID="c9236fdd28aa39a2816695beb7a9cae3e6765624a2d5698ebd0c86b9d63d2bd5" exitCode=0
Jul 08 23:15:21.121421 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:21.121139    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq" event={"ID":"6814cae4-8f93-4f99-aff3-380eca1ce465","Type":"ContainerDied","Data":"c9236fdd28aa39a2816695beb7a9cae3e6765624a2d5698ebd0c86b9d63d2bd5"}
Jul 08 23:15:27.148067 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:27.148000    2586 generic.go:356] "Generic (PLEG): container finished" podID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerID="36b21cfe29026f2e4287c6b354115ba532e10e63680ec335c3cf47f46d1bb5b7" exitCode=0
Jul 08 23:15:27.148067 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:27.148064    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq" event={"ID":"6814cae4-8f93-4f99-aff3-380eca1ce465","Type":"ContainerDied","Data":"36b21cfe29026f2e4287c6b354115ba532e10e63680ec335c3cf47f46d1bb5b7"}
Jul 08 23:15:28.282264 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.282244    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:28.324812 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.324787    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-util\") pod \"6814cae4-8f93-4f99-aff3-380eca1ce465\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") "
Jul 08 23:15:28.324938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.324832    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c476v\" (UniqueName: \"kubernetes.io/projected/6814cae4-8f93-4f99-aff3-380eca1ce465-kube-api-access-c476v\") pod \"6814cae4-8f93-4f99-aff3-380eca1ce465\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") "
Jul 08 23:15:28.324938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.324866    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-bundle\") pod \"6814cae4-8f93-4f99-aff3-380eca1ce465\" (UID: \"6814cae4-8f93-4f99-aff3-380eca1ce465\") "
Jul 08 23:15:28.325452 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.325429    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-bundle" (OuterVolumeSpecName: "bundle") pod "6814cae4-8f93-4f99-aff3-380eca1ce465" (UID: "6814cae4-8f93-4f99-aff3-380eca1ce465"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:28.326907 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.326887    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6814cae4-8f93-4f99-aff3-380eca1ce465-kube-api-access-c476v" (OuterVolumeSpecName: "kube-api-access-c476v") pod "6814cae4-8f93-4f99-aff3-380eca1ce465" (UID: "6814cae4-8f93-4f99-aff3-380eca1ce465"). InnerVolumeSpecName "kube-api-access-c476v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:28.328795 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.328773    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-util" (OuterVolumeSpecName: "util") pod "6814cae4-8f93-4f99-aff3-380eca1ce465" (UID: "6814cae4-8f93-4f99-aff3-380eca1ce465"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:28.425728 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.425667    2586 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:15:28.425728 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.425688    2586 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6814cae4-8f93-4f99-aff3-380eca1ce465-util\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:15:28.425728 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:28.425702    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c476v\" (UniqueName: \"kubernetes.io/projected/6814cae4-8f93-4f99-aff3-380eca1ce465-kube-api-access-c476v\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:15:29.157449 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:29.157411    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq" event={"ID":"6814cae4-8f93-4f99-aff3-380eca1ce465","Type":"ContainerDied","Data":"67f22a1bb4ece0639bcf8b2375efb75d5287e01e46dfb2caa0f5004f5b860959"}
Jul 08 23:15:29.157449 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:29.157437    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409sdwq"
Jul 08 23:15:29.157679 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:29.157465    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67f22a1bb4ece0639bcf8b2375efb75d5287e01e46dfb2caa0f5004f5b860959"
Jul 08 23:15:34.740343 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.740311    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"]
Jul 08 23:15:34.740723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.740590    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerName="pull"
Jul 08 23:15:34.740723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.740601    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerName="pull"
Jul 08 23:15:34.740723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.740609    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerName="extract"
Jul 08 23:15:34.740723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.740614    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerName="extract"
Jul 08 23:15:34.740723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.740631    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerName="util"
Jul 08 23:15:34.740723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.740637    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerName="util"
Jul 08 23:15:34.740723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.740690    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6814cae4-8f93-4f99-aff3-380eca1ce465" containerName="extract"
Jul 08 23:15:34.743506 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.743491    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"
Jul 08 23:15:34.745987 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.745964    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 08 23:15:34.746143 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.746059    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 08 23:15:34.746279 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.746267    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ljs5t\""
Jul 08 23:15:34.755836 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.755817    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"]
Jul 08 23:15:34.874834 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.874808    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd1eedf-6876-49da-b411-7618b3e50c88-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhnb6\" (UID: \"0fd1eedf-6876-49da-b411-7618b3e50c88\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"
Jul 08 23:15:34.874952 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.874851    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wltdq\" (UniqueName: \"kubernetes.io/projected/0fd1eedf-6876-49da-b411-7618b3e50c88-kube-api-access-wltdq\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhnb6\" (UID: \"0fd1eedf-6876-49da-b411-7618b3e50c88\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"
Jul 08 23:15:34.975942 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.975910    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd1eedf-6876-49da-b411-7618b3e50c88-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhnb6\" (UID: \"0fd1eedf-6876-49da-b411-7618b3e50c88\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"
Jul 08 23:15:34.975942 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.975947    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wltdq\" (UniqueName: \"kubernetes.io/projected/0fd1eedf-6876-49da-b411-7618b3e50c88-kube-api-access-wltdq\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhnb6\" (UID: \"0fd1eedf-6876-49da-b411-7618b3e50c88\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"
Jul 08 23:15:34.976255 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.976237    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd1eedf-6876-49da-b411-7618b3e50c88-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhnb6\" (UID: \"0fd1eedf-6876-49da-b411-7618b3e50c88\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"
Jul 08 23:15:34.983806 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:34.983781    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wltdq\" (UniqueName: \"kubernetes.io/projected/0fd1eedf-6876-49da-b411-7618b3e50c88-kube-api-access-wltdq\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhnb6\" (UID: \"0fd1eedf-6876-49da-b411-7618b3e50c88\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"
Jul 08 23:15:35.052788 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:35.052724    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"
Jul 08 23:15:35.180141 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:35.180114    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6"]
Jul 08 23:15:35.184008 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:15:35.183982    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd1eedf_6876_49da_b411_7618b3e50c88.slice/crio-46f6f815f2deb027765a775c14809e5137854b3780c8c74ece669dc7e21f2a19 WatchSource:0}: Error finding container 46f6f815f2deb027765a775c14809e5137854b3780c8c74ece669dc7e21f2a19: Status 404 returned error can't find the container with id 46f6f815f2deb027765a775c14809e5137854b3780c8c74ece669dc7e21f2a19
Jul 08 23:15:36.191639 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:36.191604    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6" event={"ID":"0fd1eedf-6876-49da-b411-7618b3e50c88","Type":"ContainerStarted","Data":"46f6f815f2deb027765a775c14809e5137854b3780c8c74ece669dc7e21f2a19"}
Jul 08 23:15:38.202594 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:38.202552    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6" event={"ID":"0fd1eedf-6876-49da-b411-7618b3e50c88","Type":"ContainerStarted","Data":"a4ab019a390b593baeb7be5d81de16fa50852d6c54084aac5e2c0428c85dd8cc"}
Jul 08 23:15:38.222490 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:38.222443    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhnb6" podStartSLOduration=1.668941098 podStartE2EDuration="4.222426711s" totalImagesPullingTime="2.553485613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:38.221335048 +0000 UTC m=+481.770394643" watchObservedRunningTime="2026-07-08 23:15:38.222426711 +0000 UTC m=+481.771486308"
Jul 08 23:15:39.091671 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.091641    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"]
Jul 08 23:15:39.095083 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.095063    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.097739 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.097715    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 23:15:39.098451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.098438    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 23:15:39.098507 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.098438    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lqpd2\""
Jul 08 23:15:39.103028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.103003    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"]
Jul 08 23:15:39.210121 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.210096    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.210483 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.210153    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxrhz\" (UniqueName: \"kubernetes.io/projected/832f05ea-1eb0-409e-8496-c33fe9892028-kube-api-access-cxrhz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.210483 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.210178    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.310958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.310924    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxrhz\" (UniqueName: \"kubernetes.io/projected/832f05ea-1eb0-409e-8496-c33fe9892028-kube-api-access-cxrhz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.310958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.310960    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.311196 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.311004    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.311375 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.311357    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.311424 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.311390    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.320773 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.320746    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxrhz\" (UniqueName: \"kubernetes.io/projected/832f05ea-1eb0-409e-8496-c33fe9892028-kube-api-access-cxrhz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.405502 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.405480    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:39.531955 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:15:39.531931    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832f05ea_1eb0_409e_8496_c33fe9892028.slice/crio-a9ccd369084cd719e6e4503eb07fda18b1f940a37ca353feb56a6379dec0ba3b WatchSource:0}: Error finding container a9ccd369084cd719e6e4503eb07fda18b1f940a37ca353feb56a6379dec0ba3b: Status 404 returned error can't find the container with id a9ccd369084cd719e6e4503eb07fda18b1f940a37ca353feb56a6379dec0ba3b
Jul 08 23:15:39.533065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:39.533043    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"]
Jul 08 23:15:40.211642 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.211608    2586 generic.go:356] "Generic (PLEG): container finished" podID="832f05ea-1eb0-409e-8496-c33fe9892028" containerID="106ce0fc71990489f2a0b6fce04c30c5f3d468fac05b92e28975b46d60a9437b" exitCode=0
Jul 08 23:15:40.211978 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.211689    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl" event={"ID":"832f05ea-1eb0-409e-8496-c33fe9892028","Type":"ContainerDied","Data":"106ce0fc71990489f2a0b6fce04c30c5f3d468fac05b92e28975b46d60a9437b"}
Jul 08 23:15:40.211978 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.211735    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl" event={"ID":"832f05ea-1eb0-409e-8496-c33fe9892028","Type":"ContainerStarted","Data":"a9ccd369084cd719e6e4503eb07fda18b1f940a37ca353feb56a6379dec0ba3b"}
Jul 08 23:15:40.663356 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.663280    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"]
Jul 08 23:15:40.666723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.666698    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"
Jul 08 23:15:40.669328 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.669269    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 23:15:40.669328 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.669304    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 23:15:40.669628 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.669571    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dx4gq\""
Jul 08 23:15:40.673201 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.673138    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"]
Jul 08 23:15:40.722578 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.722446    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrz7\" (UniqueName: \"kubernetes.io/projected/050c73a5-cb3f-47f3-9d67-d8a42cc29fa2-kube-api-access-qfrz7\") pod \"cert-manager-cainjector-559cdd8c87-g5d9d\" (UID: \"050c73a5-cb3f-47f3-9d67-d8a42cc29fa2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"
Jul 08 23:15:40.722578 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.722493    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/050c73a5-cb3f-47f3-9d67-d8a42cc29fa2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g5d9d\" (UID: \"050c73a5-cb3f-47f3-9d67-d8a42cc29fa2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"
Jul 08 23:15:40.823875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.823849    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrz7\" (UniqueName: \"kubernetes.io/projected/050c73a5-cb3f-47f3-9d67-d8a42cc29fa2-kube-api-access-qfrz7\") pod \"cert-manager-cainjector-559cdd8c87-g5d9d\" (UID: \"050c73a5-cb3f-47f3-9d67-d8a42cc29fa2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"
Jul 08 23:15:40.824019 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.823892    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/050c73a5-cb3f-47f3-9d67-d8a42cc29fa2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g5d9d\" (UID: \"050c73a5-cb3f-47f3-9d67-d8a42cc29fa2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"
Jul 08 23:15:40.832298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.832266    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/050c73a5-cb3f-47f3-9d67-d8a42cc29fa2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g5d9d\" (UID: \"050c73a5-cb3f-47f3-9d67-d8a42cc29fa2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"
Jul 08 23:15:40.832554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.832489    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrz7\" (UniqueName: \"kubernetes.io/projected/050c73a5-cb3f-47f3-9d67-d8a42cc29fa2-kube-api-access-qfrz7\") pod \"cert-manager-cainjector-559cdd8c87-g5d9d\" (UID: \"050c73a5-cb3f-47f3-9d67-d8a42cc29fa2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"
Jul 08 23:15:40.979375 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:40.979296    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"
Jul 08 23:15:41.110540 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:41.110496    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d"]
Jul 08 23:15:41.112422 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:15:41.112390    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod050c73a5_cb3f_47f3_9d67_d8a42cc29fa2.slice/crio-dc063e67fc66fd9e44218c72e1f345fab4b820fb6d3adbf5ccaae7366b93e51a WatchSource:0}: Error finding container dc063e67fc66fd9e44218c72e1f345fab4b820fb6d3adbf5ccaae7366b93e51a: Status 404 returned error can't find the container with id dc063e67fc66fd9e44218c72e1f345fab4b820fb6d3adbf5ccaae7366b93e51a
Jul 08 23:15:41.217602 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:41.217571    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d" event={"ID":"050c73a5-cb3f-47f3-9d67-d8a42cc29fa2","Type":"ContainerStarted","Data":"dc063e67fc66fd9e44218c72e1f345fab4b820fb6d3adbf5ccaae7366b93e51a"}
Jul 08 23:15:42.223642 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:42.223607    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl" event={"ID":"832f05ea-1eb0-409e-8496-c33fe9892028","Type":"ContainerStarted","Data":"2e1a409e90901333be4d817e1430d6d313d2605599088801db50ea5669da7a7f"}
Jul 08 23:15:43.230480 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:43.230449    2586 generic.go:356] "Generic (PLEG): container finished" podID="832f05ea-1eb0-409e-8496-c33fe9892028" containerID="2e1a409e90901333be4d817e1430d6d313d2605599088801db50ea5669da7a7f" exitCode=0
Jul 08 23:15:43.230879 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:43.230551    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl" event={"ID":"832f05ea-1eb0-409e-8496-c33fe9892028","Type":"ContainerDied","Data":"2e1a409e90901333be4d817e1430d6d313d2605599088801db50ea5669da7a7f"}
Jul 08 23:15:44.236982 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:44.236951    2586 generic.go:356] "Generic (PLEG): container finished" podID="832f05ea-1eb0-409e-8496-c33fe9892028" containerID="df64daa444c0602951048ddf24bcca935b43530d5893dc2abda63b8c3f60e059" exitCode=0
Jul 08 23:15:44.237340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:44.237016    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl" event={"ID":"832f05ea-1eb0-409e-8496-c33fe9892028","Type":"ContainerDied","Data":"df64daa444c0602951048ddf24bcca935b43530d5893dc2abda63b8c3f60e059"}
Jul 08 23:15:45.363756 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.363731    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:45.461488 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.461461    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-util\") pod \"832f05ea-1eb0-409e-8496-c33fe9892028\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") "
Jul 08 23:15:45.461620 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.461501    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-bundle\") pod \"832f05ea-1eb0-409e-8496-c33fe9892028\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") "
Jul 08 23:15:45.461620 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.461565    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxrhz\" (UniqueName: \"kubernetes.io/projected/832f05ea-1eb0-409e-8496-c33fe9892028-kube-api-access-cxrhz\") pod \"832f05ea-1eb0-409e-8496-c33fe9892028\" (UID: \"832f05ea-1eb0-409e-8496-c33fe9892028\") "
Jul 08 23:15:45.461869 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.461848    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-bundle" (OuterVolumeSpecName: "bundle") pod "832f05ea-1eb0-409e-8496-c33fe9892028" (UID: "832f05ea-1eb0-409e-8496-c33fe9892028"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:45.463622 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.463601    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/832f05ea-1eb0-409e-8496-c33fe9892028-kube-api-access-cxrhz" (OuterVolumeSpecName: "kube-api-access-cxrhz") pod "832f05ea-1eb0-409e-8496-c33fe9892028" (UID: "832f05ea-1eb0-409e-8496-c33fe9892028"). InnerVolumeSpecName "kube-api-access-cxrhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:15:45.465765 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.465744    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-util" (OuterVolumeSpecName: "util") pod "832f05ea-1eb0-409e-8496-c33fe9892028" (UID: "832f05ea-1eb0-409e-8496-c33fe9892028"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:15:45.562796 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.562771    2586 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:15:45.562796 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.562795    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxrhz\" (UniqueName: \"kubernetes.io/projected/832f05ea-1eb0-409e-8496-c33fe9892028-kube-api-access-cxrhz\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:15:45.562923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:45.562805    2586 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832f05ea-1eb0-409e-8496-c33fe9892028-util\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:15:46.247245 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:46.247210    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl" event={"ID":"832f05ea-1eb0-409e-8496-c33fe9892028","Type":"ContainerDied","Data":"a9ccd369084cd719e6e4503eb07fda18b1f940a37ca353feb56a6379dec0ba3b"}
Jul 08 23:15:46.247245 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:46.247224    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7lckl"
Jul 08 23:15:46.247245 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:46.247253    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9ccd369084cd719e6e4503eb07fda18b1f940a37ca353feb56a6379dec0ba3b"
Jul 08 23:15:58.270888 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.270859    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"]
Jul 08 23:15:58.271269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.271130    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832f05ea-1eb0-409e-8496-c33fe9892028" containerName="util"
Jul 08 23:15:58.271269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.271140    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="832f05ea-1eb0-409e-8496-c33fe9892028" containerName="util"
Jul 08 23:15:58.271269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.271159    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832f05ea-1eb0-409e-8496-c33fe9892028" containerName="extract"
Jul 08 23:15:58.271269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.271165    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="832f05ea-1eb0-409e-8496-c33fe9892028" containerName="extract"
Jul 08 23:15:58.271269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.271172    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832f05ea-1eb0-409e-8496-c33fe9892028" containerName="pull"
Jul 08 23:15:58.271269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.271178    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="832f05ea-1eb0-409e-8496-c33fe9892028" containerName="pull"
Jul 08 23:15:58.271269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.271224    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="832f05ea-1eb0-409e-8496-c33fe9892028" containerName="extract"
Jul 08 23:15:58.297965 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.297935    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"]
Jul 08 23:15:58.298115 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.298034    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.300587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.300548    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 23:15:58.300587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.300565    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 23:15:58.301879 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.301828    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lqpd2\""
Jul 08 23:15:58.466690 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.466656    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.466894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.466710    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.466894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.466771    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn9bx\" (UniqueName: \"kubernetes.io/projected/a3003568-519d-4a92-8b8f-9094dafe5f29-kube-api-access-fn9bx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.567669 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.567593    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.567669 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.567644    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.567669 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.567666    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn9bx\" (UniqueName: \"kubernetes.io/projected/a3003568-519d-4a92-8b8f-9094dafe5f29-kube-api-access-fn9bx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.567990 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.567970    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.568034 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.567976    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.576384 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.576363    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn9bx\" (UniqueName: \"kubernetes.io/projected/a3003568-519d-4a92-8b8f-9094dafe5f29-kube-api-access-fn9bx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.611840 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.611818    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:15:58.752146 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:58.752118    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"]
Jul 08 23:15:58.754620 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:15:58.754590    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3003568_519d_4a92_8b8f_9094dafe5f29.slice/crio-3b0ab60ecedf02e960a4c8a2500451fd253fdf4b88201b539a4008a9dafe6dd0 WatchSource:0}: Error finding container 3b0ab60ecedf02e960a4c8a2500451fd253fdf4b88201b539a4008a9dafe6dd0: Status 404 returned error can't find the container with id 3b0ab60ecedf02e960a4c8a2500451fd253fdf4b88201b539a4008a9dafe6dd0
Jul 08 23:15:59.301731 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:59.301701    2586 generic.go:356] "Generic (PLEG): container finished" podID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerID="50aff1705ba5fda3bca3e2407bb0dad2b1d27b393d5e5f4ca7febe740d8c45c2" exitCode=0
Jul 08 23:15:59.302225 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:59.301782    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77" event={"ID":"a3003568-519d-4a92-8b8f-9094dafe5f29","Type":"ContainerDied","Data":"50aff1705ba5fda3bca3e2407bb0dad2b1d27b393d5e5f4ca7febe740d8c45c2"}
Jul 08 23:15:59.302225 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:15:59.301841    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77" event={"ID":"a3003568-519d-4a92-8b8f-9094dafe5f29","Type":"ContainerStarted","Data":"3b0ab60ecedf02e960a4c8a2500451fd253fdf4b88201b539a4008a9dafe6dd0"}
Jul 08 23:16:00.308376 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:00.308336    2586 generic.go:356] "Generic (PLEG): container finished" podID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerID="943e3c0ac49055792625a1ed2940fb00c171553d02f5fe19061cccaf3020f6a6" exitCode=0
Jul 08 23:16:00.308863 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:00.308387    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77" event={"ID":"a3003568-519d-4a92-8b8f-9094dafe5f29","Type":"ContainerDied","Data":"943e3c0ac49055792625a1ed2940fb00c171553d02f5fe19061cccaf3020f6a6"}
Jul 08 23:16:01.314376 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:01.314342    2586 generic.go:356] "Generic (PLEG): container finished" podID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerID="031f302caca657dc11a692e5c2987c34ed255816320f9fa05b3af94f05d705ee" exitCode=0
Jul 08 23:16:01.314376 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:01.314377    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77" event={"ID":"a3003568-519d-4a92-8b8f-9094dafe5f29","Type":"ContainerDied","Data":"031f302caca657dc11a692e5c2987c34ed255816320f9fa05b3af94f05d705ee"}
Jul 08 23:16:02.436705 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.436685    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:16:02.599892 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.599872    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn9bx\" (UniqueName: \"kubernetes.io/projected/a3003568-519d-4a92-8b8f-9094dafe5f29-kube-api-access-fn9bx\") pod \"a3003568-519d-4a92-8b8f-9094dafe5f29\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") "
Jul 08 23:16:02.600033 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.599917    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-bundle\") pod \"a3003568-519d-4a92-8b8f-9094dafe5f29\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") "
Jul 08 23:16:02.600033 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.599984    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-util\") pod \"a3003568-519d-4a92-8b8f-9094dafe5f29\" (UID: \"a3003568-519d-4a92-8b8f-9094dafe5f29\") "
Jul 08 23:16:02.600651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.600614    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-bundle" (OuterVolumeSpecName: "bundle") pod "a3003568-519d-4a92-8b8f-9094dafe5f29" (UID: "a3003568-519d-4a92-8b8f-9094dafe5f29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:02.601941 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.601916    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3003568-519d-4a92-8b8f-9094dafe5f29-kube-api-access-fn9bx" (OuterVolumeSpecName: "kube-api-access-fn9bx") pod "a3003568-519d-4a92-8b8f-9094dafe5f29" (UID: "a3003568-519d-4a92-8b8f-9094dafe5f29"). InnerVolumeSpecName "kube-api-access-fn9bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:02.605537 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.605482    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-util" (OuterVolumeSpecName: "util") pod "a3003568-519d-4a92-8b8f-9094dafe5f29" (UID: "a3003568-519d-4a92-8b8f-9094dafe5f29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:02.700926 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.700898    2586 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-util\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:02.700926 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.700923    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn9bx\" (UniqueName: \"kubernetes.io/projected/a3003568-519d-4a92-8b8f-9094dafe5f29-kube-api-access-fn9bx\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:02.700926 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:02.700933    2586 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3003568-519d-4a92-8b8f-9094dafe5f29-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:03.324861 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:03.324838    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77"
Jul 08 23:16:03.325025 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:03.324834    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4wz77" event={"ID":"a3003568-519d-4a92-8b8f-9094dafe5f29","Type":"ContainerDied","Data":"3b0ab60ecedf02e960a4c8a2500451fd253fdf4b88201b539a4008a9dafe6dd0"}
Jul 08 23:16:03.325025 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:03.324956    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b0ab60ecedf02e960a4c8a2500451fd253fdf4b88201b539a4008a9dafe6dd0"
Jul 08 23:16:08.349168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:08.349138    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d" event={"ID":"050c73a5-cb3f-47f3-9d67-d8a42cc29fa2","Type":"ContainerStarted","Data":"9f12e41a2af265e59d47ba822a20fa1cc22ca127b2b44b2dd315522a410f0aca"}
Jul 08 23:16:08.395354 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:08.395301    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g5d9d" podStartSLOduration=1.935078837 podStartE2EDuration="28.395285063s" totalImagesPullingTime="26.460206226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:08.39290848 +0000 UTC m=+511.941968071" watchObservedRunningTime="2026-07-08 23:16:08.395285063 +0000 UTC m=+511.944344655"
Jul 08 23:16:15.255674 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.255636    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"]
Jul 08 23:16:15.256167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.256082    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerName="util"
Jul 08 23:16:15.256167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.256099    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerName="util"
Jul 08 23:16:15.256167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.256113    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerName="pull"
Jul 08 23:16:15.256167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.256121    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerName="pull"
Jul 08 23:16:15.256167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.256150    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerName="extract"
Jul 08 23:16:15.256167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.256158    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerName="extract"
Jul 08 23:16:15.256458 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.256239    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3003568-519d-4a92-8b8f-9094dafe5f29" containerName="extract"
Jul 08 23:16:15.260715 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.260695    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.263556 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.263532    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 23:16:15.263755 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.263738    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 23:16:15.263911 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.263894    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 23:16:15.264020 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.264001    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k6v7k\""
Jul 08 23:16:15.264068 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.264039    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 23:16:15.273658 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.273637    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"]
Jul 08 23:16:15.293949 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.293922    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj5pj\" (UniqueName: \"kubernetes.io/projected/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-kube-api-access-dj5pj\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.294042 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.293978    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.294130 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.294057    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-tmp\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.294130 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.294114    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.294227 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.294158    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-manifests\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.395239 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.395204    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-tmp\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.395239 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.395242    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.395500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.395268    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-manifests\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.395500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.395293    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj5pj\" (UniqueName: \"kubernetes.io/projected/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-kube-api-access-dj5pj\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.395500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.395325    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.395853 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.395786    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-manifests\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.397683 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.397659    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-tmp\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.397785 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.397771    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.397822 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.397784    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.407954 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.407928    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj5pj\" (UniqueName: \"kubernetes.io/projected/be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84-kube-api-access-dj5pj\") pod \"opendatahub-operator-controller-manager-7b86895794-lsvqj\" (UID: \"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.570624 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.570549    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:15.722238 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:15.722211    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"]
Jul 08 23:16:15.723968 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:16:15.723943    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6e6072_9d7d_4b61_a2d7_9e9cd5d56b84.slice/crio-2f5a3a799b9316301b3eace98330720e693f2d0dddea10766c27376946506bb7 WatchSource:0}: Error finding container 2f5a3a799b9316301b3eace98330720e693f2d0dddea10766c27376946506bb7: Status 404 returned error can't find the container with id 2f5a3a799b9316301b3eace98330720e693f2d0dddea10766c27376946506bb7
Jul 08 23:16:16.384099 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:16.384066    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj" event={"ID":"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84","Type":"ContainerStarted","Data":"2f5a3a799b9316301b3eace98330720e693f2d0dddea10766c27376946506bb7"}
Jul 08 23:16:19.400574 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:19.400539    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj" event={"ID":"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84","Type":"ContainerStarted","Data":"b11b2f2b3efd29ba868f5efd225e7787895a1c61795f3796b4ccf4851b45420e"}
Jul 08 23:16:20.406654 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:20.406618    2586 generic.go:356] "Generic (PLEG): container finished" podID="be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84" containerID="b11b2f2b3efd29ba868f5efd225e7787895a1c61795f3796b4ccf4851b45420e" exitCode=0
Jul 08 23:16:20.407042 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:20.406708    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj" event={"ID":"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84","Type":"ContainerDied","Data":"b11b2f2b3efd29ba868f5efd225e7787895a1c61795f3796b4ccf4851b45420e"}
Jul 08 23:16:21.412311 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:21.412276    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj" event={"ID":"be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84","Type":"ContainerStarted","Data":"136909808f4ae8a246c98f03065249a52b8a99f86680006e4d363232e35decc6"}
Jul 08 23:16:21.412742 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:21.412385    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:21.449846 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:21.449806    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj" podStartSLOduration=1.9616657800000001 podStartE2EDuration="6.449791924s" totalImagesPullingTime="3.402659818s" totalInitContainerRuntime="1.085466326s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:21.448026395 +0000 UTC m=+524.997085987" watchObservedRunningTime="2026-07-08 23:16:21.449791924 +0000 UTC m=+524.998851576"
Jul 08 23:16:32.419567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:32.419472    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-lsvqj"
Jul 08 23:16:37.450347 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.450309    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drc67"]
Jul 08 23:16:37.455314 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.455293    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:37.492686 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.492664    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 23:16:37.571116 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.571091    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25pbq\" (UniqueName: \"kubernetes.io/projected/96ae783b-d769-4140-ade2-159d65dcdf83-kube-api-access-25pbq\") pod \"model-serving-api-54d89bd5fc-drc67\" (UID: \"96ae783b-d769-4140-ade2-159d65dcdf83\") " pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:37.571231 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.571177    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ae783b-d769-4140-ade2-159d65dcdf83-tls-certs\") pod \"model-serving-api-54d89bd5fc-drc67\" (UID: \"96ae783b-d769-4140-ade2-159d65dcdf83\") " pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:37.657507 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.657458    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drc67"]
Jul 08 23:16:37.672091 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.672061    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25pbq\" (UniqueName: \"kubernetes.io/projected/96ae783b-d769-4140-ade2-159d65dcdf83-kube-api-access-25pbq\") pod \"model-serving-api-54d89bd5fc-drc67\" (UID: \"96ae783b-d769-4140-ade2-159d65dcdf83\") " pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:37.672255 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.672149    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ae783b-d769-4140-ade2-159d65dcdf83-tls-certs\") pod \"model-serving-api-54d89bd5fc-drc67\" (UID: \"96ae783b-d769-4140-ade2-159d65dcdf83\") " pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:37.672327 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:16:37.672276    2586 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 08 23:16:37.672392 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:16:37.672350    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ae783b-d769-4140-ade2-159d65dcdf83-tls-certs podName:96ae783b-d769-4140-ade2-159d65dcdf83 nodeName:}" failed. No retries permitted until 2026-07-08 23:16:38.172329757 +0000 UTC m=+541.721389329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/96ae783b-d769-4140-ade2-159d65dcdf83-tls-certs") pod "model-serving-api-54d89bd5fc-drc67" (UID: "96ae783b-d769-4140-ade2-159d65dcdf83") : secret "model-serving-api-tls" not found
Jul 08 23:16:37.740625 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:37.740554    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25pbq\" (UniqueName: \"kubernetes.io/projected/96ae783b-d769-4140-ade2-159d65dcdf83-kube-api-access-25pbq\") pod \"model-serving-api-54d89bd5fc-drc67\" (UID: \"96ae783b-d769-4140-ade2-159d65dcdf83\") " pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:38.083063 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.082990    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"]
Jul 08 23:16:38.086110 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.086092    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.090782 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.090762    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 23:16:38.091118 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.091101    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 23:16:38.091195 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.091177    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kcgmn\""
Jul 08 23:16:38.115097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.115070    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"]
Jul 08 23:16:38.176339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.176311    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14014473-eccb-4371-95a9-fd3370066aa0-tls-certs\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.176339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.176352    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ae783b-d769-4140-ade2-159d65dcdf83-tls-certs\") pod \"model-serving-api-54d89bd5fc-drc67\" (UID: \"96ae783b-d769-4140-ade2-159d65dcdf83\") " pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:38.176641 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.176383    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmk86\" (UniqueName: \"kubernetes.io/projected/14014473-eccb-4371-95a9-fd3370066aa0-kube-api-access-kmk86\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.176641 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.176415    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14014473-eccb-4371-95a9-fd3370066aa0-tmp\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.178934 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.178910    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ae783b-d769-4140-ade2-159d65dcdf83-tls-certs\") pod \"model-serving-api-54d89bd5fc-drc67\" (UID: \"96ae783b-d769-4140-ade2-159d65dcdf83\") " pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:38.277749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.277716    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14014473-eccb-4371-95a9-fd3370066aa0-tls-certs\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.277945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.277763    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmk86\" (UniqueName: \"kubernetes.io/projected/14014473-eccb-4371-95a9-fd3370066aa0-kube-api-access-kmk86\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.277945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.277795    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14014473-eccb-4371-95a9-fd3370066aa0-tmp\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.277945 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:16:38.277866    2586 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 08 23:16:38.277945 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:16:38.277927    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14014473-eccb-4371-95a9-fd3370066aa0-tls-certs podName:14014473-eccb-4371-95a9-fd3370066aa0 nodeName:}" failed. No retries permitted until 2026-07-08 23:16:38.777913234 +0000 UTC m=+542.326972803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/14014473-eccb-4371-95a9-fd3370066aa0-tls-certs") pod "kube-auth-proxy-7b8998bd98-85tk7" (UID: "14014473-eccb-4371-95a9-fd3370066aa0") : secret "kube-auth-proxy-tls" not found
Jul 08 23:16:38.280590 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.280557    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14014473-eccb-4371-95a9-fd3370066aa0-tmp\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.301826 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.301800    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmk86\" (UniqueName: \"kubernetes.io/projected/14014473-eccb-4371-95a9-fd3370066aa0-kube-api-access-kmk86\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.364780 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.364757    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:38.538658 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:16:38.538631    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ae783b_d769_4140_ade2_159d65dcdf83.slice/crio-fe559db128c3c4d7972f9bf51e7f64402e4a2b24ce6a46851dec3ca3b45d63f9 WatchSource:0}: Error finding container fe559db128c3c4d7972f9bf51e7f64402e4a2b24ce6a46851dec3ca3b45d63f9: Status 404 returned error can't find the container with id fe559db128c3c4d7972f9bf51e7f64402e4a2b24ce6a46851dec3ca3b45d63f9
Jul 08 23:16:38.545267 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.545241    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drc67"]
Jul 08 23:16:38.782799 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.782728    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14014473-eccb-4371-95a9-fd3370066aa0-tls-certs\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.785074 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.785052    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14014473-eccb-4371-95a9-fd3370066aa0-tls-certs\") pod \"kube-auth-proxy-7b8998bd98-85tk7\" (UID: \"14014473-eccb-4371-95a9-fd3370066aa0\") " pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:38.995668 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:38.995639    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"
Jul 08 23:16:39.177328 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:39.175774    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7"]
Jul 08 23:16:39.182959 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:16:39.182908    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14014473_eccb_4371_95a9_fd3370066aa0.slice/crio-537463b26f3e8d9b4741b890ec3ada2cba4f2b26cdabb50381aa49bea4746010 WatchSource:0}: Error finding container 537463b26f3e8d9b4741b890ec3ada2cba4f2b26cdabb50381aa49bea4746010: Status 404 returned error can't find the container with id 537463b26f3e8d9b4741b890ec3ada2cba4f2b26cdabb50381aa49bea4746010
Jul 08 23:16:39.493687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:39.493643    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7" event={"ID":"14014473-eccb-4371-95a9-fd3370066aa0","Type":"ContainerStarted","Data":"537463b26f3e8d9b4741b890ec3ada2cba4f2b26cdabb50381aa49bea4746010"}
Jul 08 23:16:39.495070 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:39.495033    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-drc67" event={"ID":"96ae783b-d769-4140-ade2-159d65dcdf83","Type":"ContainerStarted","Data":"fe559db128c3c4d7972f9bf51e7f64402e4a2b24ce6a46851dec3ca3b45d63f9"}
Jul 08 23:16:40.477823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.477790    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"]
Jul 08 23:16:40.481050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.481035    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.484952 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.484928    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 23:16:40.485079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.484956    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 23:16:40.485079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.484979    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 23:16:40.485079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.484984    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 23:16:40.485079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.484936    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lj5mn\""
Jul 08 23:16:40.500382 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.500363    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"]
Jul 08 23:16:40.502655 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.502580    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-drc67" event={"ID":"96ae783b-d769-4140-ade2-159d65dcdf83","Type":"ContainerStarted","Data":"f38fa413392377208e4e7e0858c792d6331db7c45dbd8d86c71167353e85c8a0"}
Jul 08 23:16:40.502655 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.502636    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:40.599432 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.599394    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-cacerts\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.599628 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.599470    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-token\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.599628 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.599501    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.599628 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.599564    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.599628 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.599600    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6csdw\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-kube-api-access-6csdw\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.599890 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.599691    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b443235a-ec08-4ade-9704-d8c19b4f57a9-local-certs\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.599890 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.599819    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.700467 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.700385    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.700467 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.700419    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.700467 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.700439    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6csdw\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-kube-api-access-6csdw\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.700777 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.700571    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b443235a-ec08-4ade-9704-d8c19b4f57a9-local-certs\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.700777 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.700618    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.700777 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.700688    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-cacerts\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.700933 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.700832    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-token\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.701149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.701128    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.702877 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.702846    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b443235a-ec08-4ade-9704-d8c19b4f57a9-local-certs\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.703060 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.703042    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.703258 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.703243    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-cacerts\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.703351 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.703330    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.711109 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.711084    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6csdw\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-kube-api-access-6csdw\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.711726 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.711709    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-token\") pod \"istiod-openshift-gateway-7574459656-g2scg\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.789503 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.789472    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:40.944015 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.943965    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-drc67" podStartSLOduration=2.130175229 podStartE2EDuration="3.943943784s" totalImagesPullingTime="1.813768555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:40.557113656 +0000 UTC m=+544.106173248" watchObservedRunningTime="2026-07-08 23:16:40.943943784 +0000 UTC m=+544.493003377"
Jul 08 23:16:40.944168 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:40.944153    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"]
Jul 08 23:16:40.946237 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:16:40.946211    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb443235a_ec08_4ade_9704_d8c19b4f57a9.slice/crio-dae675c1a9c69c865d0c77550f81f6d847b5b0717483888d8e5f7523242cf4a6 WatchSource:0}: Error finding container dae675c1a9c69c865d0c77550f81f6d847b5b0717483888d8e5f7523242cf4a6: Status 404 returned error can't find the container with id dae675c1a9c69c865d0c77550f81f6d847b5b0717483888d8e5f7523242cf4a6
Jul 08 23:16:41.509534 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:41.509500    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg" event={"ID":"b443235a-ec08-4ade-9704-d8c19b4f57a9","Type":"ContainerStarted","Data":"dae675c1a9c69c865d0c77550f81f6d847b5b0717483888d8e5f7523242cf4a6"}
Jul 08 23:16:43.521350 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:43.521317    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7" event={"ID":"14014473-eccb-4371-95a9-fd3370066aa0","Type":"ContainerStarted","Data":"1924c3644feade002e374426836b0444cc98bf9ca1785eb92cb8da388c36768f"}
Jul 08 23:16:43.556107 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:43.556057    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b8998bd98-85tk7" podStartSLOduration=1.775048112 podStartE2EDuration="5.55604222s" totalImagesPullingTime="3.780994108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:43.551433306 +0000 UTC m=+547.100492901" watchObservedRunningTime="2026-07-08 23:16:43.55604222 +0000 UTC m=+547.105101812"
Jul 08 23:16:44.719548 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:44.718909    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:16:44.719548 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:44.718998    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:16:45.533043 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:45.533006    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg" event={"ID":"b443235a-ec08-4ade-9704-d8c19b4f57a9","Type":"ContainerStarted","Data":"05a0dcf87f13042345d1592509196ba419b3cf99bb99f52fa8de0d47bdea5575"}
Jul 08 23:16:45.533268 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:45.533251    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:45.535004 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:45.534980    2586 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-g2scg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 23:16:45.535129 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:45.535041    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg" podUID="b443235a-ec08-4ade-9704-d8c19b4f57a9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 23:16:45.587614 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:45.587571    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg" podStartSLOduration=1.817178089 podStartE2EDuration="5.587554832s" totalImagesPullingTime="3.770376743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:45.583657559 +0000 UTC m=+549.132717153" watchObservedRunningTime="2026-07-08 23:16:45.587554832 +0000 UTC m=+549.136614425"
Jul 08 23:16:46.096278 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.096246    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"]
Jul 08 23:16:46.100205 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.100174    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.110899 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.109734    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p8vc5\""
Jul 08 23:16:46.133789 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.133763    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"]
Jul 08 23:16:46.150171 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150145    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.150293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150179    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667e2567-fe6b-44da-a667-baa657a03a6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.150293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150222    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.150293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150245    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.150440 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150307    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667e2567-fe6b-44da-a667-baa657a03a6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.150440 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150347    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28lbt\" (UniqueName: \"kubernetes.io/projected/667e2567-fe6b-44da-a667-baa657a03a6e-kube-api-access-28lbt\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.150510 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150463    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.150510 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150487    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.150510 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.150503    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667e2567-fe6b-44da-a667-baa657a03a6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.251833 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.251801    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.251833 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.251836    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667e2567-fe6b-44da-a667-baa657a03a6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252061 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.251854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28lbt\" (UniqueName: \"kubernetes.io/projected/667e2567-fe6b-44da-a667-baa657a03a6e-kube-api-access-28lbt\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252061 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.251896    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252061 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.251916    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252061 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.251945    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667e2567-fe6b-44da-a667-baa657a03a6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252261 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.252244    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252315 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.252285    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252315 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.252286    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252421 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.252324    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252421 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.252353    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667e2567-fe6b-44da-a667-baa657a03a6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252421 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.252406    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.252776 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.252757    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.253043 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.253025    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667e2567-fe6b-44da-a667-baa657a03a6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.254361 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.254337    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667e2567-fe6b-44da-a667-baa657a03a6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.254691 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.254663    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667e2567-fe6b-44da-a667-baa657a03a6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.297088 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.297065    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28lbt\" (UniqueName: \"kubernetes.io/projected/667e2567-fe6b-44da-a667-baa657a03a6e-kube-api-access-28lbt\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.297213 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.297067    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667e2567-fe6b-44da-a667-baa657a03a6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678782z5\" (UID: \"667e2567-fe6b-44da-a667-baa657a03a6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.415844 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.415757    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:16:46.537947 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.537921    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:46.596598 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:46.596577    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"]
Jul 08 23:16:46.597988 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:16:46.597960    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667e2567_fe6b_44da_a667_baa657a03a6e.slice/crio-3712f3a51d80391f4adb43b02b9ff27d6e9a2f63c9e0e11a2f1b07b594512e1b WatchSource:0}: Error finding container 3712f3a51d80391f4adb43b02b9ff27d6e9a2f63c9e0e11a2f1b07b594512e1b: Status 404 returned error can't find the container with id 3712f3a51d80391f4adb43b02b9ff27d6e9a2f63c9e0e11a2f1b07b594512e1b
Jul 08 23:16:47.542364 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:47.542329    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5" event={"ID":"667e2567-fe6b-44da-a667-baa657a03a6e","Type":"ContainerStarted","Data":"3712f3a51d80391f4adb43b02b9ff27d6e9a2f63c9e0e11a2f1b07b594512e1b"}
Jul 08 23:16:48.921538 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.921496    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"]
Jul 08 23:16:48.925287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.925266    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:48.936552 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.936502    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 08 23:16:48.936661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.936644    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4tl74\""
Jul 08 23:16:48.937473 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.937450    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"]
Jul 08 23:16:48.940093 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.940075    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:48.946174 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.946155    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zgp47\""
Jul 08 23:16:48.946273 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.946159    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 23:16:48.995309 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:48.995283    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"]
Jul 08 23:16:49.046198 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.046167    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"]
Jul 08 23:16:49.075575 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.075546    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a73777e5-e394-4284-acb7-63fe2e210a7d-cert\") pod \"kserve-controller-manager-d6f4b65b8-c6mhn\" (UID: \"a73777e5-e394-4284-acb7-63fe2e210a7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:49.075708 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.075638    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkjnj\" (UniqueName: \"kubernetes.io/projected/a73777e5-e394-4284-acb7-63fe2e210a7d-kube-api-access-fkjnj\") pod \"kserve-controller-manager-d6f4b65b8-c6mhn\" (UID: \"a73777e5-e394-4284-acb7-63fe2e210a7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:49.075708 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.075667    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7979a909-70f9-4c5b-a51f-a363c062fd73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-swk7h\" (UID: \"7979a909-70f9-4c5b-a51f-a363c062fd73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:49.075708 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.075699    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr92f\" (UniqueName: \"kubernetes.io/projected/7979a909-70f9-4c5b-a51f-a363c062fd73-kube-api-access-hr92f\") pod \"llmisvc-controller-manager-777c6bd7d5-swk7h\" (UID: \"7979a909-70f9-4c5b-a51f-a363c062fd73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:49.177035 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.176934    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjnj\" (UniqueName: \"kubernetes.io/projected/a73777e5-e394-4284-acb7-63fe2e210a7d-kube-api-access-fkjnj\") pod \"kserve-controller-manager-d6f4b65b8-c6mhn\" (UID: \"a73777e5-e394-4284-acb7-63fe2e210a7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:49.177035 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.176987    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7979a909-70f9-4c5b-a51f-a363c062fd73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-swk7h\" (UID: \"7979a909-70f9-4c5b-a51f-a363c062fd73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:49.177261 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.177177    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr92f\" (UniqueName: \"kubernetes.io/projected/7979a909-70f9-4c5b-a51f-a363c062fd73-kube-api-access-hr92f\") pod \"llmisvc-controller-manager-777c6bd7d5-swk7h\" (UID: \"7979a909-70f9-4c5b-a51f-a363c062fd73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:49.177330 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.177309    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a73777e5-e394-4284-acb7-63fe2e210a7d-cert\") pod \"kserve-controller-manager-d6f4b65b8-c6mhn\" (UID: \"a73777e5-e394-4284-acb7-63fe2e210a7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:49.179682 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.179659    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7979a909-70f9-4c5b-a51f-a363c062fd73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-swk7h\" (UID: \"7979a909-70f9-4c5b-a51f-a363c062fd73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:49.179935 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.179913    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a73777e5-e394-4284-acb7-63fe2e210a7d-cert\") pod \"kserve-controller-manager-d6f4b65b8-c6mhn\" (UID: \"a73777e5-e394-4284-acb7-63fe2e210a7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:49.193706 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.193673    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr92f\" (UniqueName: \"kubernetes.io/projected/7979a909-70f9-4c5b-a51f-a363c062fd73-kube-api-access-hr92f\") pod \"llmisvc-controller-manager-777c6bd7d5-swk7h\" (UID: \"7979a909-70f9-4c5b-a51f-a363c062fd73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:49.194083 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.194046    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkjnj\" (UniqueName: \"kubernetes.io/projected/a73777e5-e394-4284-acb7-63fe2e210a7d-kube-api-access-fkjnj\") pod \"kserve-controller-manager-d6f4b65b8-c6mhn\" (UID: \"a73777e5-e394-4284-acb7-63fe2e210a7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:49.237091 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.237063    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:49.249235 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.249209    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:49.428388 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.428366    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"]
Jul 08 23:16:49.430325 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:16:49.430296    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73777e5_e394_4284_acb7_63fe2e210a7d.slice/crio-fb6203f8ee2659a1a034adf4e4968fe0d3b2c1cb7d781d90543ce68d5f98c8f6 WatchSource:0}: Error finding container fb6203f8ee2659a1a034adf4e4968fe0d3b2c1cb7d781d90543ce68d5f98c8f6: Status 404 returned error can't find the container with id fb6203f8ee2659a1a034adf4e4968fe0d3b2c1cb7d781d90543ce68d5f98c8f6
Jul 08 23:16:49.465777 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.465749    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"]
Jul 08 23:16:49.469040 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:16:49.469002    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7979a909_70f9_4c5b_a51f_a363c062fd73.slice/crio-861cb1f69ad4d8f17d2b18017586579e0658c28cdd4f90ae0da803438c06c659 WatchSource:0}: Error finding container 861cb1f69ad4d8f17d2b18017586579e0658c28cdd4f90ae0da803438c06c659: Status 404 returned error can't find the container with id 861cb1f69ad4d8f17d2b18017586579e0658c28cdd4f90ae0da803438c06c659
Jul 08 23:16:49.551303 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.551276    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn" event={"ID":"a73777e5-e394-4284-acb7-63fe2e210a7d","Type":"ContainerStarted","Data":"fb6203f8ee2659a1a034adf4e4968fe0d3b2c1cb7d781d90543ce68d5f98c8f6"}
Jul 08 23:16:49.552321 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:49.552290    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h" event={"ID":"7979a909-70f9-4c5b-a51f-a363c062fd73","Type":"ContainerStarted","Data":"861cb1f69ad4d8f17d2b18017586579e0658c28cdd4f90ae0da803438c06c659"}
Jul 08 23:16:51.516332 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:51.516299    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-drc67"
Jul 08 23:16:53.575027 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:53.574989    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn" event={"ID":"a73777e5-e394-4284-acb7-63fe2e210a7d","Type":"ContainerStarted","Data":"4a5c19b3ada879034b6d223486ed1b5e65157d2e7906fe51557f5a5f014b92ce"}
Jul 08 23:16:53.575455 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:53.575047    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:16:53.576640 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:53.576392    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h" event={"ID":"7979a909-70f9-4c5b-a51f-a363c062fd73","Type":"ContainerStarted","Data":"63825b3d9bb955e787e62f8d25470ea463dd5cbd86e95c9076e807c3a8a14654"}
Jul 08 23:16:53.577562 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:53.577379    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:16:53.595599 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:53.595561    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn" podStartSLOduration=2.664785905 podStartE2EDuration="5.595547309s" totalImagesPullingTime="2.930761404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:53.594860159 +0000 UTC m=+557.143919761" watchObservedRunningTime="2026-07-08 23:16:53.595547309 +0000 UTC m=+557.144606900"
Jul 08 23:16:53.617051 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:53.617005    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h" podStartSLOduration=2.123078161 podStartE2EDuration="5.616991701s" totalImagesPullingTime="3.49391354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:53.615363029 +0000 UTC m=+557.164422632" watchObservedRunningTime="2026-07-08 23:16:53.616991701 +0000 UTC m=+557.166051299"
Jul 08 23:16:55.368270 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.368243    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"]
Jul 08 23:16:55.368895 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.368427    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg" podUID="b443235a-ec08-4ade-9704-d8c19b4f57a9" containerName="discovery" containerID="cri-o://05a0dcf87f13042345d1592509196ba419b3cf99bb99f52fa8de0d47bdea5575" gracePeriod=30
Jul 08 23:16:55.589265 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.589232    2586 generic.go:356] "Generic (PLEG): container finished" podID="b443235a-ec08-4ade-9704-d8c19b4f57a9" containerID="05a0dcf87f13042345d1592509196ba419b3cf99bb99f52fa8de0d47bdea5575" exitCode=0
Jul 08 23:16:55.589420 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.589305    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg" event={"ID":"b443235a-ec08-4ade-9704-d8c19b4f57a9","Type":"ContainerDied","Data":"05a0dcf87f13042345d1592509196ba419b3cf99bb99f52fa8de0d47bdea5575"}
Jul 08 23:16:55.626716 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.626655    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:55.736088 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736058    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6csdw\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-kube-api-access-6csdw\") pod \"b443235a-ec08-4ade-9704-d8c19b4f57a9\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") "
Jul 08 23:16:55.736227 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736127    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-dns-cert\") pod \"b443235a-ec08-4ade-9704-d8c19b4f57a9\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") "
Jul 08 23:16:55.736284 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736234    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-ca-configmap\") pod \"b443235a-ec08-4ade-9704-d8c19b4f57a9\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") "
Jul 08 23:16:55.736284 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736271    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-token\") pod \"b443235a-ec08-4ade-9704-d8c19b4f57a9\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") "
Jul 08 23:16:55.736364 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736313    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-kubeconfig\") pod \"b443235a-ec08-4ade-9704-d8c19b4f57a9\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") "
Jul 08 23:16:55.736414 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736379    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b443235a-ec08-4ade-9704-d8c19b4f57a9-local-certs\") pod \"b443235a-ec08-4ade-9704-d8c19b4f57a9\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") "
Jul 08 23:16:55.736414 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736407    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-cacerts\") pod \"b443235a-ec08-4ade-9704-d8c19b4f57a9\" (UID: \"b443235a-ec08-4ade-9704-d8c19b4f57a9\") "
Jul 08 23:16:55.736929 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736645    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b443235a-ec08-4ade-9704-d8c19b4f57a9" (UID: "b443235a-ec08-4ade-9704-d8c19b4f57a9"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:16:55.736929 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.736747    2586 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-ca-configmap\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:55.739049 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.739014    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b443235a-ec08-4ade-9704-d8c19b4f57a9-local-certs" (OuterVolumeSpecName: "local-certs") pod "b443235a-ec08-4ade-9704-d8c19b4f57a9" (UID: "b443235a-ec08-4ade-9704-d8c19b4f57a9"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:16:55.739149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.739049    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "b443235a-ec08-4ade-9704-d8c19b4f57a9" (UID: "b443235a-ec08-4ade-9704-d8c19b4f57a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:55.739149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.739059    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-cacerts" (OuterVolumeSpecName: "cacerts") pod "b443235a-ec08-4ade-9704-d8c19b4f57a9" (UID: "b443235a-ec08-4ade-9704-d8c19b4f57a9"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:16:55.739149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.739066    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-kube-api-access-6csdw" (OuterVolumeSpecName: "kube-api-access-6csdw") pod "b443235a-ec08-4ade-9704-d8c19b4f57a9" (UID: "b443235a-ec08-4ade-9704-d8c19b4f57a9"). InnerVolumeSpecName "kube-api-access-6csdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:55.739149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.739086    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b443235a-ec08-4ade-9704-d8c19b4f57a9" (UID: "b443235a-ec08-4ade-9704-d8c19b4f57a9"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:16:55.739149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.739128    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b443235a-ec08-4ade-9704-d8c19b4f57a9" (UID: "b443235a-ec08-4ade-9704-d8c19b4f57a9"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:16:55.838155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.838121    2586 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-csr-dns-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:55.838155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.838151    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:55.838155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.838160    2586 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-istio-kubeconfig\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:55.838155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.838168    2586 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b443235a-ec08-4ade-9704-d8c19b4f57a9-local-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:55.838427 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.838177    2586 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b443235a-ec08-4ade-9704-d8c19b4f57a9-cacerts\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:55.838427 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:55.838186    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6csdw\" (UniqueName: \"kubernetes.io/projected/b443235a-ec08-4ade-9704-d8c19b4f57a9-kube-api-access-6csdw\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:16:56.595043 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:56.595008    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"
Jul 08 23:16:56.595440 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:56.595047    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg" event={"ID":"b443235a-ec08-4ade-9704-d8c19b4f57a9","Type":"ContainerDied","Data":"dae675c1a9c69c865d0c77550f81f6d847b5b0717483888d8e5f7523242cf4a6"}
Jul 08 23:16:56.595440 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:56.595107    2586 scope.go:117] "RemoveContainer" containerID="05a0dcf87f13042345d1592509196ba419b3cf99bb99f52fa8de0d47bdea5575"
Jul 08 23:16:56.626889 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:56.626860    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"]
Jul 08 23:16:56.631190 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:56.631171    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2scg"]
Jul 08 23:16:57.533096 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:16:57.533061    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b443235a-ec08-4ade-9704-d8c19b4f57a9" path="/var/lib/kubelet/pods/b443235a-ec08-4ade-9704-d8c19b4f57a9/volumes"
Jul 08 23:17:00.537765 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:00.537729    2586 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-g2scg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 23:17:00.538176 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:00.537800    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2scg" podUID="b443235a-ec08-4ade-9704-d8c19b4f57a9" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.33:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 23:17:03.053895 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:03.053860    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:17:03.054193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:03.053929    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:17:03.054193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:03.053958    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:17:03.629464 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:03.629430    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5" event={"ID":"667e2567-fe6b-44da-a667-baa657a03a6e","Type":"ContainerStarted","Data":"ff2be41bb2b69c154e99dd18ee0b26421e66a2479b1be1ee5d290481e8c3dd2d"}
Jul 08 23:17:03.663988 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:03.663941    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5" podStartSLOduration=1.21028547 podStartE2EDuration="17.663926305s" totalImagesPullingTime="16.453640835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:17:03.662855969 +0000 UTC m=+567.211915561" watchObservedRunningTime="2026-07-08 23:17:03.663926305 +0000 UTC m=+567.212985898"
Jul 08 23:17:04.416468 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:04.416433    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:17:04.421087 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:04.421063    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:17:04.634499 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:04.634472    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:17:04.635308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:04.635288    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678782z5"
Jul 08 23:17:24.585850 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:24.585822    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c6mhn"
Jul 08 23:17:25.591354 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:25.591322    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swk7h"
Jul 08 23:17:36.196980 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.196947    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnf9"]
Jul 08 23:17:36.197431 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.197300    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b443235a-ec08-4ade-9704-d8c19b4f57a9" containerName="discovery"
Jul 08 23:17:36.197431 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.197313    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b443235a-ec08-4ade-9704-d8c19b4f57a9" containerName="discovery"
Jul 08 23:17:36.197431 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.197409    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b443235a-ec08-4ade-9704-d8c19b4f57a9" containerName="discovery"
Jul 08 23:17:36.202485 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.202457    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9"
Jul 08 23:17:36.205139 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.205119    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 23:17:36.206059 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.206020    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 23:17:36.206174 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.206023    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dcx4d\""
Jul 08 23:17:36.219113 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.219092    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnf9"]
Jul 08 23:17:36.278100 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.278069    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lcfb\" (UniqueName: \"kubernetes.io/projected/34bf0013-2b56-4d6a-802b-a056cadc1bb6-kube-api-access-4lcfb\") pod \"kuadrant-operator-catalog-wvnf9\" (UID: \"34bf0013-2b56-4d6a-802b-a056cadc1bb6\") " pod="kuadrant-system/kuadrant-operator-catalog-wvnf9"
Jul 08 23:17:36.379538 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.379471    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lcfb\" (UniqueName: \"kubernetes.io/projected/34bf0013-2b56-4d6a-802b-a056cadc1bb6-kube-api-access-4lcfb\") pod \"kuadrant-operator-catalog-wvnf9\" (UID: \"34bf0013-2b56-4d6a-802b-a056cadc1bb6\") " pod="kuadrant-system/kuadrant-operator-catalog-wvnf9"
Jul 08 23:17:36.389782 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.389756    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lcfb\" (UniqueName: \"kubernetes.io/projected/34bf0013-2b56-4d6a-802b-a056cadc1bb6-kube-api-access-4lcfb\") pod \"kuadrant-operator-catalog-wvnf9\" (UID: \"34bf0013-2b56-4d6a-802b-a056cadc1bb6\") " pod="kuadrant-system/kuadrant-operator-catalog-wvnf9"
Jul 08 23:17:36.515629 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.515542    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9"
Jul 08 23:17:36.549671 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.549644    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnf9"]
Jul 08 23:17:36.650103 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.650081    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnf9"]
Jul 08 23:17:36.651982 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:17:36.651957    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34bf0013_2b56_4d6a_802b_a056cadc1bb6.slice/crio-1c43a6df978c3f6255fd8e991099c3f87ec9848892a951dcd3dbadf7fa83bfc2 WatchSource:0}: Error finding container 1c43a6df978c3f6255fd8e991099c3f87ec9848892a951dcd3dbadf7fa83bfc2: Status 404 returned error can't find the container with id 1c43a6df978c3f6255fd8e991099c3f87ec9848892a951dcd3dbadf7fa83bfc2
Jul 08 23:17:36.760241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.760203    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6mzwb"]
Jul 08 23:17:36.763099 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.763077    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:36.770761 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.770738    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6mzwb"]
Jul 08 23:17:36.787996 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.787973    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9" event={"ID":"34bf0013-2b56-4d6a-802b-a056cadc1bb6","Type":"ContainerStarted","Data":"1c43a6df978c3f6255fd8e991099c3f87ec9848892a951dcd3dbadf7fa83bfc2"}
Jul 08 23:17:36.883783 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.883743    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l9gx\" (UniqueName: \"kubernetes.io/projected/6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd-kube-api-access-2l9gx\") pod \"kuadrant-operator-catalog-6mzwb\" (UID: \"6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd\") " pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:36.884583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.884562    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:17:36.884583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.884572    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:17:36.891672 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.891655    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:17:36.891781 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.891656    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:17:36.984819 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.984787    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l9gx\" (UniqueName: \"kubernetes.io/projected/6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd-kube-api-access-2l9gx\") pod \"kuadrant-operator-catalog-6mzwb\" (UID: \"6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd\") " pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:36.993007 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:36.992981    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l9gx\" (UniqueName: \"kubernetes.io/projected/6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd-kube-api-access-2l9gx\") pod \"kuadrant-operator-catalog-6mzwb\" (UID: \"6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd\") " pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:37.073632 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:37.073534    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:37.203088 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:37.203053    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6mzwb"]
Jul 08 23:17:37.207263 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:17:37.207238    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d335b9f_2dfb_462a_84f1_bbbfdbe68ecd.slice/crio-54b3d48e30e3ae5259b11aad2cd3c08a065f73568b11eebadc0f13f09036cda4 WatchSource:0}: Error finding container 54b3d48e30e3ae5259b11aad2cd3c08a065f73568b11eebadc0f13f09036cda4: Status 404 returned error can't find the container with id 54b3d48e30e3ae5259b11aad2cd3c08a065f73568b11eebadc0f13f09036cda4
Jul 08 23:17:37.799431 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:37.799392    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb" event={"ID":"6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd","Type":"ContainerStarted","Data":"54b3d48e30e3ae5259b11aad2cd3c08a065f73568b11eebadc0f13f09036cda4"}
Jul 08 23:17:39.810198 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:39.810156    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb" event={"ID":"6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd","Type":"ContainerStarted","Data":"64cd6789ad70ffb8538130c9fd674740a0372325b93220ab3a02d7a2ae4dfc06"}
Jul 08 23:17:39.811614 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:39.811593    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9" event={"ID":"34bf0013-2b56-4d6a-802b-a056cadc1bb6","Type":"ContainerStarted","Data":"9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789"}
Jul 08 23:17:39.811723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:39.811638    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9" podUID="34bf0013-2b56-4d6a-802b-a056cadc1bb6" containerName="registry-server" containerID="cri-o://9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789" gracePeriod=2
Jul 08 23:17:39.825332 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:39.825295    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb" podStartSLOduration=2.214764264 podStartE2EDuration="3.825281833s" totalImagesPullingTime="1.610517569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:17:39.824337196 +0000 UTC m=+603.373396788" watchObservedRunningTime="2026-07-08 23:17:39.825281833 +0000 UTC m=+603.374341424"
Jul 08 23:17:39.844586 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:39.844549    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9" podStartSLOduration=1.683470839 podStartE2EDuration="3.844535916s" totalImagesPullingTime="2.161065077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:17:39.843487092 +0000 UTC m=+603.392546696" watchObservedRunningTime="2026-07-08 23:17:39.844535916 +0000 UTC m=+603.393595499"
Jul 08 23:17:40.048555 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.048512    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9"
Jul 08 23:17:40.116460 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.116441    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lcfb\" (UniqueName: \"kubernetes.io/projected/34bf0013-2b56-4d6a-802b-a056cadc1bb6-kube-api-access-4lcfb\") pod \"34bf0013-2b56-4d6a-802b-a056cadc1bb6\" (UID: \"34bf0013-2b56-4d6a-802b-a056cadc1bb6\") "
Jul 08 23:17:40.118588 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.118566    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34bf0013-2b56-4d6a-802b-a056cadc1bb6-kube-api-access-4lcfb" (OuterVolumeSpecName: "kube-api-access-4lcfb") pod "34bf0013-2b56-4d6a-802b-a056cadc1bb6" (UID: "34bf0013-2b56-4d6a-802b-a056cadc1bb6"). InnerVolumeSpecName "kube-api-access-4lcfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:17:40.217129 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.217101    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lcfb\" (UniqueName: \"kubernetes.io/projected/34bf0013-2b56-4d6a-802b-a056cadc1bb6-kube-api-access-4lcfb\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:40.817509 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.817475    2586 generic.go:356] "Generic (PLEG): container finished" podID="34bf0013-2b56-4d6a-802b-a056cadc1bb6" containerID="9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789" exitCode=0
Jul 08 23:17:40.817953 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.817544    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9"
Jul 08 23:17:40.817953 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.817553    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9" event={"ID":"34bf0013-2b56-4d6a-802b-a056cadc1bb6","Type":"ContainerDied","Data":"9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789"}
Jul 08 23:17:40.817953 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.817599    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wvnf9" event={"ID":"34bf0013-2b56-4d6a-802b-a056cadc1bb6","Type":"ContainerDied","Data":"1c43a6df978c3f6255fd8e991099c3f87ec9848892a951dcd3dbadf7fa83bfc2"}
Jul 08 23:17:40.817953 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.817617    2586 scope.go:117] "RemoveContainer" containerID="9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789"
Jul 08 23:17:40.826731 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.826715    2586 scope.go:117] "RemoveContainer" containerID="9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789"
Jul 08 23:17:40.827002 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:17:40.826978    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789\": container with ID starting with 9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789 not found: ID does not exist" containerID="9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789"
Jul 08 23:17:40.827070 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.827011    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789"} err="failed to get container status \"9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789\": rpc error: code = NotFound desc = could not find container \"9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789\": container with ID starting with 9df5a7c50e2066d24d104f7956acc003fda94d682a556909f00303b00f9b7789 not found: ID does not exist"
Jul 08 23:17:40.837249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.837230    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnf9"]
Jul 08 23:17:40.839794 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:40.839774    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnf9"]
Jul 08 23:17:41.532946 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:41.532912    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34bf0013-2b56-4d6a-802b-a056cadc1bb6" path="/var/lib/kubelet/pods/34bf0013-2b56-4d6a-802b-a056cadc1bb6/volumes"
Jul 08 23:17:47.074497 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:47.074456    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:47.074936 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:47.074555    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:47.097269 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:47.097226    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:47.872675 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:47.872650    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6mzwb"
Jul 08 23:17:52.008889 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.008854    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"]
Jul 08 23:17:52.009290 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.009205    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34bf0013-2b56-4d6a-802b-a056cadc1bb6" containerName="registry-server"
Jul 08 23:17:52.009290 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.009217    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="34bf0013-2b56-4d6a-802b-a056cadc1bb6" containerName="registry-server"
Jul 08 23:17:52.009290 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.009280    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="34bf0013-2b56-4d6a-802b-a056cadc1bb6" containerName="registry-server"
Jul 08 23:17:52.011338 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.011321    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.014946 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.014927    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2p9z9\""
Jul 08 23:17:52.034773 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.034747    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"]
Jul 08 23:17:52.123431 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.123393    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.123657 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.123457    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2zrw\" (UniqueName: \"kubernetes.io/projected/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-kube-api-access-q2zrw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.123657 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.123557    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.224625 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.224589    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.224802 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.224738    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zrw\" (UniqueName: \"kubernetes.io/projected/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-kube-api-access-q2zrw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.224802 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.224786    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.224992 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.224973    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.225055 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.225041    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.236760 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.236728    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2zrw\" (UniqueName: \"kubernetes.io/projected/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-kube-api-access-q2zrw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.320641 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.320566    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:52.452384 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.452357    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"]
Jul 08 23:17:52.453549 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:17:52.453499    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3a3de4_8f6c_49f9_a369_e3f9294d7b6a.slice/crio-481217ce4eb28d197f2471980f8ee929d7c667fde25ddd1f25204cf2ff239e76 WatchSource:0}: Error finding container 481217ce4eb28d197f2471980f8ee929d7c667fde25ddd1f25204cf2ff239e76: Status 404 returned error can't find the container with id 481217ce4eb28d197f2471980f8ee929d7c667fde25ddd1f25204cf2ff239e76
Jul 08 23:17:52.780096 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.780058    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"]
Jul 08 23:17:52.782501 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.782486    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:52.792000 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.791977    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"]
Jul 08 23:17:52.875979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.875941    2586 generic.go:356] "Generic (PLEG): container finished" podID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerID="4f6444e690dd276032093b1e32cdec428d3fe8c830c248553e38e2f9f09ad93d" exitCode=0
Jul 08 23:17:52.876173 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.876027    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx" event={"ID":"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a","Type":"ContainerDied","Data":"4f6444e690dd276032093b1e32cdec428d3fe8c830c248553e38e2f9f09ad93d"}
Jul 08 23:17:52.876173 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.876073    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx" event={"ID":"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a","Type":"ContainerStarted","Data":"481217ce4eb28d197f2471980f8ee929d7c667fde25ddd1f25204cf2ff239e76"}
Jul 08 23:17:52.876540 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.876504    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:17:52.931006 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.930970    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:52.931184 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.931032    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:52.931184 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:52.931059    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rrh\" (UniqueName: \"kubernetes.io/projected/fb67938b-b919-446f-8c3f-73ce4717c661-kube-api-access-f4rrh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:53.032461 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.032359    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:53.032461 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.032434    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:53.033013 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.032477    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rrh\" (UniqueName: \"kubernetes.io/projected/fb67938b-b919-446f-8c3f-73ce4717c661-kube-api-access-f4rrh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:53.033013 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.032789    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:53.033013 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.032806    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:53.041236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.041203    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rrh\" (UniqueName: \"kubernetes.io/projected/fb67938b-b919-446f-8c3f-73ce4717c661-kube-api-access-f4rrh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:53.092312 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.092275    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:53.229263 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.229239    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"]
Jul 08 23:17:53.231017 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:17:53.230989    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb67938b_b919_446f_8c3f_73ce4717c661.slice/crio-a70139d35093802cf668c4043bd1dfa8ac833c56604f61ef918125ea6654efbe WatchSource:0}: Error finding container a70139d35093802cf668c4043bd1dfa8ac833c56604f61ef918125ea6654efbe: Status 404 returned error can't find the container with id a70139d35093802cf668c4043bd1dfa8ac833c56604f61ef918125ea6654efbe
Jul 08 23:17:53.373644 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.373616    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"]
Jul 08 23:17:53.376158 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.376143    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.389960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.389936    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"]
Jul 08 23:17:53.436124 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.436079    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.436124 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.436134    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.436305 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.436235    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9pmh\" (UniqueName: \"kubernetes.io/projected/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-kube-api-access-b9pmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.536999 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.536971    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.537174 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.537011    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.537174 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.537043    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9pmh\" (UniqueName: \"kubernetes.io/projected/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-kube-api-access-b9pmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.537422 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.537401    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.537461 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.537411    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.545135 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.545079    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9pmh\" (UniqueName: \"kubernetes.io/projected/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-kube-api-access-b9pmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.728013 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.727989    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:53.773585 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.773555    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"]
Jul 08 23:17:53.776345 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.776323    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.786643 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.786568    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"]
Jul 08 23:17:53.840973 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.840936    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.841104 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.841021    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xznk8\" (UniqueName: \"kubernetes.io/projected/a9cf0ce4-4f02-4da6-b746-c872f011ed34-kube-api-access-xznk8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.841104 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.841055    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.865495 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.865470    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"]
Jul 08 23:17:53.867396 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:17:53.867374    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4236f30_3ffc_4ee5_8485_dd813d3bffd3.slice/crio-b9ba2e146a67ea3fe9a775c7c6ef8b8ae58875923fe3701981d19dfc5f1a418e WatchSource:0}: Error finding container b9ba2e146a67ea3fe9a775c7c6ef8b8ae58875923fe3701981d19dfc5f1a418e: Status 404 returned error can't find the container with id b9ba2e146a67ea3fe9a775c7c6ef8b8ae58875923fe3701981d19dfc5f1a418e
Jul 08 23:17:53.882439 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.882417    2586 generic.go:356] "Generic (PLEG): container finished" podID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerID="1c42bf7fb1248d4dc0bac4886fb72a5062db179e95344d635b4431584f73a1c7" exitCode=0
Jul 08 23:17:53.882544 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.882485    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx" event={"ID":"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a","Type":"ContainerDied","Data":"1c42bf7fb1248d4dc0bac4886fb72a5062db179e95344d635b4431584f73a1c7"}
Jul 08 23:17:53.883849 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.883824    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245" event={"ID":"a4236f30-3ffc-4ee5-8485-dd813d3bffd3","Type":"ContainerStarted","Data":"b9ba2e146a67ea3fe9a775c7c6ef8b8ae58875923fe3701981d19dfc5f1a418e"}
Jul 08 23:17:53.885445 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.885427    2586 generic.go:356] "Generic (PLEG): container finished" podID="fb67938b-b919-446f-8c3f-73ce4717c661" containerID="1d435716be60eea8d5a55ffccce30cb40886f4e22d3d2664749102c779b6ce4b" exitCode=0
Jul 08 23:17:53.885534 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.885489    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg" event={"ID":"fb67938b-b919-446f-8c3f-73ce4717c661","Type":"ContainerDied","Data":"1d435716be60eea8d5a55ffccce30cb40886f4e22d3d2664749102c779b6ce4b"}
Jul 08 23:17:53.885583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.885540    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg" event={"ID":"fb67938b-b919-446f-8c3f-73ce4717c661","Type":"ContainerStarted","Data":"a70139d35093802cf668c4043bd1dfa8ac833c56604f61ef918125ea6654efbe"}
Jul 08 23:17:53.942254 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.942216    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.942424 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.942292    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xznk8\" (UniqueName: \"kubernetes.io/projected/a9cf0ce4-4f02-4da6-b746-c872f011ed34-kube-api-access-xznk8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.942424 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.942325    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.942827 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.942805    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.942939 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.942873    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:53.951449 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:53.951411    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xznk8\" (UniqueName: \"kubernetes.io/projected/a9cf0ce4-4f02-4da6-b746-c872f011ed34-kube-api-access-xznk8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:54.126739 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.126707    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:54.260310 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.260287    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"]
Jul 08 23:17:54.261798 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:17:54.261772    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cf0ce4_4f02_4da6_b746_c872f011ed34.slice/crio-8c4d1c5fa55744814e5cbffd1900deb76d9d5a28623272706c32ad7759fb874a WatchSource:0}: Error finding container 8c4d1c5fa55744814e5cbffd1900deb76d9d5a28623272706c32ad7759fb874a: Status 404 returned error can't find the container with id 8c4d1c5fa55744814e5cbffd1900deb76d9d5a28623272706c32ad7759fb874a
Jul 08 23:17:54.893025 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.892992    2586 generic.go:356] "Generic (PLEG): container finished" podID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerID="d580b64f3e779ee8b454ebeb96d1f576aa31f9b75502cb43c8f0763ebc8f6335" exitCode=0
Jul 08 23:17:54.893195 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.893082    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx" event={"ID":"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a","Type":"ContainerDied","Data":"d580b64f3e779ee8b454ebeb96d1f576aa31f9b75502cb43c8f0763ebc8f6335"}
Jul 08 23:17:54.894682 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.894658    2586 generic.go:356] "Generic (PLEG): container finished" podID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerID="b16b33be18e3ee95c14ec4ea76d5f16ce5696b02d4b57fa7ee5ef559df79061e" exitCode=0
Jul 08 23:17:54.894811 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.894734    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245" event={"ID":"a4236f30-3ffc-4ee5-8485-dd813d3bffd3","Type":"ContainerDied","Data":"b16b33be18e3ee95c14ec4ea76d5f16ce5696b02d4b57fa7ee5ef559df79061e"}
Jul 08 23:17:54.896220 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.896201    2586 generic.go:356] "Generic (PLEG): container finished" podID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerID="091612c5d70995e54b0d48867bddcdb03789bc9434047ee2530c4cd0326ff87b" exitCode=0
Jul 08 23:17:54.896336 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.896279    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm" event={"ID":"a9cf0ce4-4f02-4da6-b746-c872f011ed34","Type":"ContainerDied","Data":"091612c5d70995e54b0d48867bddcdb03789bc9434047ee2530c4cd0326ff87b"}
Jul 08 23:17:54.896336 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.896320    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm" event={"ID":"a9cf0ce4-4f02-4da6-b746-c872f011ed34","Type":"ContainerStarted","Data":"8c4d1c5fa55744814e5cbffd1900deb76d9d5a28623272706c32ad7759fb874a"}
Jul 08 23:17:54.898223 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.898205    2586 generic.go:356] "Generic (PLEG): container finished" podID="fb67938b-b919-446f-8c3f-73ce4717c661" containerID="da2dbb4cc7c664f85dd94c1b4a1d140a0d0b0e3b09c56921abf20607a107c6af" exitCode=0
Jul 08 23:17:54.898314 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:54.898271    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg" event={"ID":"fb67938b-b919-446f-8c3f-73ce4717c661","Type":"ContainerDied","Data":"da2dbb4cc7c664f85dd94c1b4a1d140a0d0b0e3b09c56921abf20607a107c6af"}
Jul 08 23:17:55.905072 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:55.905030    2586 generic.go:356] "Generic (PLEG): container finished" podID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerID="56a36c1b8a3fe8018dc8c41a73b57366e5ef6defdb926eb75ee0487fb4f28f77" exitCode=0
Jul 08 23:17:55.905465 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:55.905112    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245" event={"ID":"a4236f30-3ffc-4ee5-8485-dd813d3bffd3","Type":"ContainerDied","Data":"56a36c1b8a3fe8018dc8c41a73b57366e5ef6defdb926eb75ee0487fb4f28f77"}
Jul 08 23:17:55.907651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:55.907626    2586 generic.go:356] "Generic (PLEG): container finished" podID="fb67938b-b919-446f-8c3f-73ce4717c661" containerID="ae7ff7e549deb938442dbc0a38736ff56808ac5c92c03dd69f149356320964f3" exitCode=0
Jul 08 23:17:55.907787 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:55.907715    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg" event={"ID":"fb67938b-b919-446f-8c3f-73ce4717c661","Type":"ContainerDied","Data":"ae7ff7e549deb938442dbc0a38736ff56808ac5c92c03dd69f149356320964f3"}
Jul 08 23:17:56.034206 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.034180    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:56.160621 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.160591    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2zrw\" (UniqueName: \"kubernetes.io/projected/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-kube-api-access-q2zrw\") pod \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") "
Jul 08 23:17:56.160808 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.160791    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-bundle\") pod \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") "
Jul 08 23:17:56.160870 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.160815    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-util\") pod \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\" (UID: \"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a\") "
Jul 08 23:17:56.161241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.161217    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-bundle" (OuterVolumeSpecName: "bundle") pod "8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" (UID: "8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:17:56.162664 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.162641    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-kube-api-access-q2zrw" (OuterVolumeSpecName: "kube-api-access-q2zrw") pod "8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" (UID: "8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a"). InnerVolumeSpecName "kube-api-access-q2zrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:17:56.166018 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.165970    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-util" (OuterVolumeSpecName: "util") pod "8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" (UID: "8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:17:56.262415 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.262379    2586 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:56.262415 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.262409    2586 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-util\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:56.262415 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.262418    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2zrw\" (UniqueName: \"kubernetes.io/projected/8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a-kube-api-access-q2zrw\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:56.914029 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.913984    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx" event={"ID":"8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a","Type":"ContainerDied","Data":"481217ce4eb28d197f2471980f8ee929d7c667fde25ddd1f25204cf2ff239e76"}
Jul 08 23:17:56.914411 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.914043    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="481217ce4eb28d197f2471980f8ee929d7c667fde25ddd1f25204cf2ff239e76"
Jul 08 23:17:56.914411 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.914008    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx"
Jul 08 23:17:56.916177 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.916152    2586 generic.go:356] "Generic (PLEG): container finished" podID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerID="ebf35e9abfbb92b643af75ce3fe0c5542f29cca81b8a78ca72b9580927ef7b9b" exitCode=0
Jul 08 23:17:56.916289 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.916262    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245" event={"ID":"a4236f30-3ffc-4ee5-8485-dd813d3bffd3","Type":"ContainerDied","Data":"ebf35e9abfbb92b643af75ce3fe0c5542f29cca81b8a78ca72b9580927ef7b9b"}
Jul 08 23:17:56.917949 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.917924    2586 generic.go:356] "Generic (PLEG): container finished" podID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerID="b99674692726b1a66902645489fc0abf3e85ae79e627acf1ca309e9a3f84d89b" exitCode=0
Jul 08 23:17:56.918046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:56.917950    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm" event={"ID":"a9cf0ce4-4f02-4da6-b746-c872f011ed34","Type":"ContainerDied","Data":"b99674692726b1a66902645489fc0abf3e85ae79e627acf1ca309e9a3f84d89b"}
Jul 08 23:17:57.052058 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.052034    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:57.169959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.169864    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-util\") pod \"fb67938b-b919-446f-8c3f-73ce4717c661\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") "
Jul 08 23:17:57.169959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.169928    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-bundle\") pod \"fb67938b-b919-446f-8c3f-73ce4717c661\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") "
Jul 08 23:17:57.170203 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.169974    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4rrh\" (UniqueName: \"kubernetes.io/projected/fb67938b-b919-446f-8c3f-73ce4717c661-kube-api-access-f4rrh\") pod \"fb67938b-b919-446f-8c3f-73ce4717c661\" (UID: \"fb67938b-b919-446f-8c3f-73ce4717c661\") "
Jul 08 23:17:57.170639 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.170616    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-bundle" (OuterVolumeSpecName: "bundle") pod "fb67938b-b919-446f-8c3f-73ce4717c661" (UID: "fb67938b-b919-446f-8c3f-73ce4717c661"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:17:57.172133 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.172109    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb67938b-b919-446f-8c3f-73ce4717c661-kube-api-access-f4rrh" (OuterVolumeSpecName: "kube-api-access-f4rrh") pod "fb67938b-b919-446f-8c3f-73ce4717c661" (UID: "fb67938b-b919-446f-8c3f-73ce4717c661"). InnerVolumeSpecName "kube-api-access-f4rrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:17:57.175263 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.175243    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-util" (OuterVolumeSpecName: "util") pod "fb67938b-b919-446f-8c3f-73ce4717c661" (UID: "fb67938b-b919-446f-8c3f-73ce4717c661"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:17:57.270815 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.270774    2586 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-util\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:57.270815 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.270810    2586 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb67938b-b919-446f-8c3f-73ce4717c661-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:57.270815 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.270819    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4rrh\" (UniqueName: \"kubernetes.io/projected/fb67938b-b919-446f-8c3f-73ce4717c661-kube-api-access-f4rrh\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:57.931314 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.931274    2586 generic.go:356] "Generic (PLEG): container finished" podID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerID="ffc04e277f3f3331f181d127dfce1c252c12e91f02b2abdf9f0f2d2cadc4ba6f" exitCode=0
Jul 08 23:17:57.931737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.931352    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm" event={"ID":"a9cf0ce4-4f02-4da6-b746-c872f011ed34","Type":"ContainerDied","Data":"ffc04e277f3f3331f181d127dfce1c252c12e91f02b2abdf9f0f2d2cadc4ba6f"}
Jul 08 23:17:57.933127 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.933102    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg" event={"ID":"fb67938b-b919-446f-8c3f-73ce4717c661","Type":"ContainerDied","Data":"a70139d35093802cf668c4043bd1dfa8ac833c56604f61ef918125ea6654efbe"}
Jul 08 23:17:57.933252 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.933129    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg"
Jul 08 23:17:57.933252 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:57.933144    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a70139d35093802cf668c4043bd1dfa8ac833c56604f61ef918125ea6654efbe"
Jul 08 23:17:58.064199 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.064176    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:58.179268 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.179232    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-util\") pod \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") "
Jul 08 23:17:58.179434 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.179304    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9pmh\" (UniqueName: \"kubernetes.io/projected/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-kube-api-access-b9pmh\") pod \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") "
Jul 08 23:17:58.179434 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.179335    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-bundle\") pod \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\" (UID: \"a4236f30-3ffc-4ee5-8485-dd813d3bffd3\") "
Jul 08 23:17:58.179886 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.179858    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-bundle" (OuterVolumeSpecName: "bundle") pod "a4236f30-3ffc-4ee5-8485-dd813d3bffd3" (UID: "a4236f30-3ffc-4ee5-8485-dd813d3bffd3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:17:58.181447 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.181391    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-kube-api-access-b9pmh" (OuterVolumeSpecName: "kube-api-access-b9pmh") pod "a4236f30-3ffc-4ee5-8485-dd813d3bffd3" (UID: "a4236f30-3ffc-4ee5-8485-dd813d3bffd3"). InnerVolumeSpecName "kube-api-access-b9pmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:17:58.184600 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.184575    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-util" (OuterVolumeSpecName: "util") pod "a4236f30-3ffc-4ee5-8485-dd813d3bffd3" (UID: "a4236f30-3ffc-4ee5-8485-dd813d3bffd3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:17:58.280155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.280123    2586 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-util\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:58.280155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.280148    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9pmh\" (UniqueName: \"kubernetes.io/projected/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-kube-api-access-b9pmh\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:58.280155 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.280159    2586 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4236f30-3ffc-4ee5-8485-dd813d3bffd3-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:58.940135 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.940099    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245" event={"ID":"a4236f30-3ffc-4ee5-8485-dd813d3bffd3","Type":"ContainerDied","Data":"b9ba2e146a67ea3fe9a775c7c6ef8b8ae58875923fe3701981d19dfc5f1a418e"}
Jul 08 23:17:58.940506 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.940150    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9ba2e146a67ea3fe9a775c7c6ef8b8ae58875923fe3701981d19dfc5f1a418e"
Jul 08 23:17:58.940506 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:58.940279    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245"
Jul 08 23:17:59.075757 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.075733    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:59.188820 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.188790    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xznk8\" (UniqueName: \"kubernetes.io/projected/a9cf0ce4-4f02-4da6-b746-c872f011ed34-kube-api-access-xznk8\") pod \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") "
Jul 08 23:17:59.189022 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.188853    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-util\") pod \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") "
Jul 08 23:17:59.189097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.189026    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-bundle\") pod \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\" (UID: \"a9cf0ce4-4f02-4da6-b746-c872f011ed34\") "
Jul 08 23:17:59.189422 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.189398    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-bundle" (OuterVolumeSpecName: "bundle") pod "a9cf0ce4-4f02-4da6-b746-c872f011ed34" (UID: "a9cf0ce4-4f02-4da6-b746-c872f011ed34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:17:59.190992 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.190933    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9cf0ce4-4f02-4da6-b746-c872f011ed34-kube-api-access-xznk8" (OuterVolumeSpecName: "kube-api-access-xznk8") pod "a9cf0ce4-4f02-4da6-b746-c872f011ed34" (UID: "a9cf0ce4-4f02-4da6-b746-c872f011ed34"). InnerVolumeSpecName "kube-api-access-xznk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:17:59.194472 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.194450    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-util" (OuterVolumeSpecName: "util") pod "a9cf0ce4-4f02-4da6-b746-c872f011ed34" (UID: "a9cf0ce4-4f02-4da6-b746-c872f011ed34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:17:59.290496 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.290459    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xznk8\" (UniqueName: \"kubernetes.io/projected/a9cf0ce4-4f02-4da6-b746-c872f011ed34-kube-api-access-xznk8\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:59.290496 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.290486    2586 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-util\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:59.290496 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.290497    2586 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9cf0ce4-4f02-4da6-b746-c872f011ed34-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:17:59.947340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.947308    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm" event={"ID":"a9cf0ce4-4f02-4da6-b746-c872f011ed34","Type":"ContainerDied","Data":"8c4d1c5fa55744814e5cbffd1900deb76d9d5a28623272706c32ad7759fb874a"}
Jul 08 23:17:59.947340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.947338    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm"
Jul 08 23:17:59.947791 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:17:59.947351    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c4d1c5fa55744814e5cbffd1900deb76d9d5a28623272706c32ad7759fb874a"
Jul 08 23:18:10.142497 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142460    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"]
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142795    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerName="extract"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142806    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerName="extract"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142813    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerName="util"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142818    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerName="util"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142828    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb67938b-b919-446f-8c3f-73ce4717c661" containerName="extract"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142833    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb67938b-b919-446f-8c3f-73ce4717c661" containerName="extract"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142841    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerName="util"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142846    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerName="util"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142858    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerName="util"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142862    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerName="util"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142872    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb67938b-b919-446f-8c3f-73ce4717c661" containerName="util"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142877    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb67938b-b919-446f-8c3f-73ce4717c661" containerName="util"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142882    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerName="extract"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142886    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerName="extract"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142893    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerName="pull"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142898    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerName="pull"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142904    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb67938b-b919-446f-8c3f-73ce4717c661" containerName="pull"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142908    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb67938b-b919-446f-8c3f-73ce4717c661" containerName="pull"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142916    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerName="pull"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142921    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerName="pull"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142927    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerName="pull"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142932    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerName="pull"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142937    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerName="extract"
Jul 08 23:18:10.142958 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142942    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerName="extract"
Jul 08 23:18:10.143698 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142989    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a" containerName="extract"
Jul 08 23:18:10.143698 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.142999    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb67938b-b919-446f-8c3f-73ce4717c661" containerName="extract"
Jul 08 23:18:10.143698 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.143006    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9cf0ce4-4f02-4da6-b746-c872f011ed34" containerName="extract"
Jul 08 23:18:10.143698 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.143012    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4236f30-3ffc-4ee5-8485-dd813d3bffd3" containerName="extract"
Jul 08 23:18:10.147087 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.147072    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:10.149700 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.149679    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p8ghq\""
Jul 08 23:18:10.161131 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.161112    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"]
Jul 08 23:18:10.282795 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.282765    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs77k\" (UniqueName: \"kubernetes.io/projected/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-kube-api-access-gs77k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" (UID: \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:10.282970 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.282800    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" (UID: \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:10.383660 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.383615    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs77k\" (UniqueName: \"kubernetes.io/projected/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-kube-api-access-gs77k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" (UID: \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:10.383828 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.383669    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" (UID: \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:10.384061 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.384041    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" (UID: \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:10.396736 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.396673    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs77k\" (UniqueName: \"kubernetes.io/projected/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-kube-api-access-gs77k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" (UID: \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:10.457093 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.457067    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:10.591843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:10.591815    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"]
Jul 08 23:18:10.593557 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:10.593514    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7281a9ed_c7bf_4b06_8250_4c23fa21f90b.slice/crio-191a5721c1eba27cb7153024917ea4a1a91ac76c28adadcaae4eb737891f89cd WatchSource:0}: Error finding container 191a5721c1eba27cb7153024917ea4a1a91ac76c28adadcaae4eb737891f89cd: Status 404 returned error can't find the container with id 191a5721c1eba27cb7153024917ea4a1a91ac76c28adadcaae4eb737891f89cd
Jul 08 23:18:11.001917 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:11.001883    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd" event={"ID":"7281a9ed-c7bf-4b06-8250-4c23fa21f90b","Type":"ContainerStarted","Data":"191a5721c1eba27cb7153024917ea4a1a91ac76c28adadcaae4eb737891f89cd"}
Jul 08 23:18:12.164445 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.164417    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"]
Jul 08 23:18:12.167825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.167807    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"
Jul 08 23:18:12.170712 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.170694    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 23:18:12.170808 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.170694    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-l8z65\""
Jul 08 23:18:12.182083 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.182062    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"]
Jul 08 23:18:12.300492 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.300462    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rchj\" (UniqueName: \"kubernetes.io/projected/cedde334-a802-4993-918c-e5715bdfcc4f-kube-api-access-7rchj\") pod \"dns-operator-controller-manager-864dd78c4c-h27w4\" (UID: \"cedde334-a802-4993-918c-e5715bdfcc4f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"
Jul 08 23:18:12.401685 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.401652    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rchj\" (UniqueName: \"kubernetes.io/projected/cedde334-a802-4993-918c-e5715bdfcc4f-kube-api-access-7rchj\") pod \"dns-operator-controller-manager-864dd78c4c-h27w4\" (UID: \"cedde334-a802-4993-918c-e5715bdfcc4f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"
Jul 08 23:18:12.437509 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.437439    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rchj\" (UniqueName: \"kubernetes.io/projected/cedde334-a802-4993-918c-e5715bdfcc4f-kube-api-access-7rchj\") pod \"dns-operator-controller-manager-864dd78c4c-h27w4\" (UID: \"cedde334-a802-4993-918c-e5715bdfcc4f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"
Jul 08 23:18:12.478271 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.478246    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"
Jul 08 23:18:12.653566 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:12.653538    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"]
Jul 08 23:18:12.655925 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:12.655745    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcedde334_a802_4993_918c_e5715bdfcc4f.slice/crio-dac539d2dabd9716815a8faa2982381c48127f727165a73eb363e515c18b469f WatchSource:0}: Error finding container dac539d2dabd9716815a8faa2982381c48127f727165a73eb363e515c18b469f: Status 404 returned error can't find the container with id dac539d2dabd9716815a8faa2982381c48127f727165a73eb363e515c18b469f
Jul 08 23:18:13.012412 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:13.012380    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4" event={"ID":"cedde334-a802-4993-918c-e5715bdfcc4f","Type":"ContainerStarted","Data":"dac539d2dabd9716815a8faa2982381c48127f727165a73eb363e515c18b469f"}
Jul 08 23:18:15.023316 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.023290    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4" event={"ID":"cedde334-a802-4993-918c-e5715bdfcc4f","Type":"ContainerStarted","Data":"50260e77ac281e7185809437683b82be84fe15b1eabce9473dc495ea77f8687c"}
Jul 08 23:18:15.023682 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.023362    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"
Jul 08 23:18:15.043342 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.043300    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4" podStartSLOduration=0.766836544 podStartE2EDuration="3.043286802s" totalImagesPullingTime="2.276450258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:15.042700102 +0000 UTC m=+638.591759695" watchObservedRunningTime="2026-07-08 23:18:15.043286802 +0000 UTC m=+638.592346393"
Jul 08 23:18:15.366184 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.366153    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"]
Jul 08 23:18:15.369843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.369824    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"
Jul 08 23:18:15.372307 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.372288    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nwhdh\""
Jul 08 23:18:15.383361 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.383338    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"]
Jul 08 23:18:15.428802 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.428769    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9qx8\" (UniqueName: \"kubernetes.io/projected/b3f7fd26-c1fe-4403-8156-a72e477ad504-kube-api-access-l9qx8\") pod \"authorino-operator-75cc8d5cb7-n25mc\" (UID: \"b3f7fd26-c1fe-4403-8156-a72e477ad504\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"
Jul 08 23:18:15.529593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.529568    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9qx8\" (UniqueName: \"kubernetes.io/projected/b3f7fd26-c1fe-4403-8156-a72e477ad504-kube-api-access-l9qx8\") pod \"authorino-operator-75cc8d5cb7-n25mc\" (UID: \"b3f7fd26-c1fe-4403-8156-a72e477ad504\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"
Jul 08 23:18:15.544733 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.544708    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9qx8\" (UniqueName: \"kubernetes.io/projected/b3f7fd26-c1fe-4403-8156-a72e477ad504-kube-api-access-l9qx8\") pod \"authorino-operator-75cc8d5cb7-n25mc\" (UID: \"b3f7fd26-c1fe-4403-8156-a72e477ad504\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"
Jul 08 23:18:15.685245 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.685181    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"
Jul 08 23:18:15.817480 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:15.817459    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"]
Jul 08 23:18:15.819313 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:15.819285    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f7fd26_c1fe_4403_8156_a72e477ad504.slice/crio-d3bfc6f737726646894bdad89fdcd16a86569d8522dbee9584d89b52d1ea063c WatchSource:0}: Error finding container d3bfc6f737726646894bdad89fdcd16a86569d8522dbee9584d89b52d1ea063c: Status 404 returned error can't find the container with id d3bfc6f737726646894bdad89fdcd16a86569d8522dbee9584d89b52d1ea063c
Jul 08 23:18:16.030460 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:16.030378    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc" event={"ID":"b3f7fd26-c1fe-4403-8156-a72e477ad504","Type":"ContainerStarted","Data":"d3bfc6f737726646894bdad89fdcd16a86569d8522dbee9584d89b52d1ea063c"}
Jul 08 23:18:18.045134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.045088    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd" event={"ID":"7281a9ed-c7bf-4b06-8250-4c23fa21f90b","Type":"ContainerStarted","Data":"acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3"}
Jul 08 23:18:18.045630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.045188    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:18.088691 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.088626    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd" podStartSLOduration=1.447312355 podStartE2EDuration="8.088603763s" totalImagesPullingTime="6.641291408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:18.08693979 +0000 UTC m=+641.635999383" watchObservedRunningTime="2026-07-08 23:18:18.088603763 +0000 UTC m=+641.637663358"
Jul 08 23:18:18.157418 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.157381    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"]
Jul 08 23:18:18.165846 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.165820    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:18.170582 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.170408    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fg9tj\""
Jul 08 23:18:18.174322 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.174298    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"]
Jul 08 23:18:18.255357 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.255323    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx46d\" (UniqueName: \"kubernetes.io/projected/9424b170-2c20-4a30-97ee-00afe4d1a84b-kube-api-access-xx46d\") pod \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" (UID: \"9424b170-2c20-4a30-97ee-00afe4d1a84b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:18.356217 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.356186    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx46d\" (UniqueName: \"kubernetes.io/projected/9424b170-2c20-4a30-97ee-00afe4d1a84b-kube-api-access-xx46d\") pod \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" (UID: \"9424b170-2c20-4a30-97ee-00afe4d1a84b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:18.367245 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.367216    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx46d\" (UniqueName: \"kubernetes.io/projected/9424b170-2c20-4a30-97ee-00afe4d1a84b-kube-api-access-xx46d\") pod \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" (UID: \"9424b170-2c20-4a30-97ee-00afe4d1a84b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:18.480585 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:18.480552    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:19.081029 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:19.081007    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"]
Jul 08 23:18:19.082739 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:19.082717    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9424b170_2c20_4a30_97ee_00afe4d1a84b.slice/crio-b4a60c5a7b56af1ea62d30ef727e8d8ddd7408ed5eee52acf237bc4fb0a49e03 WatchSource:0}: Error finding container b4a60c5a7b56af1ea62d30ef727e8d8ddd7408ed5eee52acf237bc4fb0a49e03: Status 404 returned error can't find the container with id b4a60c5a7b56af1ea62d30ef727e8d8ddd7408ed5eee52acf237bc4fb0a49e03
Jul 08 23:18:20.067075 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.067041    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc" event={"ID":"b3f7fd26-c1fe-4403-8156-a72e477ad504","Type":"ContainerStarted","Data":"8b6cc20ef0b5a88c06ef52f1fe3de725bbfb596c3693b267c7e60cd4c49e83c8"}
Jul 08 23:18:20.067261 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.067133    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"
Jul 08 23:18:20.068249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.068222    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj" event={"ID":"9424b170-2c20-4a30-97ee-00afe4d1a84b","Type":"ContainerStarted","Data":"b4a60c5a7b56af1ea62d30ef727e8d8ddd7408ed5eee52acf237bc4fb0a49e03"}
Jul 08 23:18:20.084803 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.084752    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc" podStartSLOduration=1.901806547 podStartE2EDuration="5.084734535s" totalImagesPullingTime="3.182927988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:20.081849354 +0000 UTC m=+643.630908961" watchObservedRunningTime="2026-07-08 23:18:20.084734535 +0000 UTC m=+643.633794130"
Jul 08 23:18:20.311079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.307057    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c95c75cb-nz9hh"]
Jul 08 23:18:20.311657 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.311634    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.319066 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.319005    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c95c75cb-nz9hh"]
Jul 08 23:18:20.367803 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.367774    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"]
Jul 08 23:18:20.371280 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.371260    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.373736 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373704    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d077928-2fab-4c25-89bc-762266624e55-console-oauth-config\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.373852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373741    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d077928-2fab-4c25-89bc-762266624e55-console-serving-cert\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.373852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373784    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-trusted-ca-bundle\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.373852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373815    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 08 23:18:20.373852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373833    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-service-ca\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.373852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373846    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2p9z9\""
Jul 08 23:18:20.374138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373919    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 08 23:18:20.374138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373923    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-oauth-serving-cert\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.374138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.373947    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ht4g\" (UniqueName: \"kubernetes.io/projected/9d077928-2fab-4c25-89bc-762266624e55-kube-api-access-7ht4g\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.374138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.374035    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-console-config\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.379399 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.379371    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"]
Jul 08 23:18:20.474945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.474912    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e592360-1666-4c7b-895b-5aba3fe797c2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.474945 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.474948    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-console-config\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.475185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.474974    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e592360-1666-4c7b-895b-5aba3fe797c2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.475185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475013    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg7lc\" (UniqueName: \"kubernetes.io/projected/1e592360-1666-4c7b-895b-5aba3fe797c2-kube-api-access-gg7lc\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.475185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475073    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d077928-2fab-4c25-89bc-762266624e55-console-oauth-config\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.475185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475102    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d077928-2fab-4c25-89bc-762266624e55-console-serving-cert\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.475185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475130    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-trusted-ca-bundle\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.475185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475181    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-service-ca\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.475512 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475268    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-oauth-serving-cert\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.475512 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475288    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ht4g\" (UniqueName: \"kubernetes.io/projected/9d077928-2fab-4c25-89bc-762266624e55-kube-api-access-7ht4g\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.475815 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475787    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-console-config\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.475957 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.475935    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-service-ca\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.476028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.476007    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-trusted-ca-bundle\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.476143 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.476125    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d077928-2fab-4c25-89bc-762266624e55-oauth-serving-cert\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.477661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.477636    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d077928-2fab-4c25-89bc-762266624e55-console-oauth-config\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.477761 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.477733    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d077928-2fab-4c25-89bc-762266624e55-console-serving-cert\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.492939 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.492918    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ht4g\" (UniqueName: \"kubernetes.io/projected/9d077928-2fab-4c25-89bc-762266624e55-kube-api-access-7ht4g\") pod \"console-5c95c75cb-nz9hh\" (UID: \"9d077928-2fab-4c25-89bc-762266624e55\") " pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.576636 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.576569    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e592360-1666-4c7b-895b-5aba3fe797c2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.576636 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.576614    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg7lc\" (UniqueName: \"kubernetes.io/projected/1e592360-1666-4c7b-895b-5aba3fe797c2-kube-api-access-gg7lc\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.576881 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.576859    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e592360-1666-4c7b-895b-5aba3fe797c2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.576968 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:20.576955    2586 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 08 23:18:20.577036 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:20.577004    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e592360-1666-4c7b-895b-5aba3fe797c2-plugin-serving-cert podName:1e592360-1666-4c7b-895b-5aba3fe797c2 nodeName:}" failed. No retries permitted until 2026-07-08 23:18:21.076990725 +0000 UTC m=+644.626050295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1e592360-1666-4c7b-895b-5aba3fe797c2-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-csc9r" (UID: "1e592360-1666-4c7b-895b-5aba3fe797c2") : secret "plugin-serving-cert" not found
Jul 08 23:18:20.577231 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.577215    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e592360-1666-4c7b-895b-5aba3fe797c2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.587395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.587372    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg7lc\" (UniqueName: \"kubernetes.io/projected/1e592360-1666-4c7b-895b-5aba3fe797c2-kube-api-access-gg7lc\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:20.624002 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.623967    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:20.756114 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:20.756093    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c95c75cb-nz9hh"]
Jul 08 23:18:20.758600 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:20.758566    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d077928_2fab_4c25_89bc_762266624e55.slice/crio-6d1b80e36531fd73989bf8ccdc07f9ae3a23f93ab192a953b142c52dacc9cafb WatchSource:0}: Error finding container 6d1b80e36531fd73989bf8ccdc07f9ae3a23f93ab192a953b142c52dacc9cafb: Status 404 returned error can't find the container with id 6d1b80e36531fd73989bf8ccdc07f9ae3a23f93ab192a953b142c52dacc9cafb
Jul 08 23:18:21.078185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:21.078136    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c95c75cb-nz9hh" event={"ID":"9d077928-2fab-4c25-89bc-762266624e55","Type":"ContainerStarted","Data":"303f751d0318ce9bc2425b99166ac29be16f273d97a63d4a611d0a0b5c655650"}
Jul 08 23:18:21.078385 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:21.078201    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c95c75cb-nz9hh" event={"ID":"9d077928-2fab-4c25-89bc-762266624e55","Type":"ContainerStarted","Data":"6d1b80e36531fd73989bf8ccdc07f9ae3a23f93ab192a953b142c52dacc9cafb"}
Jul 08 23:18:21.083404 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:21.083031    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e592360-1666-4c7b-895b-5aba3fe797c2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:21.085710 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:21.085685    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e592360-1666-4c7b-895b-5aba3fe797c2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-csc9r\" (UID: \"1e592360-1666-4c7b-895b-5aba3fe797c2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:21.101497 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:21.101457    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c95c75cb-nz9hh" podStartSLOduration=1.101443851 podStartE2EDuration="1.101443851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:21.099941954 +0000 UTC m=+644.649001547" watchObservedRunningTime="2026-07-08 23:18:21.101443851 +0000 UTC m=+644.650503442"
Jul 08 23:18:21.281607 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:21.281579    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"
Jul 08 23:18:21.413350 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:21.413327    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r"]
Jul 08 23:18:21.414764 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:21.414744    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e592360_1666_4c7b_895b_5aba3fe797c2.slice/crio-17b5d5f03af3bd79e3fc4b8bc541176ed6e51b75e4edad3a3c1875bedaad96ef WatchSource:0}: Error finding container 17b5d5f03af3bd79e3fc4b8bc541176ed6e51b75e4edad3a3c1875bedaad96ef: Status 404 returned error can't find the container with id 17b5d5f03af3bd79e3fc4b8bc541176ed6e51b75e4edad3a3c1875bedaad96ef
Jul 08 23:18:22.085715 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:22.085676    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r" event={"ID":"1e592360-1666-4c7b-895b-5aba3fe797c2","Type":"ContainerStarted","Data":"17b5d5f03af3bd79e3fc4b8bc541176ed6e51b75e4edad3a3c1875bedaad96ef"}
Jul 08 23:18:22.087257 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:22.087233    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj" event={"ID":"9424b170-2c20-4a30-97ee-00afe4d1a84b","Type":"ContainerStarted","Data":"223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7"}
Jul 08 23:18:22.087463 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:22.087446    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:22.107164 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:22.107120    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj" podStartSLOduration=2.050589536 podStartE2EDuration="4.107105829s" totalImagesPullingTime="2.056516293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:22.106074257 +0000 UTC m=+645.655133852" watchObservedRunningTime="2026-07-08 23:18:22.107105829 +0000 UTC m=+645.656165474"
Jul 08 23:18:26.033020 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:26.032992    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h27w4"
Jul 08 23:18:29.062189 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:29.062157    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:30.624289 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.624252    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:30.624756 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.624326    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:30.629693 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.629667    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:30.812205 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.812171    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"]
Jul 08 23:18:30.812426 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.812386    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" containerName="manager" containerID="cri-o://acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3" gracePeriod=2
Jul 08 23:18:30.827115 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.827075    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"]
Jul 08 23:18:30.834658 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:30.834627    2586 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\": pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:30.859739 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.859612    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"]
Jul 08 23:18:30.859878 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.859829    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" containerName="manager" containerID="cri-o://223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7" gracePeriod=2
Jul 08 23:18:30.861948 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.861919    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:30.863264 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.863238    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"]
Jul 08 23:18:30.863829 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.863808    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" containerName="manager"
Jul 08 23:18:30.863923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.863832    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" containerName="manager"
Jul 08 23:18:30.863982 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.863944    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" containerName="manager"
Jul 08 23:18:30.867447 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.867427    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:30.874039 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:30.873997    2586 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9424b170-2c20-4a30-97ee-00afe4d1a84b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-5w5gj\": pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:30.875124 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.875057    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"]
Jul 08 23:18:30.876794 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:30.876599    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:30.879592 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:30.879558    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:30.881162 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.881127    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"]
Jul 08 23:18:30.881867 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:30.881842    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:30.894742 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.894698    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"]
Jul 08 23:18:30.895649 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.895280    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" containerName="manager"
Jul 08 23:18:30.895649 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.895303    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" containerName="manager"
Jul 08 23:18:30.895649 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.895390    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" containerName="manager"
Jul 08 23:18:30.899739 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.899599    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"
Jul 08 23:18:30.911909 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.911824    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"]
Jul 08 23:18:30.913144 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:30.913016    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:30.916735 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:30.916692    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:30.978433 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.978403    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjtfm\" (UniqueName: \"kubernetes.io/projected/fe898d03-80df-4216-8a8b-151f3cb33b66-kube-api-access-kjtfm\") pod \"kuadrant-operator-controller-manager-55467d9f7-sqclt\" (UID: \"fe898d03-80df-4216-8a8b-151f3cb33b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:30.978598 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.978458    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe898d03-80df-4216-8a8b-151f3cb33b66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sqclt\" (UID: \"fe898d03-80df-4216-8a8b-151f3cb33b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:30.978598 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:30.978511    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m27s\" (UniqueName: \"kubernetes.io/projected/c5333a7c-80f9-4a06-994c-99ef238ff885-kube-api-access-8m27s\") pod \"limitador-operator-controller-manager-859d7b78bd-h66xn\" (UID: \"c5333a7c-80f9-4a06-994c-99ef238ff885\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"
Jul 08 23:18:31.079185 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.079128    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m27s\" (UniqueName: \"kubernetes.io/projected/c5333a7c-80f9-4a06-994c-99ef238ff885-kube-api-access-8m27s\") pod \"limitador-operator-controller-manager-859d7b78bd-h66xn\" (UID: \"c5333a7c-80f9-4a06-994c-99ef238ff885\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"
Jul 08 23:18:31.079396 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.079245    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjtfm\" (UniqueName: \"kubernetes.io/projected/fe898d03-80df-4216-8a8b-151f3cb33b66-kube-api-access-kjtfm\") pod \"kuadrant-operator-controller-manager-55467d9f7-sqclt\" (UID: \"fe898d03-80df-4216-8a8b-151f3cb33b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:31.079396 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.079305    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe898d03-80df-4216-8a8b-151f3cb33b66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sqclt\" (UID: \"fe898d03-80df-4216-8a8b-151f3cb33b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:31.079757 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.079731    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe898d03-80df-4216-8a8b-151f3cb33b66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sqclt\" (UID: \"fe898d03-80df-4216-8a8b-151f3cb33b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:31.081414 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.081367    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n25mc"
Jul 08 23:18:31.083723 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:31.083697    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:31.088222 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.088188    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m27s\" (UniqueName: \"kubernetes.io/projected/c5333a7c-80f9-4a06-994c-99ef238ff885-kube-api-access-8m27s\") pod \"limitador-operator-controller-manager-859d7b78bd-h66xn\" (UID: \"c5333a7c-80f9-4a06-994c-99ef238ff885\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"
Jul 08 23:18:31.088640 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.088591    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjtfm\" (UniqueName: \"kubernetes.io/projected/fe898d03-80df-4216-8a8b-151f3cb33b66-kube-api-access-kjtfm\") pod \"kuadrant-operator-controller-manager-55467d9f7-sqclt\" (UID: \"fe898d03-80df-4216-8a8b-151f3cb33b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:31.104289 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:31.104252    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:31.149961 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.149878    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c95c75cb-nz9hh"
Jul 08 23:18:31.152247 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:31.152202    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:31.176200 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:31.176170    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:31.210478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.210451    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66cc4449fd-kg5gh"]
Jul 08 23:18:31.233905 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.233876    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:31.238011 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:31.237880    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:31.240071 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:31.240040    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:31.241380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:31.241347    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"
Jul 08 23:18:44.462783 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.462759    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"]
Jul 08 23:18:44.464076 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:44.464037    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe898d03_80df_4216_8a8b_151f3cb33b66.slice/crio-743071adaa5705f806a8caaab77d8b7cba6578ce9535d2638dcf12c3a4688afb WatchSource:0}: Error finding container 743071adaa5705f806a8caaab77d8b7cba6578ce9535d2638dcf12c3a4688afb: Status 404 returned error can't find the container with id 743071adaa5705f806a8caaab77d8b7cba6578ce9535d2638dcf12c3a4688afb
Jul 08 23:18:44.464423 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.464384    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:44.467492 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:44.467462    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:44.467764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.467750    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:44.469739 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:44.469712    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:44.471692 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:44.471615    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:44.490292 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.490268    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"]
Jul 08 23:18:44.498605 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:44.498579    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5333a7c_80f9_4a06_994c_99ef238ff885.slice/crio-e97cba26b2bc49a8d96692a071d0de33d916ede93b17b76b93b5f0e02ea799ee WatchSource:0}: Error finding container e97cba26b2bc49a8d96692a071d0de33d916ede93b17b76b93b5f0e02ea799ee: Status 404 returned error can't find the container with id e97cba26b2bc49a8d96692a071d0de33d916ede93b17b76b93b5f0e02ea799ee
Jul 08 23:18:44.614691 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.614661    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-extensions-socket-volume\") pod \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\" (UID: \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\") "
Jul 08 23:18:44.614841 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.614726    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx46d\" (UniqueName: \"kubernetes.io/projected/9424b170-2c20-4a30-97ee-00afe4d1a84b-kube-api-access-xx46d\") pod \"9424b170-2c20-4a30-97ee-00afe4d1a84b\" (UID: \"9424b170-2c20-4a30-97ee-00afe4d1a84b\") "
Jul 08 23:18:44.614841 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.614760    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs77k\" (UniqueName: \"kubernetes.io/projected/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-kube-api-access-gs77k\") pod \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\" (UID: \"7281a9ed-c7bf-4b06-8250-4c23fa21f90b\") "
Jul 08 23:18:44.615217 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.615182    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7281a9ed-c7bf-4b06-8250-4c23fa21f90b" (UID: "7281a9ed-c7bf-4b06-8250-4c23fa21f90b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:18:44.616700 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.616678    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9424b170-2c20-4a30-97ee-00afe4d1a84b-kube-api-access-xx46d" (OuterVolumeSpecName: "kube-api-access-xx46d") pod "9424b170-2c20-4a30-97ee-00afe4d1a84b" (UID: "9424b170-2c20-4a30-97ee-00afe4d1a84b"). InnerVolumeSpecName "kube-api-access-xx46d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:18:44.616799 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.616717    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-kube-api-access-gs77k" (OuterVolumeSpecName: "kube-api-access-gs77k") pod "7281a9ed-c7bf-4b06-8250-4c23fa21f90b" (UID: "7281a9ed-c7bf-4b06-8250-4c23fa21f90b"). InnerVolumeSpecName "kube-api-access-gs77k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:18:44.715773 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.715741    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs77k\" (UniqueName: \"kubernetes.io/projected/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-kube-api-access-gs77k\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:44.715773 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.715766    2586 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7281a9ed-c7bf-4b06-8250-4c23fa21f90b-extensions-socket-volume\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:44.715773 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:44.715775    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx46d\" (UniqueName: \"kubernetes.io/projected/9424b170-2c20-4a30-97ee-00afe4d1a84b-kube-api-access-xx46d\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:45.230302 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.230268    2586 generic.go:356] "Generic (PLEG): container finished" podID="9424b170-2c20-4a30-97ee-00afe4d1a84b" containerID="223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7" exitCode=0
Jul 08 23:18:45.230493 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.230312    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:45.230493 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.230376    2586 scope.go:117] "RemoveContainer" containerID="223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7"
Jul 08 23:18:45.232193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.232167    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r" event={"ID":"1e592360-1666-4c7b-895b-5aba3fe797c2","Type":"ContainerStarted","Data":"fca625a39a9fca3c45c80ce1acd7814925724bd97ae1a3ac0832bb2e5585a2bd"}
Jul 08 23:18:45.232614 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:45.232591    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:45.234064 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.234044    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt" event={"ID":"fe898d03-80df-4216-8a8b-151f3cb33b66","Type":"ContainerStarted","Data":"79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f"}
Jul 08 23:18:45.234171 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.234079    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt" event={"ID":"fe898d03-80df-4216-8a8b-151f3cb33b66","Type":"ContainerStarted","Data":"743071adaa5705f806a8caaab77d8b7cba6578ce9535d2638dcf12c3a4688afb"}
Jul 08 23:18:45.234171 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.234099    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:45.234463 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:45.234434    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:45.235478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.235457    2586 generic.go:356] "Generic (PLEG): container finished" podID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" containerID="acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3" exitCode=0
Jul 08 23:18:45.235604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.235498    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:45.236330 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:45.236297    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:45.237190 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.237171    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn" event={"ID":"c5333a7c-80f9-4a06-994c-99ef238ff885","Type":"ContainerStarted","Data":"acbcedaef8270951025d8e7ea0f2fe02536876182ea4c6bd3556b45914065f4f"}
Jul 08 23:18:45.237276 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.237213    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn" event={"ID":"c5333a7c-80f9-4a06-994c-99ef238ff885","Type":"ContainerStarted","Data":"e97cba26b2bc49a8d96692a071d0de33d916ede93b17b76b93b5f0e02ea799ee"}
Jul 08 23:18:45.237276 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.237263    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"
Jul 08 23:18:45.240425 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.240401    2586 scope.go:117] "RemoveContainer" containerID="223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7"
Jul 08 23:18:45.240675 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:45.240658    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7\": container with ID starting with 223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7 not found: ID does not exist" containerID="223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7"
Jul 08 23:18:45.240743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.240683    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7"} err="failed to get container status \"223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7\": rpc error: code = NotFound desc = could not find container \"223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7\": container with ID starting with 223818304da45db6995961d6b9ddaa75f87b5a01d5233648c821a1d99e6b58a7 not found: ID does not exist"
Jul 08 23:18:45.240743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.240697    2586 scope.go:117] "RemoveContainer" containerID="acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3"
Jul 08 23:18:45.250029 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.250013    2586 scope.go:117] "RemoveContainer" containerID="acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3"
Jul 08 23:18:45.250316 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:45.250296    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3\": container with ID starting with acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3 not found: ID does not exist" containerID="acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3"
Jul 08 23:18:45.250388 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.250324    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3"} err="failed to get container status \"acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3\": rpc error: code = NotFound desc = could not find container \"acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3\": container with ID starting with acc4ee73443333d0e4b2b15e7cc7e833b0e79ae26e51889e37285e6eb8d749d3 not found: ID does not exist"
Jul 08 23:18:45.253738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.253700    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-csc9r" podStartSLOduration=2.299220581 podStartE2EDuration="25.253687739s" totalImagesPullingTime="22.954467158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:45.251747217 +0000 UTC m=+668.800806824" watchObservedRunningTime="2026-07-08 23:18:45.253687739 +0000 UTC m=+668.802747378"
Jul 08 23:18:45.254016 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:45.253988    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:45.275255 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.275207    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt" podStartSLOduration=15.275194733 podStartE2EDuration="15.275194733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:45.273816645 +0000 UTC m=+668.822876238" watchObservedRunningTime="2026-07-08 23:18:45.275194733 +0000 UTC m=+668.824254325"
Jul 08 23:18:45.275832 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:45.275808    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kn7wd\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kn7wd"
Jul 08 23:18:45.279775 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:45.279752    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5w5gj\" is forbidden: User \"system:node:ip-10-0-138-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-15.ec2.internal' and this object" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5w5gj"
Jul 08 23:18:45.297147 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.297110    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn" podStartSLOduration=15.297097606 podStartE2EDuration="15.297097606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:45.296231194 +0000 UTC m=+668.845290788" watchObservedRunningTime="2026-07-08 23:18:45.297097606 +0000 UTC m=+668.846157197"
Jul 08 23:18:45.534073 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.533990    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7281a9ed-c7bf-4b06-8250-4c23fa21f90b" path="/var/lib/kubelet/pods/7281a9ed-c7bf-4b06-8250-4c23fa21f90b/volumes"
Jul 08 23:18:45.534411 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:45.534310    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9424b170-2c20-4a30-97ee-00afe4d1a84b" path="/var/lib/kubelet/pods/9424b170-2c20-4a30-97ee-00afe4d1a84b/volumes"
Jul 08 23:18:56.237214 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.237166    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66cc4449fd-kg5gh" podUID="d215a3d1-342e-4321-9050-233601e6f56f" containerName="console" containerID="cri-o://98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045" gracePeriod=15
Jul 08 23:18:56.246476 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.246452    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:18:56.246608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.246588    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h66xn"
Jul 08 23:18:56.514662 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.514637    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:18:56.554001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.553971    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"]
Jul 08 23:18:56.554507 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.554484    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d215a3d1-342e-4321-9050-233601e6f56f" containerName="console"
Jul 08 23:18:56.554507 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.554507    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="d215a3d1-342e-4321-9050-233601e6f56f" containerName="console"
Jul 08 23:18:56.554704 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.554618    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="d215a3d1-342e-4321-9050-233601e6f56f" containerName="console"
Jul 08 23:18:56.578169 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.578137    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"]
Jul 08 23:18:56.578328 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.578243    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:56.616142 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616116    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-console-config\") pod \"d215a3d1-342e-4321-9050-233601e6f56f\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") "
Jul 08 23:18:56.616286 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616152    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-oauth-serving-cert\") pod \"d215a3d1-342e-4321-9050-233601e6f56f\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") "
Jul 08 23:18:56.616286 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616178    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vn28\" (UniqueName: \"kubernetes.io/projected/d215a3d1-342e-4321-9050-233601e6f56f-kube-api-access-8vn28\") pod \"d215a3d1-342e-4321-9050-233601e6f56f\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") "
Jul 08 23:18:56.616286 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616206    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-oauth-config\") pod \"d215a3d1-342e-4321-9050-233601e6f56f\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") "
Jul 08 23:18:56.616286 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616263    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-service-ca\") pod \"d215a3d1-342e-4321-9050-233601e6f56f\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") "
Jul 08 23:18:56.616501 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616304    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-trusted-ca-bundle\") pod \"d215a3d1-342e-4321-9050-233601e6f56f\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") "
Jul 08 23:18:56.616501 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616327    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-serving-cert\") pod \"d215a3d1-342e-4321-9050-233601e6f56f\" (UID: \"d215a3d1-342e-4321-9050-233601e6f56f\") "
Jul 08 23:18:56.616627 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616491    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d215a3d1-342e-4321-9050-233601e6f56f" (UID: "d215a3d1-342e-4321-9050-233601e6f56f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:18:56.616711 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616687    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-console-config" (OuterVolumeSpecName: "console-config") pod "d215a3d1-342e-4321-9050-233601e6f56f" (UID: "d215a3d1-342e-4321-9050-233601e6f56f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:18:56.616770 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616703    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d215a3d1-342e-4321-9050-233601e6f56f" (UID: "d215a3d1-342e-4321-9050-233601e6f56f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:18:56.616770 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616717    2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-oauth-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:56.616770 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.616750    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d215a3d1-342e-4321-9050-233601e6f56f" (UID: "d215a3d1-342e-4321-9050-233601e6f56f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:18:56.618437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.618415    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d215a3d1-342e-4321-9050-233601e6f56f" (UID: "d215a3d1-342e-4321-9050-233601e6f56f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:18:56.618590 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.618461    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d215a3d1-342e-4321-9050-233601e6f56f-kube-api-access-8vn28" (OuterVolumeSpecName: "kube-api-access-8vn28") pod "d215a3d1-342e-4321-9050-233601e6f56f" (UID: "d215a3d1-342e-4321-9050-233601e6f56f"). InnerVolumeSpecName "kube-api-access-8vn28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:18:56.618659 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.618645    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d215a3d1-342e-4321-9050-233601e6f56f" (UID: "d215a3d1-342e-4321-9050-233601e6f56f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:18:56.717665 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.717627    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k4vf8\" (UID: \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:56.717859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.717688    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xj6c\" (UniqueName: \"kubernetes.io/projected/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-kube-api-access-8xj6c\") pod \"kuadrant-operator-controller-manager-86878c769f-k4vf8\" (UID: \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:56.717859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.717770    2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-oauth-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:56.717859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.717792    2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-service-ca\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:56.717859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.717814    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-trusted-ca-bundle\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:56.717859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.717827    2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d215a3d1-342e-4321-9050-233601e6f56f-console-serving-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:56.717859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.717842    2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d215a3d1-342e-4321-9050-233601e6f56f-console-config\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:56.717859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.717854    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vn28\" (UniqueName: \"kubernetes.io/projected/d215a3d1-342e-4321-9050-233601e6f56f-kube-api-access-8vn28\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:18:56.820469 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.820399    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k4vf8\" (UID: \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:56.820469 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.820446    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xj6c\" (UniqueName: \"kubernetes.io/projected/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-kube-api-access-8xj6c\") pod \"kuadrant-operator-controller-manager-86878c769f-k4vf8\" (UID: \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:56.820825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.820800    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k4vf8\" (UID: \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:56.835134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.835106    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xj6c\" (UniqueName: \"kubernetes.io/projected/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-kube-api-access-8xj6c\") pod \"kuadrant-operator-controller-manager-86878c769f-k4vf8\" (UID: \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:56.889099 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:56.889072    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:57.041562 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.041533    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"]
Jul 08 23:18:57.045071 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:18:57.045045    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8f6e46_68aa_44c4_ab13_2a55afb15aaf.slice/crio-2f731297869e4d5d8a6da78ff04fd68acf80cfae8ab10ae2c7f06437e110418e WatchSource:0}: Error finding container 2f731297869e4d5d8a6da78ff04fd68acf80cfae8ab10ae2c7f06437e110418e: Status 404 returned error can't find the container with id 2f731297869e4d5d8a6da78ff04fd68acf80cfae8ab10ae2c7f06437e110418e
Jul 08 23:18:57.306003 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.305968    2586 generic.go:356] "Generic (PLEG): container finished" podID="d215a3d1-342e-4321-9050-233601e6f56f" containerID="98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045" exitCode=0
Jul 08 23:18:57.306451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.306003    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cc4449fd-kg5gh" event={"ID":"d215a3d1-342e-4321-9050-233601e6f56f","Type":"ContainerDied","Data":"98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045"}
Jul 08 23:18:57.306451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.306055    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cc4449fd-kg5gh"
Jul 08 23:18:57.306451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.306073    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cc4449fd-kg5gh" event={"ID":"d215a3d1-342e-4321-9050-233601e6f56f","Type":"ContainerDied","Data":"3d201484c8dc6185f60d7f048261d8a3598673f09d081a434d139b87a4801c48"}
Jul 08 23:18:57.306451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.306100    2586 scope.go:117] "RemoveContainer" containerID="98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045"
Jul 08 23:18:57.308244 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.308215    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8" event={"ID":"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf","Type":"ContainerStarted","Data":"c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de"}
Jul 08 23:18:57.308380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.308280    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:18:57.308380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.308305    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8" event={"ID":"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf","Type":"ContainerStarted","Data":"2f731297869e4d5d8a6da78ff04fd68acf80cfae8ab10ae2c7f06437e110418e"}
Jul 08 23:18:57.315944 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.315928    2586 scope.go:117] "RemoveContainer" containerID="98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045"
Jul 08 23:18:57.316171 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:18:57.316154    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045\": container with ID starting with 98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045 not found: ID does not exist" containerID="98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045"
Jul 08 23:18:57.316210 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.316179    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045"} err="failed to get container status \"98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045\": rpc error: code = NotFound desc = could not find container \"98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045\": container with ID starting with 98a55a5815f6a8076863a66dc67280a97c78d95515a3547ffa3213c9758fe045 not found: ID does not exist"
Jul 08 23:18:57.330406 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.330354    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66cc4449fd-kg5gh"]
Jul 08 23:18:57.342057 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.342026    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66cc4449fd-kg5gh"]
Jul 08 23:18:57.368136 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.368081    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8" podStartSLOduration=1.368063386 podStartE2EDuration="1.368063386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:57.365011156 +0000 UTC m=+680.914070748" watchObservedRunningTime="2026-07-08 23:18:57.368063386 +0000 UTC m=+680.917122980"
Jul 08 23:18:57.533509 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:18:57.533473    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d215a3d1-342e-4321-9050-233601e6f56f" path="/var/lib/kubelet/pods/d215a3d1-342e-4321-9050-233601e6f56f/volumes"
Jul 08 23:19:08.317229 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.317195    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:19:08.363393 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.363363    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"]
Jul 08 23:19:08.363653 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.363628    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt" podUID="fe898d03-80df-4216-8a8b-151f3cb33b66" containerName="manager" containerID="cri-o://79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f" gracePeriod=10
Jul 08 23:19:08.615379 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.615355    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:19:08.711903 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.711876    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe898d03-80df-4216-8a8b-151f3cb33b66-extensions-socket-volume\") pod \"fe898d03-80df-4216-8a8b-151f3cb33b66\" (UID: \"fe898d03-80df-4216-8a8b-151f3cb33b66\") "
Jul 08 23:19:08.712038 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.711922    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjtfm\" (UniqueName: \"kubernetes.io/projected/fe898d03-80df-4216-8a8b-151f3cb33b66-kube-api-access-kjtfm\") pod \"fe898d03-80df-4216-8a8b-151f3cb33b66\" (UID: \"fe898d03-80df-4216-8a8b-151f3cb33b66\") "
Jul 08 23:19:08.712308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.712286    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe898d03-80df-4216-8a8b-151f3cb33b66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe898d03-80df-4216-8a8b-151f3cb33b66" (UID: "fe898d03-80df-4216-8a8b-151f3cb33b66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:19:08.713962 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.713946    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe898d03-80df-4216-8a8b-151f3cb33b66-kube-api-access-kjtfm" (OuterVolumeSpecName: "kube-api-access-kjtfm") pod "fe898d03-80df-4216-8a8b-151f3cb33b66" (UID: "fe898d03-80df-4216-8a8b-151f3cb33b66"). InnerVolumeSpecName "kube-api-access-kjtfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:19:08.812390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.812359    2586 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe898d03-80df-4216-8a8b-151f3cb33b66-extensions-socket-volume\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:19:08.812390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:08.812385    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjtfm\" (UniqueName: \"kubernetes.io/projected/fe898d03-80df-4216-8a8b-151f3cb33b66-kube-api-access-kjtfm\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:19:09.379023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.378987    2586 generic.go:356] "Generic (PLEG): container finished" podID="fe898d03-80df-4216-8a8b-151f3cb33b66" containerID="79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f" exitCode=0
Jul 08 23:19:09.379446 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.379031    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"
Jul 08 23:19:09.379446 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.379048    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt" event={"ID":"fe898d03-80df-4216-8a8b-151f3cb33b66","Type":"ContainerDied","Data":"79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f"}
Jul 08 23:19:09.379446 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.379088    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt" event={"ID":"fe898d03-80df-4216-8a8b-151f3cb33b66","Type":"ContainerDied","Data":"743071adaa5705f806a8caaab77d8b7cba6578ce9535d2638dcf12c3a4688afb"}
Jul 08 23:19:09.379446 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.379110    2586 scope.go:117] "RemoveContainer" containerID="79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f"
Jul 08 23:19:09.388551 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.388535    2586 scope.go:117] "RemoveContainer" containerID="79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f"
Jul 08 23:19:09.388770 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:19:09.388753    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f\": container with ID starting with 79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f not found: ID does not exist" containerID="79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f"
Jul 08 23:19:09.388820 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.388781    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f"} err="failed to get container status \"79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f\": rpc error: code = NotFound desc = could not find container \"79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f\": container with ID starting with 79c44a81c3ee97a648210dce5e5cd1bfd52393b277cd23b5cdbe87e598a8c15f not found: ID does not exist"
Jul 08 23:19:09.406787 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.406763    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"]
Jul 08 23:19:09.410142 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.410123    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sqclt"]
Jul 08 23:19:09.532408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:09.532389    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe898d03-80df-4216-8a8b-151f3cb33b66" path="/var/lib/kubelet/pods/fe898d03-80df-4216-8a8b-151f3cb33b66/volumes"
Jul 08 23:19:12.697652 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.697619    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"]
Jul 08 23:19:12.698030 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.698016    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe898d03-80df-4216-8a8b-151f3cb33b66" containerName="manager"
Jul 08 23:19:12.698086 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.698031    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe898d03-80df-4216-8a8b-151f3cb33b66" containerName="manager"
Jul 08 23:19:12.698121 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.698104    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe898d03-80df-4216-8a8b-151f3cb33b66" containerName="manager"
Jul 08 23:19:12.700869 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.700852    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.703366 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.703344    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zcl5t\""
Jul 08 23:19:12.713487 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.713461    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"]
Jul 08 23:19:12.738101 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738077    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.738195 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738107    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65hf5\" (UniqueName: \"kubernetes.io/projected/df1aba57-ac38-4dde-86ba-22bc6dbe4528-kube-api-access-65hf5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.738195 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738127    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.738323 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738190    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.738323 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738228    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.738323 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738282    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.738323 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738317    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.738461 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738349    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.738461 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.738384    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.838969 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.838942    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.838989    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839015    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65hf5\" (UniqueName: \"kubernetes.io/projected/df1aba57-ac38-4dde-86ba-22bc6dbe4528-kube-api-access-65hf5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839044    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839095    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839373 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839160    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839373 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839214    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839373 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839244    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839373 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839274    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839408    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839551    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839717 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839628    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839776 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839723    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.839776 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.839735    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.841558 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.841537    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.841687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.841671    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.852554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.846792    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65hf5\" (UniqueName: \"kubernetes.io/projected/df1aba57-ac38-4dde-86ba-22bc6dbe4528-kube-api-access-65hf5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:12.852554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:12.846955    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df1aba57-ac38-4dde-86ba-22bc6dbe4528-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vp674\" (UID: \"df1aba57-ac38-4dde-86ba-22bc6dbe4528\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:13.012356 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:13.012271    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:13.145459 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:13.145431    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"]
Jul 08 23:19:13.146449 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:19:13.146423    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1aba57_ac38_4dde_86ba_22bc6dbe4528.slice/crio-6fe365285ed83534770f6536c6469568b6dc242ca605a25c5253b0d5b666329a WatchSource:0}: Error finding container 6fe365285ed83534770f6536c6469568b6dc242ca605a25c5253b0d5b666329a: Status 404 returned error can't find the container with id 6fe365285ed83534770f6536c6469568b6dc242ca605a25c5253b0d5b666329a
Jul 08 23:19:13.148494 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:13.148458    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:19:13.148610 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:13.148581    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:19:13.148652 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:13.148621    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:19:13.405368 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:13.405336    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" event={"ID":"df1aba57-ac38-4dde-86ba-22bc6dbe4528","Type":"ContainerStarted","Data":"6c5af81843eef1e71acc94c9bb604b171e363e03e7e7daab1124a2ed190df0b5"}
Jul 08 23:19:13.405584 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:13.405382    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" event={"ID":"df1aba57-ac38-4dde-86ba-22bc6dbe4528","Type":"ContainerStarted","Data":"6fe365285ed83534770f6536c6469568b6dc242ca605a25c5253b0d5b666329a"}
Jul 08 23:19:13.424904 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:13.424860    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" podStartSLOduration=1.424844893 podStartE2EDuration="1.424844893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:19:13.422411439 +0000 UTC m=+696.971471035" watchObservedRunningTime="2026-07-08 23:19:13.424844893 +0000 UTC m=+696.973904484"
Jul 08 23:19:14.012559 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:14.012511    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:14.017005 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:14.016980    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:14.410469 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:14.410439    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:14.411414 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:14.411394    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:19:15.858792 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:15.858759    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:19:15.861481 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:15.861459    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:15.863730 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:15.863712    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 23:19:15.872249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:15.872228    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:19:15.903172 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:15.903147    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:19:15.967917 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:15.967892    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8287b403-04ca-41f2-9c21-201d252aaa64-config-file\") pod \"limitador-limitador-54d6d988d5-ktc7w\" (UID: \"8287b403-04ca-41f2-9c21-201d252aaa64\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:15.968031 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:15.967999    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvvpm\" (UniqueName: \"kubernetes.io/projected/8287b403-04ca-41f2-9c21-201d252aaa64-kube-api-access-lvvpm\") pod \"limitador-limitador-54d6d988d5-ktc7w\" (UID: \"8287b403-04ca-41f2-9c21-201d252aaa64\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:16.069082 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:16.069056    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvvpm\" (UniqueName: \"kubernetes.io/projected/8287b403-04ca-41f2-9c21-201d252aaa64-kube-api-access-lvvpm\") pod \"limitador-limitador-54d6d988d5-ktc7w\" (UID: \"8287b403-04ca-41f2-9c21-201d252aaa64\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:16.069187 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:16.069097    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8287b403-04ca-41f2-9c21-201d252aaa64-config-file\") pod \"limitador-limitador-54d6d988d5-ktc7w\" (UID: \"8287b403-04ca-41f2-9c21-201d252aaa64\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:16.069739 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:16.069722    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8287b403-04ca-41f2-9c21-201d252aaa64-config-file\") pod \"limitador-limitador-54d6d988d5-ktc7w\" (UID: \"8287b403-04ca-41f2-9c21-201d252aaa64\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:16.080015 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:16.079998    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvvpm\" (UniqueName: \"kubernetes.io/projected/8287b403-04ca-41f2-9c21-201d252aaa64-kube-api-access-lvvpm\") pod \"limitador-limitador-54d6d988d5-ktc7w\" (UID: \"8287b403-04ca-41f2-9c21-201d252aaa64\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:16.172241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:16.172168    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:16.310144 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:16.310123    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:19:16.311929 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:19:16.311903    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8287b403_04ca_41f2_9c21_201d252aaa64.slice/crio-cc546c357788a40127318b326cd46d789a8a6823f6da43551c4624829972f46d WatchSource:0}: Error finding container cc546c357788a40127318b326cd46d789a8a6823f6da43551c4624829972f46d: Status 404 returned error can't find the container with id cc546c357788a40127318b326cd46d789a8a6823f6da43551c4624829972f46d
Jul 08 23:19:16.422789 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:16.422700    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w" event={"ID":"8287b403-04ca-41f2-9c21-201d252aaa64","Type":"ContainerStarted","Data":"cc546c357788a40127318b326cd46d789a8a6823f6da43551c4624829972f46d"}
Jul 08 23:19:19.445630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:19.445593    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w" event={"ID":"8287b403-04ca-41f2-9c21-201d252aaa64","Type":"ContainerStarted","Data":"4a93321e4497984d09ea5f929f7b71e73c06d43a1a0d5207e4eb53667dd4050f"}
Jul 08 23:19:19.446153 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:19.445665    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:19:19.462979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:19.462932    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w" podStartSLOduration=2.04751502 podStartE2EDuration="4.462917635s" totalImagesPullingTime="2.415402615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:19:19.461383489 +0000 UTC m=+703.010443094" watchObservedRunningTime="2026-07-08 23:19:19.462917635 +0000 UTC m=+703.011977226"
Jul 08 23:19:30.452493 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:19:30.452417    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"
Jul 08 23:20:31.095344 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:31.095298    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:20:38.869950 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:38.869917    2586 generic.go:356] "Generic (PLEG): container finished" podID="df1aba57-ac38-4dde-86ba-22bc6dbe4528" containerID="6c5af81843eef1e71acc94c9bb604b171e363e03e7e7daab1124a2ed190df0b5" exitCode=0
Jul 08 23:20:38.870378 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:38.869975    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" event={"ID":"df1aba57-ac38-4dde-86ba-22bc6dbe4528","Type":"ContainerDied","Data":"6c5af81843eef1e71acc94c9bb604b171e363e03e7e7daab1124a2ed190df0b5"}
Jul 08 23:20:38.870378 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:38.870339    2586 scope.go:117] "RemoveContainer" containerID="6c5af81843eef1e71acc94c9bb604b171e363e03e7e7daab1124a2ed190df0b5"
Jul 08 23:20:38.871305 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:38.871280    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:20:38.871363 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:38.871352    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:20:38.871403 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:38.871383    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:20:39.877762 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:39.877728    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" event={"ID":"df1aba57-ac38-4dde-86ba-22bc6dbe4528","Type":"ContainerStarted","Data":"494d00eb319b0f30a3521a04dee9088a9a0a7e88129f8543f14398d08675543a"}
Jul 08 23:20:40.013203 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:40.013171    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:20:40.014409 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:40.014380    2586 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-vp674 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 08 23:20:40.014533 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:40.014435    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" podUID="df1aba57-ac38-4dde-86ba-22bc6dbe4528" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 08 23:20:41.013501 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:41.013468    2586 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-vp674 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 08 23:20:41.013910 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:41.013571    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" podUID="df1aba57-ac38-4dde-86ba-22bc6dbe4528" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 08 23:20:42.013118 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:42.013080    2586 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-vp674 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 08 23:20:42.013275 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:42.013143    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" podUID="df1aba57-ac38-4dde-86ba-22bc6dbe4528" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 08 23:20:43.012769 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:43.012735    2586 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-vp674 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 08 23:20:43.013164 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:43.012787    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674" podUID="df1aba57-ac38-4dde-86ba-22bc6dbe4528" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 08 23:20:44.036921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:44.036889    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:20:44.037397 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:44.037301    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:20:44.038033 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:44.038014    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vp674"
Jul 08 23:20:46.398988 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:20:46.398959    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:21:04.497206 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:04.497121    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:21:15.504366 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:15.504331    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:21:28.499554 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:28.499501    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:21:35.694757 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:35.694724    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:21:41.503396 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.503363    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"]
Jul 08 23:21:41.513768 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.513747    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.517640 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.517620    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nzknt\""
Jul 08 23:21:41.517814 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.517693    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 08 23:21:41.517987 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.517761    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 23:21:41.518164 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.518146    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 23:21:41.520884 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.520861    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"]
Jul 08 23:21:41.643384 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.643347    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.643604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.643397    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7scjs\" (UniqueName: \"kubernetes.io/projected/a2a95f55-7d25-4750-b45a-d53cfc335f88-kube-api-access-7scjs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.643604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.643493    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a95f55-7d25-4750-b45a-d53cfc335f88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.643604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.643558    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.643772 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.643672    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.643772 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.643731    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.744505 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.744475    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.744687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.744546    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.744687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.744582    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.744687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.744609    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.744687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.744632    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7scjs\" (UniqueName: \"kubernetes.io/projected/a2a95f55-7d25-4750-b45a-d53cfc335f88-kube-api-access-7scjs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.744687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.744673    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a95f55-7d25-4750-b45a-d53cfc335f88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.745032 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.744939    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.745571 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.745548    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.745755 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.745552    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.747370 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.747342    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2a95f55-7d25-4750-b45a-d53cfc335f88-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.747910 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.747890    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a95f55-7d25-4750-b45a-d53cfc335f88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.752637 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.752616    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7scjs\" (UniqueName: \"kubernetes.io/projected/a2a95f55-7d25-4750-b45a-d53cfc335f88-kube-api-access-7scjs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg\" (UID: \"a2a95f55-7d25-4750-b45a-d53cfc335f88\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.824904 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.824837    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:41.956736 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:41.956711    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"]
Jul 08 23:21:41.958580 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:21:41.958549    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2a95f55_7d25_4750_b45a_d53cfc335f88.slice/crio-3ea67584c322bba6d81192af902c2036ae01d95cfb5ae05fa3dcd38e71074274 WatchSource:0}: Error finding container 3ea67584c322bba6d81192af902c2036ae01d95cfb5ae05fa3dcd38e71074274: Status 404 returned error can't find the container with id 3ea67584c322bba6d81192af902c2036ae01d95cfb5ae05fa3dcd38e71074274
Jul 08 23:21:42.236768 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:42.236723    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg" event={"ID":"a2a95f55-7d25-4750-b45a-d53cfc335f88","Type":"ContainerStarted","Data":"3ea67584c322bba6d81192af902c2036ae01d95cfb5ae05fa3dcd38e71074274"}
Jul 08 23:21:43.244432 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:43.244336    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg" event={"ID":"a2a95f55-7d25-4750-b45a-d53cfc335f88","Type":"ContainerStarted","Data":"02be6d528961faf1a858afb390dbf6b1ac10f8f970a312663a458ce9bcf4cb97"}
Jul 08 23:21:43.264019 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:43.263972    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg" podStartSLOduration=1.25294501 podStartE2EDuration="2.26395935s" totalImagesPullingTime="1.01101434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:21:43.262017353 +0000 UTC m=+846.811076946" watchObservedRunningTime="2026-07-08 23:21:43.26395935 +0000 UTC m=+846.813018988"
Jul 08 23:21:45.501843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:45.501808    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:21:51.825663 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:51.825625    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:51.826241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:51.825681    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:51.838617 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:51.838586    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:21:52.304610 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:21:52.304577    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg"
Jul 08 23:22:36.921290 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:22:36.921218    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:22:36.922096 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:22:36.922079    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:22:36.929332 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:22:36.929310    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:22:36.929670 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:22:36.929653    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:23:13.408766 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:23:13.408728    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:23:22.918976 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:23:22.918938    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:23:34.398813 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:23:34.398771    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:23:43.398607 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:23:43.398570    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:23:54.011530 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:23:54.011486    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:24:21.799283 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:24:21.799246    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:24:34.400138 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:24:34.400101    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:25:07.803645 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:25:07.803611    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:25:17.500970 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:25:17.500939    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:25:27.103145 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:25:27.103114    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:25:35.000277 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:25:35.000177    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:25:45.167221 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:25:45.167184    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:25:54.407896 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:25:54.407868    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:26:06.902406 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:26:06.902372    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:26:16.697249 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:26:16.697213    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:26:38.494392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:26:38.494356    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:26:50.196701 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:26:50.196662    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:27:13.609547 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:13.609445    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:27:23.599252 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:23.599218    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:27:36.958000 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:36.957968    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:27:36.961252 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:36.961232    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:27:36.965575 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:36.965555    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:27:36.968079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:36.968064    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:27:38.209434 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:38.209400    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:27:47.698547 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:47.698497    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:27:56.804312 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:27:56.804276    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:28:05.899309 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:05.899277    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:28:14.900761 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:14.900728    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:28:41.908424 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:41.908312    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"]
Jul 08 23:28:41.909094 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:41.908562    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8" podUID="3a8f6e46-68aa-44c4-ab13-2a55afb15aaf" containerName="manager" containerID="cri-o://c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de" gracePeriod=10
Jul 08 23:28:44.567764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.567740    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:28:44.588697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.588570    2586 generic.go:356] "Generic (PLEG): container finished" podID="3a8f6e46-68aa-44c4-ab13-2a55afb15aaf" containerID="c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de" exitCode=0
Jul 08 23:28:44.588697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.588611    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8" event={"ID":"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf","Type":"ContainerDied","Data":"c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de"}
Jul 08 23:28:44.588697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.588701    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8" event={"ID":"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf","Type":"ContainerDied","Data":"2f731297869e4d5d8a6da78ff04fd68acf80cfae8ab10ae2c7f06437e110418e"}
Jul 08 23:28:44.588933 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.588744    2586 scope.go:117] "RemoveContainer" containerID="c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de"
Jul 08 23:28:44.593983 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.589323    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"
Jul 08 23:28:44.607758 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.607689    2586 scope.go:117] "RemoveContainer" containerID="c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de"
Jul 08 23:28:44.608002 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:28:44.607976    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de\": container with ID starting with c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de not found: ID does not exist" containerID="c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de"
Jul 08 23:28:44.608071 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.608016    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de"} err="failed to get container status \"c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de\": rpc error: code = NotFound desc = could not find container \"c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de\": container with ID starting with c1bf8abee07aab3b172f439a2252b03c078a6bb45066f9383c52fc44e562c4de not found: ID does not exist"
Jul 08 23:28:44.659685 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.659659    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-extensions-socket-volume\") pod \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\" (UID: \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\") "
Jul 08 23:28:44.659822 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.659715    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xj6c\" (UniqueName: \"kubernetes.io/projected/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-kube-api-access-8xj6c\") pod \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\" (UID: \"3a8f6e46-68aa-44c4-ab13-2a55afb15aaf\") "
Jul 08 23:28:44.660028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.660007    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3a8f6e46-68aa-44c4-ab13-2a55afb15aaf" (UID: "3a8f6e46-68aa-44c4-ab13-2a55afb15aaf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:28:44.661739 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.661716    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-kube-api-access-8xj6c" (OuterVolumeSpecName: "kube-api-access-8xj6c") pod "3a8f6e46-68aa-44c4-ab13-2a55afb15aaf" (UID: "3a8f6e46-68aa-44c4-ab13-2a55afb15aaf"). InnerVolumeSpecName "kube-api-access-8xj6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:28:44.760558 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.760504    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xj6c\" (UniqueName: \"kubernetes.io/projected/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-kube-api-access-8xj6c\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:28:44.760558 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.760556    2586 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf-extensions-socket-volume\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:28:44.914737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.914708    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"]
Jul 08 23:28:44.919095 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:44.919071    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4vf8"]
Jul 08 23:28:45.533610 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:28:45.533574    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a8f6e46-68aa-44c4-ab13-2a55afb15aaf" path="/var/lib/kubelet/pods/3a8f6e46-68aa-44c4-ab13-2a55afb15aaf/volumes"
Jul 08 23:29:43.077889 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.077853    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"]
Jul 08 23:29:43.079201 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.079175    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8f6e46-68aa-44c4-ab13-2a55afb15aaf" containerName="manager"
Jul 08 23:29:43.079353 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.079339    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8f6e46-68aa-44c4-ab13-2a55afb15aaf" containerName="manager"
Jul 08 23:29:43.079597 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.079581    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a8f6e46-68aa-44c4-ab13-2a55afb15aaf" containerName="manager"
Jul 08 23:29:43.090221 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.090192    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.093208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.092992    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p8ghq\""
Jul 08 23:29:43.095355 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.095330    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"]
Jul 08 23:29:43.156890 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.156858    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e33114d1-3cc4-422e-a2a9-4fa5bfd19e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vmgbt\" (UID: \"e33114d1-3cc4-422e-a2a9-4fa5bfd19e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.156890 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.156906    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stz2n\" (UniqueName: \"kubernetes.io/projected/e33114d1-3cc4-422e-a2a9-4fa5bfd19e64-kube-api-access-stz2n\") pod \"kuadrant-operator-controller-manager-86878c769f-vmgbt\" (UID: \"e33114d1-3cc4-422e-a2a9-4fa5bfd19e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.257711 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.257678    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e33114d1-3cc4-422e-a2a9-4fa5bfd19e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vmgbt\" (UID: \"e33114d1-3cc4-422e-a2a9-4fa5bfd19e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.257862 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.257727    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stz2n\" (UniqueName: \"kubernetes.io/projected/e33114d1-3cc4-422e-a2a9-4fa5bfd19e64-kube-api-access-stz2n\") pod \"kuadrant-operator-controller-manager-86878c769f-vmgbt\" (UID: \"e33114d1-3cc4-422e-a2a9-4fa5bfd19e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.258085 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.258065    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e33114d1-3cc4-422e-a2a9-4fa5bfd19e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vmgbt\" (UID: \"e33114d1-3cc4-422e-a2a9-4fa5bfd19e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.266365 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.266334    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stz2n\" (UniqueName: \"kubernetes.io/projected/e33114d1-3cc4-422e-a2a9-4fa5bfd19e64-kube-api-access-stz2n\") pod \"kuadrant-operator-controller-manager-86878c769f-vmgbt\" (UID: \"e33114d1-3cc4-422e-a2a9-4fa5bfd19e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.402859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.402829    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.585062 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.585037    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"]
Jul 08 23:29:43.587256 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:29:43.587227    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33114d1_3cc4_422e_a2a9_4fa5bfd19e64.slice/crio-9cf1a234797fa5e121fcdfdbe928bcb14819756b9f276cae57e2765d976b5691 WatchSource:0}: Error finding container 9cf1a234797fa5e121fcdfdbe928bcb14819756b9f276cae57e2765d976b5691: Status 404 returned error can't find the container with id 9cf1a234797fa5e121fcdfdbe928bcb14819756b9f276cae57e2765d976b5691
Jul 08 23:29:43.927641 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.927557    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt" event={"ID":"e33114d1-3cc4-422e-a2a9-4fa5bfd19e64","Type":"ContainerStarted","Data":"b7eb7c92c96d447a085beb03d234d067579df904e521e3353f39ed025415dee9"}
Jul 08 23:29:43.927641 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.927613    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt" event={"ID":"e33114d1-3cc4-422e-a2a9-4fa5bfd19e64","Type":"ContainerStarted","Data":"9cf1a234797fa5e121fcdfdbe928bcb14819756b9f276cae57e2765d976b5691"}
Jul 08 23:29:43.927866 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.927659    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:29:43.944587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:43.944508    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt" podStartSLOduration=0.944487718 podStartE2EDuration="944.487718ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:29:43.943941739 +0000 UTC m=+1327.493001332" watchObservedRunningTime="2026-07-08 23:29:43.944487718 +0000 UTC m=+1327.493547505"
Jul 08 23:29:54.935566 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:29:54.935515    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmgbt"
Jul 08 23:30:06.469502 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:30:06.469422    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:30:15.601568 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:30:15.601535    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:30:28.208111 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:30:28.208081    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:30:39.202438 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:30:39.202403    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:30:49.997997 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:30:49.997960    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:31:00.400658 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:31:00.400624    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:31:10.596903 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:31:10.596870    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:31:21.402459 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:31:21.402421    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:31:31.598883 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:31:31.598801    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:31:41.609600 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:31:41.609566    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:31:52.313389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:31:52.313353    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:32:15.398761 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:32:15.398721    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:32:24.313216 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:32:24.313183    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:32:34.703864 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:32:34.703829    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:32:36.995856 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:32:36.995833    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:32:36.998954 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:32:36.998936    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:32:37.002329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:32:37.002310    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:32:37.005610 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:32:37.005593    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:32:46.901170 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:32:46.901137    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:33:02.895105 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:33:02.895022    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:33:12.097929 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:33:12.097896    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:33:21.102575 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:33:21.102536    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:33:29.799916 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:33:29.799878    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:33:40.701139 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:33:40.701104    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:33:49.995996 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:33:49.995961    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:34:03.305207 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:34:03.305175    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:34:12.205345 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:34:12.205309    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:34:21.706017 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:34:21.705983    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:34:31.092793 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:34:31.092706    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:34:43.594685 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:34:43.594651    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:34:52.602613 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:34:52.602579    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:35:04.209049 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:04.209017    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:35:16.505773 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:16.505735    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:35:27.198962 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:27.198928    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:35:39.398316 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:39.398280    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:35:50.799642 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:50.799607    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:35:56.345296 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.345260    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"]
Jul 08 23:35:56.349642 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.349620    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.352418 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.352204    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e8178fd3-openshift-default-dockercfg-v77s7\""
Jul 08 23:35:56.369538 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.369497    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"]
Jul 08 23:35:56.475276 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475246    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-socket\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.475276 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475279    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-podinfo\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.475505 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475357    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-token\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.475505 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475396    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-envoy\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.475505 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475430    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-credential-socket\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.475505 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475460    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg7pj\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-kube-api-access-fg7pj\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.475505 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475492    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-data\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.475708 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475543    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-certs\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.475708 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.475569    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istiod-ca-cert\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576150 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576114    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-token\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576162    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-envoy\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576205    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-credential-socket\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576241    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg7pj\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-kube-api-access-fg7pj\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576499 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576377    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-data\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576499 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576438    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-certs\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576499 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576467    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istiod-ca-cert\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576703 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576580    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-socket\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576703 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576609    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-podinfo\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576703 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576693    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-credential-socket\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576838 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576756    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-data\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.576838 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576808    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-certs\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.577011 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.576988    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-socket\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.577112 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.577095    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istiod-ca-cert\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.578552 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.578532    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-envoy\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.578867 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.578851    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-podinfo\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.583974 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.583949    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg7pj\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-kube-api-access-fg7pj\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.584100 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.584079    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-token\") pod \"e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") " pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.660894 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.660812    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:56.801730 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.801705    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"]
Jul 08 23:35:56.803003 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:35:56.802975    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50855e8c_4c17_4c36_a2ba_573a71a8ba1c.slice/crio-4c4060d1fb700e8cdf8526ab555ab4fd7ebdff92fb21ace0265a34a5971f58aa WatchSource:0}: Error finding container 4c4060d1fb700e8cdf8526ab555ab4fd7ebdff92fb21ace0265a34a5971f58aa: Status 404 returned error can't find the container with id 4c4060d1fb700e8cdf8526ab555ab4fd7ebdff92fb21ace0265a34a5971f58aa
Jul 08 23:35:56.805112 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.805078    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:35:56.805219 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.805160    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:35:56.805219 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.805208    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:35:56.991199 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.991118    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw" event={"ID":"50855e8c-4c17-4c36-a2ba-573a71a8ba1c","Type":"ContainerStarted","Data":"2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b"}
Jul 08 23:35:56.991199 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:56.991181    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw" event={"ID":"50855e8c-4c17-4c36-a2ba-573a71a8ba1c","Type":"ContainerStarted","Data":"4c4060d1fb700e8cdf8526ab555ab4fd7ebdff92fb21ace0265a34a5971f58aa"}
Jul 08 23:35:57.010717 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:57.010672    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw" podStartSLOduration=1.010654211 podStartE2EDuration="1.010654211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:35:57.009294388 +0000 UTC m=+1700.558354004" watchObservedRunningTime="2026-07-08 23:35:57.010654211 +0000 UTC m=+1700.559713803"
Jul 08 23:35:57.661442 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:57.661411    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:57.667385 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:57.667306    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:57.996661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:57.996578    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:35:57.997597 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:35:57.997579    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:36:01.496456 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:01.496419    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:36:02.786940 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:02.786911    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"]
Jul 08 23:36:02.787347 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:02.787114    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw" podUID="50855e8c-4c17-4c36-a2ba-573a71a8ba1c" containerName="istio-proxy" containerID="cri-o://2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b" gracePeriod=30
Jul 08 23:36:08.916891 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:08.916860    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"]
Jul 08 23:36:08.920572 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:08.920550    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:08.923084 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:08.923064    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2443f2d9-openshift-default-dockercfg-fdrhn\""
Jul 08 23:36:08.932596 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:08.932567    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"]
Jul 08 23:36:09.095312 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095275    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-socket\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.095501 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095319    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-credential-socket\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.095501 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095347    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-podinfo\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.095501 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095365    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chzx5\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-kube-api-access-chzx5\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.095501 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095396    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-token\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.095685 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095503    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-envoy\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.095685 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095550    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215fe8d-48d4-418a-808d-6ed647f8bd95-istiod-ca-cert\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.095685 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095575    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-certs\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.095685 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.095593    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-data\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.196651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.196587    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-socket\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.196651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.196630    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-credential-socket\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.196651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.196651    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-podinfo\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.196778    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzx5\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-kube-api-access-chzx5\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.196845    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-token\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.196922    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-envoy\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.196946    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215fe8d-48d4-418a-808d-6ed647f8bd95-istiod-ca-cert\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.196987    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-certs\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.197017    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-data\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.197055    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-socket\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.197084    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-credential-socket\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.197404    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-certs\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.197436    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-data\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.198097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.197743    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215fe8d-48d4-418a-808d-6ed647f8bd95-istiod-ca-cert\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.199099 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.199079    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-envoy\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.199485 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.199464    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-podinfo\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.204586 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.204563    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chzx5\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-kube-api-access-chzx5\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.204764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.204743    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-token\") pod \"e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") " pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.233712 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.233687    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:09.385212 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.385181    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"]
Jul 08 23:36:09.385580 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:36:09.385550    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0215fe8d_48d4_418a_808d_6ed647f8bd95.slice/crio-06af342052f57299cc97bf0267b4e9591cecee008883fb80907cc5edb138d4ed WatchSource:0}: Error finding container 06af342052f57299cc97bf0267b4e9591cecee008883fb80907cc5edb138d4ed: Status 404 returned error can't find the container with id 06af342052f57299cc97bf0267b4e9591cecee008883fb80907cc5edb138d4ed
Jul 08 23:36:09.388484 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.388311    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:36:09.388484 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.388399    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:36:09.388484 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.388447    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:36:09.454979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.454951    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:36:09.498193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498165    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-token\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.498193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498206    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-data\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.498437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498233    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istiod-ca-cert\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.498437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498266    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-certs\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.498437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498319    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg7pj\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-kube-api-access-fg7pj\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.498437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498353    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-socket\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.498437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498381    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-podinfo\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.498437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498405    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-envoy\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.498775 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498453    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-credential-socket\") pod \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\" (UID: \"50855e8c-4c17-4c36-a2ba-573a71a8ba1c\") "
Jul 08 23:36:09.500291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.498994    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:09.500291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.499181    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:09.500291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.499213    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:36:09.500291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.499247    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:09.500291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.500212    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:09.501291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.501267    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:36:09.501510 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.501478    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-kube-api-access-fg7pj" (OuterVolumeSpecName: "kube-api-access-fg7pj") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "kube-api-access-fg7pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:36:09.501646 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.501590    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:09.501710 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.501660    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50855e8c-4c17-4c36-a2ba-573a71a8ba1c" (UID: "50855e8c-4c17-4c36-a2ba-573a71a8ba1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:36:09.599106 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599067    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:09.599106 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599103    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:09.599106 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599111    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:09.599106 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599120    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:09.599367 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599129    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg7pj\" (UniqueName: \"kubernetes.io/projected/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-kube-api-access-fg7pj\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:09.599367 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599138    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:09.599367 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599146    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:09.599367 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599154    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:09.599367 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:09.599161    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50855e8c-4c17-4c36-a2ba-573a71a8ba1c-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:10.066949 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.066911    2586 generic.go:356] "Generic (PLEG): container finished" podID="50855e8c-4c17-4c36-a2ba-573a71a8ba1c" containerID="2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b" exitCode=0
Jul 08 23:36:10.067410 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.066957    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"
Jul 08 23:36:10.067410 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.066997    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw" event={"ID":"50855e8c-4c17-4c36-a2ba-573a71a8ba1c","Type":"ContainerDied","Data":"2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b"}
Jul 08 23:36:10.067410 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.067062    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw" event={"ID":"50855e8c-4c17-4c36-a2ba-573a71a8ba1c","Type":"ContainerDied","Data":"4c4060d1fb700e8cdf8526ab555ab4fd7ebdff92fb21ace0265a34a5971f58aa"}
Jul 08 23:36:10.067410 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.067093    2586 scope.go:117] "RemoveContainer" containerID="2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b"
Jul 08 23:36:10.068863 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.068837    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx" event={"ID":"0215fe8d-48d4-418a-808d-6ed647f8bd95","Type":"ContainerStarted","Data":"9062e208b937c12d311f138fb5110b1e43337955d51e72f07553f0894da30746"}
Jul 08 23:36:10.068963 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.068894    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx" event={"ID":"0215fe8d-48d4-418a-808d-6ed647f8bd95","Type":"ContainerStarted","Data":"06af342052f57299cc97bf0267b4e9591cecee008883fb80907cc5edb138d4ed"}
Jul 08 23:36:10.076857 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.076840    2586 scope.go:117] "RemoveContainer" containerID="2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b"
Jul 08 23:36:10.077129 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:36:10.077108    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b\": container with ID starting with 2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b not found: ID does not exist" containerID="2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b"
Jul 08 23:36:10.077184 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.077138    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b"} err="failed to get container status \"2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b\": rpc error: code = NotFound desc = could not find container \"2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b\": container with ID starting with 2368bec5349027d7f311f2e6b9797a88ba9c6028560467d4cc1b15f28dac834b not found: ID does not exist"
Jul 08 23:36:10.092903 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.092859    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx" podStartSLOduration=2.092846383 podStartE2EDuration="2.092846383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:36:10.090580356 +0000 UTC m=+1713.639639954" watchObservedRunningTime="2026-07-08 23:36:10.092846383 +0000 UTC m=+1713.641905975"
Jul 08 23:36:10.116414 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.116353    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"]
Jul 08 23:36:10.120761 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.120737    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e8178fd3-openshift-default-69d996854c-6dmtw"]
Jul 08 23:36:10.234469 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.234431    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:10.242830 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:10.242766    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:11.077124 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:11.077094    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:11.077983 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:11.077965    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:11.533821 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:11.533787    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50855e8c-4c17-4c36-a2ba-573a71a8ba1c" path="/var/lib/kubelet/pods/50855e8c-4c17-4c36-a2ba-573a71a8ba1c/volumes"
Jul 08 23:36:14.501243 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:14.501204    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:36:21.215390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:21.215350    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"]
Jul 08 23:36:21.215951 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:21.215587    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx" podUID="0215fe8d-48d4-418a-808d-6ed647f8bd95" containerName="istio-proxy" containerID="cri-o://9062e208b937c12d311f138fb5110b1e43337955d51e72f07553f0894da30746" gracePeriod=30
Jul 08 23:36:22.141237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.141205    2586 generic.go:356] "Generic (PLEG): container finished" podID="0215fe8d-48d4-418a-808d-6ed647f8bd95" containerID="9062e208b937c12d311f138fb5110b1e43337955d51e72f07553f0894da30746" exitCode=0
Jul 08 23:36:22.141385 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.141276    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx" event={"ID":"0215fe8d-48d4-418a-808d-6ed647f8bd95","Type":"ContainerDied","Data":"9062e208b937c12d311f138fb5110b1e43337955d51e72f07553f0894da30746"}
Jul 08 23:36:22.264673 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.264650    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:22.319451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319395    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-certs\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.319451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319433    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-data\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.319653 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319462    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-envoy\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.319653 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319566    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-credential-socket\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.319653 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319600    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chzx5\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-kube-api-access-chzx5\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.319818 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319670    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-socket\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.319818 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319700    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-token\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.319818 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319698    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:22.319818 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319730    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-podinfo\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.319818 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.319753    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215fe8d-48d4-418a-808d-6ed647f8bd95-istiod-ca-cert\") pod \"0215fe8d-48d4-418a-808d-6ed647f8bd95\" (UID: \"0215fe8d-48d4-418a-808d-6ed647f8bd95\") "
Jul 08 23:36:22.320198 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.320057    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:22.320198 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.320157    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:22.320429 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.320398    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:22.320494 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.320405    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0215fe8d-48d4-418a-808d-6ed647f8bd95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:36:22.320604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.320550    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-data" (OuterVolumeSpecName: "istio-data") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:22.322589 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.322280    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-token" (OuterVolumeSpecName: "istio-token") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:36:22.322589 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.322294    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:36:22.322752 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.322609    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:22.322752 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.322645    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-kube-api-access-chzx5" (OuterVolumeSpecName: "kube-api-access-chzx5") pod "0215fe8d-48d4-418a-808d-6ed647f8bd95" (UID: "0215fe8d-48d4-418a-808d-6ed647f8bd95"). InnerVolumeSpecName "kube-api-access-chzx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:36:22.420828 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.420803    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:22.420828 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.420825    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:22.420828 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.420834    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:22.421044 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.420845    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chzx5\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-kube-api-access-chzx5\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:22.421044 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.420854    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215fe8d-48d4-418a-808d-6ed647f8bd95-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:22.421044 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.420863    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:22.421044 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.420871    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215fe8d-48d4-418a-808d-6ed647f8bd95-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:22.421044 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:22.420879    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215fe8d-48d4-418a-808d-6ed647f8bd95-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:23.149943 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:23.149917    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"
Jul 08 23:36:23.149943 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:23.149923    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx" event={"ID":"0215fe8d-48d4-418a-808d-6ed647f8bd95","Type":"ContainerDied","Data":"06af342052f57299cc97bf0267b4e9591cecee008883fb80907cc5edb138d4ed"}
Jul 08 23:36:23.150164 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:23.149976    2586 scope.go:117] "RemoveContainer" containerID="9062e208b937c12d311f138fb5110b1e43337955d51e72f07553f0894da30746"
Jul 08 23:36:23.174830 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:23.174801    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"]
Jul 08 23:36:23.179025 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:23.179006    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2443f2d9-openshift-default-96bbf79-69mjx"]
Jul 08 23:36:23.534583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:23.534499    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0215fe8d-48d4-418a-808d-6ed647f8bd95" path="/var/lib/kubelet/pods/0215fe8d-48d4-418a-808d-6ed647f8bd95/volumes"
Jul 08 23:36:27.236679 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.236643    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"]
Jul 08 23:36:27.237231 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.237213    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50855e8c-4c17-4c36-a2ba-573a71a8ba1c" containerName="istio-proxy"
Jul 08 23:36:27.237277 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.237235    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="50855e8c-4c17-4c36-a2ba-573a71a8ba1c" containerName="istio-proxy"
Jul 08 23:36:27.237277 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.237247    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0215fe8d-48d4-418a-808d-6ed647f8bd95" containerName="istio-proxy"
Jul 08 23:36:27.237277 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.237256    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0215fe8d-48d4-418a-808d-6ed647f8bd95" containerName="istio-proxy"
Jul 08 23:36:27.237395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.237384    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0215fe8d-48d4-418a-808d-6ed647f8bd95" containerName="istio-proxy"
Jul 08 23:36:27.237475 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.237401    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="50855e8c-4c17-4c36-a2ba-573a71a8ba1c" containerName="istio-proxy"
Jul 08 23:36:27.240855 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.240837    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.243448 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.243237    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-197d7ae2-openshift-default-dockercfg-dbsk9\""
Jul 08 23:36:27.256126 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.256100    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"]
Jul 08 23:36:27.361671 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361641    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-envoy\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.361817 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361691    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istiod-ca-cert\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.361817 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361769    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-podinfo\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.361817 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361814    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-data\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.361937 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361836    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-credential-socket\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.361937 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361863    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-token\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.361937 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361905    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6cw5\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-kube-api-access-m6cw5\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.362033 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361955    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-socket\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.362033 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.361973    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-certs\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.462764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.462728    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-podinfo\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.462947 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.462777    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-data\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.462947 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.462801    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-credential-socket\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.462947 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.462917    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-token\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463119 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.462949    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6cw5\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-kube-api-access-m6cw5\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463119 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.462997    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-socket\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463119 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.463027    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-certs\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463119 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.463101    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-envoy\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.463170    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istiod-ca-cert\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.463189    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-data\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.463373    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-socket\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463451 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.463424    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-certs\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463586 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.463484    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-credential-socket\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.463843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.463823    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istiod-ca-cert\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.465213 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.465192    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-envoy\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.465319 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.465273    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-podinfo\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.470181 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.470157    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-token\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.470409 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.470391    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6cw5\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-kube-api-access-m6cw5\") pod \"e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") " pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.558146 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.558066    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:27.605433 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.605401    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:36:27.699913 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.699891    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"]
Jul 08 23:36:27.701558 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:36:27.701515    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02e99ae_8843_4f2e_aeb3_32decd7ea3af.slice/crio-72186abea5492ac98761645ddbb4043f55e018a993d5e468f3dde87540cbefe9 WatchSource:0}: Error finding container 72186abea5492ac98761645ddbb4043f55e018a993d5e468f3dde87540cbefe9: Status 404 returned error can't find the container with id 72186abea5492ac98761645ddbb4043f55e018a993d5e468f3dde87540cbefe9
Jul 08 23:36:27.703493 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.703463    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:36:27.703571 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.703551    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:36:27.703630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:27.703582    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:36:28.180074 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:28.180041    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh" event={"ID":"d02e99ae-8843-4f2e-aeb3-32decd7ea3af","Type":"ContainerStarted","Data":"2e967213de4db53873d127baa325e97f1a72f8000a06fa77073fcc6587c4a8ba"}
Jul 08 23:36:28.180247 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:28.180094    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh" event={"ID":"d02e99ae-8843-4f2e-aeb3-32decd7ea3af","Type":"ContainerStarted","Data":"72186abea5492ac98761645ddbb4043f55e018a993d5e468f3dde87540cbefe9"}
Jul 08 23:36:28.200832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:28.200784    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh" podStartSLOduration=1.200769874 podStartE2EDuration="1.200769874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:36:28.198488095 +0000 UTC m=+1731.747547687" watchObservedRunningTime="2026-07-08 23:36:28.200769874 +0000 UTC m=+1731.749829528"
Jul 08 23:36:28.558665 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:28.558573    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:28.564112 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:28.564087    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:29.186124 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:29.186080    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:29.187165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:29.187148    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:32.983406 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:32.983365    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"]
Jul 08 23:36:32.983888 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:32.983600    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh" podUID="d02e99ae-8843-4f2e-aeb3-32decd7ea3af" containerName="istio-proxy" containerID="cri-o://2e967213de4db53873d127baa325e97f1a72f8000a06fa77073fcc6587c4a8ba" gracePeriod=30
Jul 08 23:36:38.235395 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.235366    2586 generic.go:356] "Generic (PLEG): container finished" podID="d02e99ae-8843-4f2e-aeb3-32decd7ea3af" containerID="2e967213de4db53873d127baa325e97f1a72f8000a06fa77073fcc6587c4a8ba" exitCode=0
Jul 08 23:36:38.235721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.235409    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh" event={"ID":"d02e99ae-8843-4f2e-aeb3-32decd7ea3af","Type":"ContainerDied","Data":"2e967213de4db53873d127baa325e97f1a72f8000a06fa77073fcc6587c4a8ba"}
Jul 08 23:36:38.235721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.235469    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh" event={"ID":"d02e99ae-8843-4f2e-aeb3-32decd7ea3af","Type":"ContainerDied","Data":"72186abea5492ac98761645ddbb4043f55e018a993d5e468f3dde87540cbefe9"}
Jul 08 23:36:38.235721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.235497    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72186abea5492ac98761645ddbb4043f55e018a993d5e468f3dde87540cbefe9"
Jul 08 23:36:38.241377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.241356    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:38.357419 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357393    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-data\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.357603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357445    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istiod-ca-cert\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.357603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357471    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-credential-socket\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.357603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357499    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-token\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.357603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357538    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6cw5\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-kube-api-access-m6cw5\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.357603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357572    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-certs\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.357874 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357614    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-envoy\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.357874 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357677    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-socket\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.357874 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357716    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-podinfo\") pod \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\" (UID: \"d02e99ae-8843-4f2e-aeb3-32decd7ea3af\") "
Jul 08 23:36:38.358050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357710    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-data" (OuterVolumeSpecName: "istio-data") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:38.358050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357772    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:38.358050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357945    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:38.358050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.358050    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:38.358358 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.357953    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:36:38.359852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.359825    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:36:38.359954 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.359865    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-token" (OuterVolumeSpecName: "istio-token") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:36:38.359954 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.359890    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-kube-api-access-m6cw5" (OuterVolumeSpecName: "kube-api-access-m6cw5") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "kube-api-access-m6cw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:36:38.360174 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.360156    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d02e99ae-8843-4f2e-aeb3-32decd7ea3af" (UID: "d02e99ae-8843-4f2e-aeb3-32decd7ea3af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:36:38.459149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459128    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:38.459149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459149    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:38.459294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459159    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:38.459294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459168    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:38.459294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459176    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:38.459294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459184    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:38.459294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459192    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:38.459294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459199    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6cw5\" (UniqueName: \"kubernetes.io/projected/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-kube-api-access-m6cw5\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:38.459294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:38.459207    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d02e99ae-8843-4f2e-aeb3-32decd7ea3af-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:36:39.241360 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:39.241333    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"
Jul 08 23:36:39.266589 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:39.266564    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"]
Jul 08 23:36:39.281234 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:39.281212    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-197d7ae2-openshift-default-79ccb79695-hx8bh"]
Jul 08 23:36:39.533258 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:36:39.533179    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d02e99ae-8843-4f2e-aeb3-32decd7ea3af" path="/var/lib/kubelet/pods/d02e99ae-8843-4f2e-aeb3-32decd7ea3af/volumes"
Jul 08 23:37:37.037897 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:37:37.037870    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:37:37.042374 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:37:37.042354    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:37:37.045102 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:37:37.045084    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:37:37.049458 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:37:37.049442    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:38:01.004171 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:01.004131    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:38:10.198183 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:10.198147    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:38:13.480046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.480004    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"]
Jul 08 23:38:13.480634 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.480617    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d02e99ae-8843-4f2e-aeb3-32decd7ea3af" containerName="istio-proxy"
Jul 08 23:38:13.480713 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.480636    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="d02e99ae-8843-4f2e-aeb3-32decd7ea3af" containerName="istio-proxy"
Jul 08 23:38:13.480769 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.480746    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="d02e99ae-8843-4f2e-aeb3-32decd7ea3af" containerName="istio-proxy"
Jul 08 23:38:13.484258 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.484239    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.486666 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.486647    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f40dc7f6-openshift-default-dockercfg-r66f2\""
Jul 08 23:38:13.501892 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.501868    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"]
Jul 08 23:38:13.571507 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571476    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-podinfo\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.571694 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571513    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-socket\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.571694 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571568    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-certs\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.571694 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571592    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istiod-ca-cert\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.571694 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571658    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-envoy\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.571909 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571698    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-token\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.571909 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571720    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-credential-socket\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.571909 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571753    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-data\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.571909 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.571781    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrvx\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-kube-api-access-jxrvx\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672487 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672451    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-certs\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672487 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672492    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istiod-ca-cert\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672544    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-envoy\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672569    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-token\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672585    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-credential-socket\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672620    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-data\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672643    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrvx\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-kube-api-access-jxrvx\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672689    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-podinfo\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.672737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672723    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-socket\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.673103 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672881    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-certs\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.673103 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.672961    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-credential-socket\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.673205 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.673169    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-socket\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.673262 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.673201    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-data\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.673542 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.673503    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istiod-ca-cert\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.674858 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.674827    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-envoy\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.675179 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.675162    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-podinfo\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.680918 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.680890    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrvx\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-kube-api-access-jxrvx\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.681084 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.681062    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-token\") pod \"e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") " pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.794287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.794213    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:13.935322 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.935298    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"]
Jul 08 23:38:13.937257 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:38:13.937230    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51b45c1_9a46_4867_8e91_f62dc2ac8f55.slice/crio-10031889125b14d0a8d4509177f3b86e95b69c1569465f314a43dd6010917f00 WatchSource:0}: Error finding container 10031889125b14d0a8d4509177f3b86e95b69c1569465f314a43dd6010917f00: Status 404 returned error can't find the container with id 10031889125b14d0a8d4509177f3b86e95b69c1569465f314a43dd6010917f00
Jul 08 23:38:13.939766 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.939734    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:13.939871 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.939812    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:13.939871 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:13.939856    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:14.764556 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:14.764500    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" event={"ID":"c51b45c1-9a46-4867-8e91-f62dc2ac8f55","Type":"ContainerStarted","Data":"d663a2ac9895d6a59130e71a94af76bd2540b7a48a919db74122064f92043eb1"}
Jul 08 23:38:14.764927 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:14.764581    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" event={"ID":"c51b45c1-9a46-4867-8e91-f62dc2ac8f55","Type":"ContainerStarted","Data":"10031889125b14d0a8d4509177f3b86e95b69c1569465f314a43dd6010917f00"}
Jul 08 23:38:14.784467 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:14.784408    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" podStartSLOduration=1.78438963 podStartE2EDuration="1.78438963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:38:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:38:14.783661985 +0000 UTC m=+1838.332721577" watchObservedRunningTime="2026-07-08 23:38:14.78438963 +0000 UTC m=+1838.333449223"
Jul 08 23:38:14.795097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:14.795075    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:14.800065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:14.800046    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:15.770109 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:15.770079    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:15.770909 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:15.770891    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:22.116595 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:22.116559    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:38:29.853604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:29.853503    2586 generic.go:356] "Generic (PLEG): container finished" podID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerID="d663a2ac9895d6a59130e71a94af76bd2540b7a48a919db74122064f92043eb1" exitCode=0
Jul 08 23:38:29.853604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:29.853579    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" event={"ID":"c51b45c1-9a46-4867-8e91-f62dc2ac8f55","Type":"ContainerDied","Data":"d663a2ac9895d6a59130e71a94af76bd2540b7a48a919db74122064f92043eb1"}
Jul 08 23:38:29.854369 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:29.854079    2586 scope.go:117] "RemoveContainer" containerID="d663a2ac9895d6a59130e71a94af76bd2540b7a48a919db74122064f92043eb1"
Jul 08 23:38:29.855174 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:29.855146    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:29.855278 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:29.855214    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:29.855278 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:29.855248    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:30.770005 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:30.769967    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:30.865567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:30.865511    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" event={"ID":"c51b45c1-9a46-4867-8e91-f62dc2ac8f55","Type":"ContainerStarted","Data":"7a583cc41f146f3ddb0e86b0c3cd746cd9cfeba44e8b5eb782143d6f0aac55d3"}
Jul 08 23:38:31.794787 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:31.794750    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:31.795932 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:31.795910    2586 patch_prober.go:28] interesting pod/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 08 23:38:31.796001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:31.795957    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 08 23:38:32.710268 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:32.710232    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:38:32.795576 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:32.795514    2586 patch_prober.go:28] interesting pod/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 08 23:38:32.795767 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:32.795595    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 08 23:38:33.795090 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:33.795060    2586 patch_prober.go:28] interesting pod/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 08 23:38:33.795494 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:33.795112    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 08 23:38:34.774494 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:34.774462    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"]
Jul 08 23:38:34.774708 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:34.774662    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy" containerID="cri-o://7a583cc41f146f3ddb0e86b0c3cd746cd9cfeba44e8b5eb782143d6f0aac55d3" gracePeriod=30
Jul 08 23:38:39.921471 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:39.921427    2586 generic.go:356] "Generic (PLEG): container finished" podID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerID="7a583cc41f146f3ddb0e86b0c3cd746cd9cfeba44e8b5eb782143d6f0aac55d3" exitCode=0
Jul 08 23:38:39.922005 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:39.921495    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" event={"ID":"c51b45c1-9a46-4867-8e91-f62dc2ac8f55","Type":"ContainerDied","Data":"7a583cc41f146f3ddb0e86b0c3cd746cd9cfeba44e8b5eb782143d6f0aac55d3"}
Jul 08 23:38:39.922005 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:39.921578    2586 scope.go:117] "RemoveContainer" containerID="d663a2ac9895d6a59130e71a94af76bd2540b7a48a919db74122064f92043eb1"
Jul 08 23:38:40.035877 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.035822    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:40.222583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222546    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-envoy\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.222814 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222593    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-credential-socket\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.222814 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222650    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-data\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.222814 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222693    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-certs\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.222814 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222726    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istiod-ca-cert\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.222814 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222754    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-token\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.222814 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222778    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-socket\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.223136 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222820    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxrvx\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-kube-api-access-jxrvx\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.223136 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222855    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-podinfo\") pod \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\" (UID: \"c51b45c1-9a46-4867-8e91-f62dc2ac8f55\") "
Jul 08 23:38:40.223136 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222909    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:38:40.223136 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.222991    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:38:40.223136 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.223091    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:38:40.223136 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.223108    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:38:40.223462 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.223223    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.223462 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.223241    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.223462 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.223255    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.223462 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.223269    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.223771 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.223685    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-data" (OuterVolumeSpecName: "istio-data") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:38:40.224997 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.224968    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:38:40.225132 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.225040    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:38:40.225132 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.225058    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-token" (OuterVolumeSpecName: "istio-token") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:38:40.225132 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.225111    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-kube-api-access-jxrvx" (OuterVolumeSpecName: "kube-api-access-jxrvx") pod "c51b45c1-9a46-4867-8e91-f62dc2ac8f55" (UID: "c51b45c1-9a46-4867-8e91-f62dc2ac8f55"). InnerVolumeSpecName "kube-api-access-jxrvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:38:40.324662 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.324583    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.324662 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.324610    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.324662 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.324618    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.324662 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.324626    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.324662 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.324634    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxrvx\" (UniqueName: \"kubernetes.io/projected/c51b45c1-9a46-4867-8e91-f62dc2ac8f55-kube-api-access-jxrvx\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:38:40.933752 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.933721    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"
Jul 08 23:38:40.933752 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.933730    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4" event={"ID":"c51b45c1-9a46-4867-8e91-f62dc2ac8f55","Type":"ContainerDied","Data":"10031889125b14d0a8d4509177f3b86e95b69c1569465f314a43dd6010917f00"}
Jul 08 23:38:40.934295 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.933807    2586 scope.go:117] "RemoveContainer" containerID="7a583cc41f146f3ddb0e86b0c3cd746cd9cfeba44e8b5eb782143d6f0aac55d3"
Jul 08 23:38:40.969140 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.969115    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"]
Jul 08 23:38:40.973142 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:40.973114    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f40dc7f6-openshift-default-6479788bf9-clkb4"]
Jul 08 23:38:41.533757 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:41.533729    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" path="/var/lib/kubelet/pods/c51b45c1-9a46-4867-8e91-f62dc2ac8f55/volumes"
Jul 08 23:38:54.474724 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.474691    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"]
Jul 08 23:38:54.475292 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.475274    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy"
Jul 08 23:38:54.475292 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.475293    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy"
Jul 08 23:38:54.475430 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.475309    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy"
Jul 08 23:38:54.475430 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.475319    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy"
Jul 08 23:38:54.475498 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.475463    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy"
Jul 08 23:38:54.480362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.480343    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.482941 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.482921    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-58c9c277-openshift-default-dockercfg-qf9vz\""
Jul 08 23:38:54.490830 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.490806    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"]
Jul 08 23:38:54.546425 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546399    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-token\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.546593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546443    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-socket\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.546593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546503    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-certs\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.546593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546557    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-podinfo\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.546593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546581    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istiod-ca-cert\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.546823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546633    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-envoy\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.546823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546672    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smjgx\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-kube-api-access-smjgx\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.546823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546738    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-credential-socket\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.546823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.546763    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-data\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.647626 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.647597    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smjgx\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-kube-api-access-smjgx\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.647793 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.647663    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-credential-socket\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.647872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.647791    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-data\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.647872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.647850    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-token\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.647978 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.647896    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-socket\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648054 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648027    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-credential-socket\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648054 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648042    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-certs\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648172 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648091    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-podinfo\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648172 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648111    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-data\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648172 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648117    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istiod-ca-cert\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648309 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648205    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-socket\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648350 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648335    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-envoy\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648397 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648354    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-certs\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.648901 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.648875    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istiod-ca-cert\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.650352 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.650322    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-envoy\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.650722 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.650703    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-podinfo\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.655637 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.655610    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-token\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.655737 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.655652    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smjgx\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-kube-api-access-smjgx\") pod \"e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") " pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.791877 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.791779    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:54.939843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.939807    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"]
Jul 08 23:38:54.943023 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:38:54.942991    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de638a2_ec32_49cd_ae2b_770f0055ca9a.slice/crio-a8eaa803d4765aabc3c5496f423ad9aba360e08ef813f9a97a99fb9c74730cf3 WatchSource:0}: Error finding container a8eaa803d4765aabc3c5496f423ad9aba360e08ef813f9a97a99fb9c74730cf3: Status 404 returned error can't find the container with id a8eaa803d4765aabc3c5496f423ad9aba360e08ef813f9a97a99fb9c74730cf3
Jul 08 23:38:54.945648 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.945612    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:54.945777 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.945678    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:54.945777 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:54.945705    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:38:55.013830 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:55.013805    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" event={"ID":"6de638a2-ec32-49cd-ae2b-770f0055ca9a","Type":"ContainerStarted","Data":"d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401"}
Jul 08 23:38:55.013978 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:55.013854    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" event={"ID":"6de638a2-ec32-49cd-ae2b-770f0055ca9a","Type":"ContainerStarted","Data":"a8eaa803d4765aabc3c5496f423ad9aba360e08ef813f9a97a99fb9c74730cf3"}
Jul 08 23:38:55.032337 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:55.032294    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" podStartSLOduration=1.032279139 podStartE2EDuration="1.032279139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:38:55.030575198 +0000 UTC m=+1878.579634791" watchObservedRunningTime="2026-07-08 23:38:55.032279139 +0000 UTC m=+1878.581338730"
Jul 08 23:38:55.792433 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:55.792390    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:56.797004 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:56.796969    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:57.027091 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:57.027061    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:57.027891 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:57.027870    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:38:59.890474 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:38:59.890394    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:39:06.703727 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.703675    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"]
Jul 08 23:39:06.704293 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.704250    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51b45c1-9a46-4867-8e91-f62dc2ac8f55" containerName="istio-proxy"
Jul 08 23:39:06.707278 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.707262    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.709921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.709904    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-58c9c277\"/\"kube-root-ca.crt\""
Jul 08 23:39:06.711246 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.711226    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-58c9c277\"/\"default-dockercfg-kgq8r\""
Jul 08 23:39:06.711359 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.711274    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-58c9c277\"/\"openshift-service-ca.crt\""
Jul 08 23:39:06.711359 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.711276    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-58c9c277\"/\"e2e-lifecycle-model-58c9c277-kserve-self-signed-certs\""
Jul 08 23:39:06.720839 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.720814    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"]
Jul 08 23:39:06.765469 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.765345    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-tmp-dir\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.765469 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.765438    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-model-cache\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.765469 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.765467    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47sxx\" (UniqueName: \"kubernetes.io/projected/4eb2f128-b963-4348-bacb-12c6847b1e8a-kube-api-access-47sxx\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.765760 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.765509    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-home\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.765760 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.765564    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-dshm\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.765760 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.765617    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb2f128-b963-4348-bacb-12c6847b1e8a-tls-certs\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.866859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.866829    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb2f128-b963-4348-bacb-12c6847b1e8a-tls-certs\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.867019 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.866874    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-tmp-dir\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.867019 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.866921    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-model-cache\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.867019 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.866940    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47sxx\" (UniqueName: \"kubernetes.io/projected/4eb2f128-b963-4348-bacb-12c6847b1e8a-kube-api-access-47sxx\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.867019 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.866975    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-home\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.867019 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.867011    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-dshm\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.867466 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.867440    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-home\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.867569 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.867467    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-model-cache\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.867569 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.867545    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-tmp-dir\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.869238 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.869219    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-dshm\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.869335 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.869319    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb2f128-b963-4348-bacb-12c6847b1e8a-tls-certs\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:06.874123 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:06.874102    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47sxx\" (UniqueName: \"kubernetes.io/projected/4eb2f128-b963-4348-bacb-12c6847b1e8a-kube-api-access-47sxx\") pod \"e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") " pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:07.018575 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:07.018473    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:07.163755 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:07.163721    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"]
Jul 08 23:39:07.165584 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:39:07.165558    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eb2f128_b963_4348_bacb_12c6847b1e8a.slice/crio-5f2ce93f8d27c97f5661d2660161b05d0530453fed58dee4fea3fecf1b089b94 WatchSource:0}: Error finding container 5f2ce93f8d27c97f5661d2660161b05d0530453fed58dee4fea3fecf1b089b94: Status 404 returned error can't find the container with id 5f2ce93f8d27c97f5661d2660161b05d0530453fed58dee4fea3fecf1b089b94
Jul 08 23:39:08.106390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.106353    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr" event={"ID":"4eb2f128-b963-4348-bacb-12c6847b1e8a","Type":"ContainerStarted","Data":"0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9"}
Jul 08 23:39:08.106883 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.106409    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr" event={"ID":"4eb2f128-b963-4348-bacb-12c6847b1e8a","Type":"ContainerStarted","Data":"5f2ce93f8d27c97f5661d2660161b05d0530453fed58dee4fea3fecf1b089b94"}
Jul 08 23:39:08.107956 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.107934    2586 generic.go:356] "Generic (PLEG): container finished" podID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerID="d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401" exitCode=0
Jul 08 23:39:08.108047 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.108001    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" event={"ID":"6de638a2-ec32-49cd-ae2b-770f0055ca9a","Type":"ContainerDied","Data":"d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401"}
Jul 08 23:39:08.108336 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.108323    2586 scope.go:117] "RemoveContainer" containerID="d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401"
Jul 08 23:39:08.109358 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.109330    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:39:08.109457 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.109425    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:39:08.109541 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.109472    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:39:08.122295 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:08.122256    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr" podStartSLOduration=2.122242608 podStartE2EDuration="2.122242608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:39:08.121110893 +0000 UTC m=+1891.670170480" watchObservedRunningTime="2026-07-08 23:39:08.122242608 +0000 UTC m=+1891.671302197"
Jul 08 23:39:09.122752 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:09.122715    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" event={"ID":"6de638a2-ec32-49cd-ae2b-770f0055ca9a","Type":"ContainerStarted","Data":"d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d"}
Jul 08 23:39:09.792154 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:09.792118    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:39:09.793319 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:09.793286    2586 patch_prober.go:28] interesting pod/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 08 23:39:09.793456 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:09.793342    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 08 23:39:10.793173 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:10.793136    2586 patch_prober.go:28] interesting pod/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 08 23:39:10.793620 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:10.793197    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 08 23:39:11.793147 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:11.793110    2586 patch_prober.go:28] interesting pod/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 08 23:39:11.793336 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:11.793165    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 08 23:39:12.027290 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:12.027260    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:39:12.792453 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:12.792412    2586 patch_prober.go:28] interesting pod/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 08 23:39:12.792669 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:12.792474    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 08 23:39:13.796003 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:13.795970    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:39:13.796885 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:13.796867    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:39:13.904538 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:13.899967    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:39:17.019306 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:17.019271    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:17.019306 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:17.019316    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:17.032031 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:17.032006    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:17.180997 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:17.180972    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:26.100331 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:26.100295    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:39:39.721723 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:39.721689    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"]
Jul 08 23:39:40.792727 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:40.792692    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:39:54.741786 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:54.741741    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr" podUID="4eb2f128-b963-4348-bacb-12c6847b1e8a" containerName="main" containerID="cri-o://0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9" gracePeriod=45
Jul 08 23:39:54.996817 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:54.996754    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:55.090924 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.090896    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb2f128-b963-4348-bacb-12c6847b1e8a-tls-certs\") pod \"4eb2f128-b963-4348-bacb-12c6847b1e8a\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") "
Jul 08 23:39:55.091093 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.090934    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47sxx\" (UniqueName: \"kubernetes.io/projected/4eb2f128-b963-4348-bacb-12c6847b1e8a-kube-api-access-47sxx\") pod \"4eb2f128-b963-4348-bacb-12c6847b1e8a\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") "
Jul 08 23:39:55.091093 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.090957    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-dshm\") pod \"4eb2f128-b963-4348-bacb-12c6847b1e8a\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") "
Jul 08 23:39:55.091093 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091026    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-tmp-dir\") pod \"4eb2f128-b963-4348-bacb-12c6847b1e8a\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") "
Jul 08 23:39:55.091093 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091058    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-home\") pod \"4eb2f128-b963-4348-bacb-12c6847b1e8a\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") "
Jul 08 23:39:55.091324 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091122    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-model-cache\") pod \"4eb2f128-b963-4348-bacb-12c6847b1e8a\" (UID: \"4eb2f128-b963-4348-bacb-12c6847b1e8a\") "
Jul 08 23:39:55.091324 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091286    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4eb2f128-b963-4348-bacb-12c6847b1e8a" (UID: "4eb2f128-b963-4348-bacb-12c6847b1e8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:39:55.091446 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091347    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-home" (OuterVolumeSpecName: "home") pod "4eb2f128-b963-4348-bacb-12c6847b1e8a" (UID: "4eb2f128-b963-4348-bacb-12c6847b1e8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:39:55.091446 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091382    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-model-cache" (OuterVolumeSpecName: "model-cache") pod "4eb2f128-b963-4348-bacb-12c6847b1e8a" (UID: "4eb2f128-b963-4348-bacb-12c6847b1e8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:39:55.091594 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091482    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-tmp-dir\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:39:55.091594 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091502    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-home\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:39:55.091594 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.091542    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-model-cache\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:39:55.093114 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.093088    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb2f128-b963-4348-bacb-12c6847b1e8a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4eb2f128-b963-4348-bacb-12c6847b1e8a" (UID: "4eb2f128-b963-4348-bacb-12c6847b1e8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:39:55.093241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.093167    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-dshm" (OuterVolumeSpecName: "dshm") pod "4eb2f128-b963-4348-bacb-12c6847b1e8a" (UID: "4eb2f128-b963-4348-bacb-12c6847b1e8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:39:55.093241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.093197    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb2f128-b963-4348-bacb-12c6847b1e8a-kube-api-access-47sxx" (OuterVolumeSpecName: "kube-api-access-47sxx") pod "4eb2f128-b963-4348-bacb-12c6847b1e8a" (UID: "4eb2f128-b963-4348-bacb-12c6847b1e8a"). InnerVolumeSpecName "kube-api-access-47sxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:39:55.192529 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.192502    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eb2f128-b963-4348-bacb-12c6847b1e8a-tls-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:39:55.192650 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.192543    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47sxx\" (UniqueName: \"kubernetes.io/projected/4eb2f128-b963-4348-bacb-12c6847b1e8a-kube-api-access-47sxx\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:39:55.192650 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.192554    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eb2f128-b963-4348-bacb-12c6847b1e8a-dshm\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:39:55.385261 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.385228    2586 generic.go:356] "Generic (PLEG): container finished" podID="4eb2f128-b963-4348-bacb-12c6847b1e8a" containerID="0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9" exitCode=0
Jul 08 23:39:55.385389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.385271    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"
Jul 08 23:39:55.385389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.385316    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr" event={"ID":"4eb2f128-b963-4348-bacb-12c6847b1e8a","Type":"ContainerDied","Data":"0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9"}
Jul 08 23:39:55.385389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.385355    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr" event={"ID":"4eb2f128-b963-4348-bacb-12c6847b1e8a","Type":"ContainerDied","Data":"5f2ce93f8d27c97f5661d2660161b05d0530453fed58dee4fea3fecf1b089b94"}
Jul 08 23:39:55.385389 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.385378    2586 scope.go:117] "RemoveContainer" containerID="0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9"
Jul 08 23:39:55.395087 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.395072    2586 scope.go:117] "RemoveContainer" containerID="0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9"
Jul 08 23:39:55.395362 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:39:55.395342    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9\": container with ID starting with 0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9 not found: ID does not exist" containerID="0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9"
Jul 08 23:39:55.395362 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.395366    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9"} err="failed to get container status \"0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9\": rpc error: code = NotFound desc = could not find container \"0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9\": container with ID starting with 0efad9e65fade9892e0107d79a0bbaecd8720a5e8f04204e465ef0c0aa2b03c9 not found: ID does not exist"
Jul 08 23:39:55.407425 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.407405    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"]
Jul 08 23:39:55.409674 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.409657    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-58c9c277/e2e-lifecycle-model-58c9c277-kserve-6dcd89dd75-j4vrr"]
Jul 08 23:39:55.533875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:39:55.533847    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb2f128-b963-4348-bacb-12c6847b1e8a" path="/var/lib/kubelet/pods/4eb2f128-b963-4348-bacb-12c6847b1e8a/volumes"
Jul 08 23:40:19.597957 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:19.597923    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:40:22.585607 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:22.585576    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"]
Jul 08 23:40:22.586007 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:22.585805    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy" containerID="cri-o://d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d" gracePeriod=30
Jul 08 23:40:27.844875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.844851    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:40:27.896148 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896075    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-certs\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896148 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896116    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istiod-ca-cert\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896148 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896133    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-credential-socket\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896428 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896272    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-envoy\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896428 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896346    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-token\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896428 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896390    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-podinfo\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896428 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896423    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smjgx\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-kube-api-access-smjgx\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896403    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:40:27.896661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896463    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:40:27.896661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896471    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-data\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896534    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-socket\") pod \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\" (UID: \"6de638a2-ec32-49cd-ae2b-770f0055ca9a\") "
Jul 08 23:40:27.896661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896595    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:40:27.896921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896805    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:40:27.896921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896874    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:27.896921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896892    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:27.896921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896905    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:27.896921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.896917    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:27.897292 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.897273    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:40:27.898599 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.898575    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-kube-api-access-smjgx" (OuterVolumeSpecName: "kube-api-access-smjgx") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "kube-api-access-smjgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:40:27.898706 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.898654    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:40:27.898870 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.898849    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:40:27.898960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.898891    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6de638a2-ec32-49cd-ae2b-770f0055ca9a" (UID: "6de638a2-ec32-49cd-ae2b-770f0055ca9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:40:27.997713 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.997686    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:27.997713 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.997711    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:27.997713 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.997720    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smjgx\" (UniqueName: \"kubernetes.io/projected/6de638a2-ec32-49cd-ae2b-770f0055ca9a-kube-api-access-smjgx\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:27.997937 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.997729    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:27.997937 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:27.997738    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de638a2-ec32-49cd-ae2b-770f0055ca9a-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:40:28.578246 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.578212    2586 generic.go:356] "Generic (PLEG): container finished" podID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerID="d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d" exitCode=0
Jul 08 23:40:28.578442 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.578260    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"
Jul 08 23:40:28.578442 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.578305    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" event={"ID":"6de638a2-ec32-49cd-ae2b-770f0055ca9a","Type":"ContainerDied","Data":"d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d"}
Jul 08 23:40:28.578442 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.578356    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp" event={"ID":"6de638a2-ec32-49cd-ae2b-770f0055ca9a","Type":"ContainerDied","Data":"a8eaa803d4765aabc3c5496f423ad9aba360e08ef813f9a97a99fb9c74730cf3"}
Jul 08 23:40:28.578442 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.578381    2586 scope.go:117] "RemoveContainer" containerID="d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d"
Jul 08 23:40:28.588051 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.588035    2586 scope.go:117] "RemoveContainer" containerID="d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401"
Jul 08 23:40:28.596299 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.596281    2586 scope.go:117] "RemoveContainer" containerID="d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d"
Jul 08 23:40:28.596571 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:40:28.596553    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d\": container with ID starting with d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d not found: ID does not exist" containerID="d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d"
Jul 08 23:40:28.596644 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.596578    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d"} err="failed to get container status \"d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d\": rpc error: code = NotFound desc = could not find container \"d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d\": container with ID starting with d927289ba31838f9ecae129430e28813b396f8f835966cdad54c58b87b449a4d not found: ID does not exist"
Jul 08 23:40:28.596644 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.596593    2586 scope.go:117] "RemoveContainer" containerID="d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401"
Jul 08 23:40:28.596833 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:40:28.596816    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401\": container with ID starting with d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401 not found: ID does not exist" containerID="d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401"
Jul 08 23:40:28.596872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.596842    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401"} err="failed to get container status \"d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401\": rpc error: code = NotFound desc = could not find container \"d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401\": container with ID starting with d4c0e5e5d6a0230bffe26fb0c0890ab78c44b3d46bc814a865a8ba9e9f1aa401 not found: ID does not exist"
Jul 08 23:40:28.600601 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.600583    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"]
Jul 08 23:40:28.604443 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:28.604422    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-58c9c277-openshift-default-79d65fb59f-p76lp"]
Jul 08 23:40:29.307466 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:29.307436    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:40:29.534198 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:29.534165    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" path="/var/lib/kubelet/pods/6de638a2-ec32-49cd-ae2b-770f0055ca9a/volumes"
Jul 08 23:40:41.002213 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:40:41.002180    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:41:17.120576 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.120546    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"]
Jul 08 23:41:17.121042 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.120937    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy"
Jul 08 23:41:17.121042 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.120949    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy"
Jul 08 23:41:17.121042 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.120974    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy"
Jul 08 23:41:17.121042 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.120980    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy"
Jul 08 23:41:17.121042 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.120996    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb2f128-b963-4348-bacb-12c6847b1e8a" containerName="main"
Jul 08 23:41:17.121042 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.121002    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb2f128-b963-4348-bacb-12c6847b1e8a" containerName="main"
Jul 08 23:41:17.121237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.121063    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy"
Jul 08 23:41:17.121237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.121072    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de638a2-ec32-49cd-ae2b-770f0055ca9a" containerName="istio-proxy"
Jul 08 23:41:17.121237 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.121079    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb2f128-b963-4348-bacb-12c6847b1e8a" containerName="main"
Jul 08 23:41:17.124193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.124179    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.126769 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.126750    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-08d361-openshift-default-dockercfg-h7p9j\""
Jul 08 23:41:17.136959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.136939    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"]
Jul 08 23:41:17.240919 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.240889    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-certs\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.241089 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.240925    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-podinfo\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.241089 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.240954    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-credential-socket\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.241089 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.240991    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eda727b-b1f1-4c79-850f-0f9dd5451481-istiod-ca-cert\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.241089 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.241041    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-socket\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.241089 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.241077    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-token\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.241291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.241098    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-envoy\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.241291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.241174    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm65h\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-kube-api-access-tm65h\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.241291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.241209    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-data\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342407 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342374    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm65h\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-kube-api-access-tm65h\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342415    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-data\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342453    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-certs\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342488    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-podinfo\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342549    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-credential-socket\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342573    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eda727b-b1f1-4c79-850f-0f9dd5451481-istiod-ca-cert\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342619    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-socket\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342660    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-token\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.342872 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342692    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-envoy\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.343020 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342947    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-certs\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.343020 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.342985    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-credential-socket\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.343428 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.343308    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-socket\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.343428 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.343366    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-data\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.343908 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.343886    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eda727b-b1f1-4c79-850f-0f9dd5451481-istiod-ca-cert\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.345045 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.345024    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-envoy\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.345503 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.345484    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-podinfo\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.349775 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.349752    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-token\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.349961 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.349944    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm65h\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-kube-api-access-tm65h\") pod \"e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") " pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.436246 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.436169    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:17.576090 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.576066    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"]
Jul 08 23:41:17.577677 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:41:17.577652    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eda727b_b1f1_4c79_850f_0f9dd5451481.slice/crio-bcf4e4a20b5672d919a0c935506590a8d88e444148b87b832391d488754734a1 WatchSource:0}: Error finding container bcf4e4a20b5672d919a0c935506590a8d88e444148b87b832391d488754734a1: Status 404 returned error can't find the container with id bcf4e4a20b5672d919a0c935506590a8d88e444148b87b832391d488754734a1
Jul 08 23:41:17.579823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.579789    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:17.579908 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.579852    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:17.579908 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.579882    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:17.857074 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.857036    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" event={"ID":"7eda727b-b1f1-4c79-850f-0f9dd5451481","Type":"ContainerStarted","Data":"ed0e7e8f56939364608b40eda399b9d762ba4843adf7167442e69607ec87a0f8"}
Jul 08 23:41:17.857264 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.857129    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" event={"ID":"7eda727b-b1f1-4c79-850f-0f9dd5451481","Type":"ContainerStarted","Data":"bcf4e4a20b5672d919a0c935506590a8d88e444148b87b832391d488754734a1"}
Jul 08 23:41:17.876930 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:17.876880    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" podStartSLOduration=0.876865581 podStartE2EDuration="876.865581ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:41:17.873796754 +0000 UTC m=+2021.422856347" watchObservedRunningTime="2026-07-08 23:41:17.876865581 +0000 UTC m=+2021.425925234"
Jul 08 23:41:18.437291 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:18.437260    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:18.441797 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:18.441776    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:18.863924 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:18.863889    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:18.864871 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:18.864853    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:24.915842 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:24.915812    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"]
Jul 08 23:41:24.919305 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:24.919290    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:24.922071 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:24.922036    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-717c2b-openshift-default-dockercfg-9f7zq\""
Jul 08 23:41:24.930668 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:24.930645    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"]
Jul 08 23:41:25.012037 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.011993    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-socket\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.012235 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.012094    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2daf351b-7619-4b25-8545-46f4276c1cfb-istiod-ca-cert\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.012235 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.012128    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-token\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.012235 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.012172    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-data\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.012235 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.012224    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-credential-socket\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.012481 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.012260    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djphh\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-kube-api-access-djphh\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.012481 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.012288    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-podinfo\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.012481 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.012327    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-envoy\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.012481 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.012359    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-certs\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113097    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-socket\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113312 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113149    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2daf351b-7619-4b25-8545-46f4276c1cfb-istiod-ca-cert\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113312 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113179    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-token\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113312 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113214    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-data\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113312 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113258    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-credential-socket\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113312 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113291    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djphh\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-kube-api-access-djphh\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113631 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113317    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-podinfo\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113631 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113353    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-envoy\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113631 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113386    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-certs\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113631 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113576    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-data\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113858 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113603    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-socket\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.113858 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.113804    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-credential-socket\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.114079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.114060    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2daf351b-7619-4b25-8545-46f4276c1cfb-istiod-ca-cert\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.114307 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.114291    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-certs\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.115682 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.115660    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-envoy\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.115907 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.115889    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-podinfo\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.122055 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.122025    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-token\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.122055 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.122035    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djphh\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-kube-api-access-djphh\") pod \"e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") " pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.230891 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.230818    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:25.375075 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.375026    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"]
Jul 08 23:41:25.377006 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:41:25.376977    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2daf351b_7619_4b25_8545_46f4276c1cfb.slice/crio-ea41e25ee6fe41b2e63dee5aaa12117c40e67ac4a39954316c7569d643d25d66 WatchSource:0}: Error finding container ea41e25ee6fe41b2e63dee5aaa12117c40e67ac4a39954316c7569d643d25d66: Status 404 returned error can't find the container with id ea41e25ee6fe41b2e63dee5aaa12117c40e67ac4a39954316c7569d643d25d66
Jul 08 23:41:25.383245 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.383208    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:25.383357 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.383282    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:25.383357 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.383320    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:25.909083 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.909046    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" event={"ID":"2daf351b-7619-4b25-8545-46f4276c1cfb","Type":"ContainerStarted","Data":"e67842a9f05d15a90bcf81f71ff4808959eb0beef72e1b92a4702f61a9b7779d"}
Jul 08 23:41:25.909266 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.909099    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" event={"ID":"2daf351b-7619-4b25-8545-46f4276c1cfb","Type":"ContainerStarted","Data":"ea41e25ee6fe41b2e63dee5aaa12117c40e67ac4a39954316c7569d643d25d66"}
Jul 08 23:41:25.930243 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:25.930201    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" podStartSLOduration=1.930187359 podStartE2EDuration="1.930187359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:41:25.928092483 +0000 UTC m=+2029.477152076" watchObservedRunningTime="2026-07-08 23:41:25.930187359 +0000 UTC m=+2029.479247005"
Jul 08 23:41:26.231031 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:26.230943    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:26.236013 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:26.235989    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:26.915045 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:26.915018    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:26.916090 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:26.916068    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:27.918708 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:27.918673    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:41:34.904685 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:34.904650    2586 patch_prober.go:28] interesting pod/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 23:41:34.905143 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:34.904709    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 23:41:35.972488 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:35.972399    2586 generic.go:356] "Generic (PLEG): container finished" podID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerID="ed0e7e8f56939364608b40eda399b9d762ba4843adf7167442e69607ec87a0f8" exitCode=0
Jul 08 23:41:35.972488 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:35.972440    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" event={"ID":"7eda727b-b1f1-4c79-850f-0f9dd5451481","Type":"ContainerDied","Data":"ed0e7e8f56939364608b40eda399b9d762ba4843adf7167442e69607ec87a0f8"}
Jul 08 23:41:35.973377 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:35.972987    2586 scope.go:117] "RemoveContainer" containerID="ed0e7e8f56939364608b40eda399b9d762ba4843adf7167442e69607ec87a0f8"
Jul 08 23:41:35.974157 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:35.974127    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:35.974206 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:35.974196    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:35.974241 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:35.974227    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:36.980807 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:36.980774    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" event={"ID":"7eda727b-b1f1-4c79-850f-0f9dd5451481","Type":"ContainerStarted","Data":"d298bb0720ca6fa70e6e017c53b326e8236181c6b04ececa5cb897b3105b7a1e"}
Jul 08 23:41:37.436398 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:37.436363    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:37.436626 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:37.436559    2586 patch_prober.go:28] interesting pod/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 08 23:41:37.436626 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:37.436613    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 08 23:41:38.437436 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:38.437406    2586 patch_prober.go:28] interesting pod/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 08 23:41:38.437923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:38.437895    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 08 23:41:39.436921 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:39.436888    2586 patch_prober.go:28] interesting pod/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 08 23:41:39.437094 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:39.436945    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 08 23:41:40.436827 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:40.436790    2586 patch_prober.go:28] interesting pod/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 08 23:41:40.437238 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:40.436842    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 08 23:41:41.440535 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:41.440502    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:41.440915 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:41.440757    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:41.441482 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:41.441464    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:41:42.956696 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:42.956652    2586 patch_prober.go:28] interesting pod/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 23:41:42.957102 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:42.956775    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 23:41:43.304721 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:43.304645    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:41:44.029131 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:44.029022    2586 generic.go:356] "Generic (PLEG): container finished" podID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerID="e67842a9f05d15a90bcf81f71ff4808959eb0beef72e1b92a4702f61a9b7779d" exitCode=0
Jul 08 23:41:44.029131 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:44.029088    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" event={"ID":"2daf351b-7619-4b25-8545-46f4276c1cfb","Type":"ContainerDied","Data":"e67842a9f05d15a90bcf81f71ff4808959eb0beef72e1b92a4702f61a9b7779d"}
Jul 08 23:41:44.029586 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:44.029503    2586 scope.go:117] "RemoveContainer" containerID="e67842a9f05d15a90bcf81f71ff4808959eb0beef72e1b92a4702f61a9b7779d"
Jul 08 23:41:44.030558 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:44.030512    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:44.030674 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:44.030611    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:44.030674 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:44.030659    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:41:45.038300 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:45.038263    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" event={"ID":"2daf351b-7619-4b25-8545-46f4276c1cfb","Type":"ContainerStarted","Data":"5533c51185a0dd7acb8159c4752a74a1b61b7a3e912011e07b420c9854d92015"}
Jul 08 23:41:45.231941 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:45.231907    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:45.232159 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:45.232138    2586 patch_prober.go:28] interesting pod/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 08 23:41:45.232219 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:45.232188    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 08 23:41:46.231261 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:46.231224    2586 patch_prober.go:28] interesting pod/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 08 23:41:46.231677 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:46.231283    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 08 23:41:47.232121 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:47.232083    2586 patch_prober.go:28] interesting pod/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 08 23:41:47.232552 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:47.232135    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 08 23:41:48.231618 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:48.231584    2586 patch_prober.go:28] interesting pod/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 08 23:41:48.231798 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:48.231651    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 08 23:41:49.234930 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:49.234901    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:49.235318 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:49.235175    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:49.235914 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:49.235899    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:41:58.896538 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:41:58.896442    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:42:13.307043 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.307005    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"]
Jul 08 23:42:13.310420 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.310404    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.313994 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.313966    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-717c2b\"/\"kube-root-ca.crt\""
Jul 08 23:42:13.313994 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.313986    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-717c2b\"/\"openshift-service-ca.crt\""
Jul 08 23:42:13.314197 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.313986    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-717c2b\"/\"test-model-717c2b-kserve-self-signed-certs\""
Jul 08 23:42:13.314197 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.314073    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-717c2b\"/\"default-dockercfg-gv6z5\""
Jul 08 23:42:13.320603 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.320584    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"]
Jul 08 23:42:13.377832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.377789    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg27p\" (UniqueName: \"kubernetes.io/projected/5b03a4df-aa8d-416f-b233-361a33318593-kube-api-access-tg27p\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.377979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.377839    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-home\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.377979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.377905    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-model-cache\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.377979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.377954    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-tmp-dir\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.378132 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.377993    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-dshm\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.378132 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.378018    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b03a4df-aa8d-416f-b233-361a33318593-tls-certs\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479038 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479004    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-tmp-dir\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479038 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479045    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-dshm\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479282 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479067    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b03a4df-aa8d-416f-b233-361a33318593-tls-certs\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479282 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479150    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg27p\" (UniqueName: \"kubernetes.io/projected/5b03a4df-aa8d-416f-b233-361a33318593-kube-api-access-tg27p\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479282 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479172    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-home\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479282 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479200    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-model-cache\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479504 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479481    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-tmp-dir\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479614 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479593    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-home\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.479700 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.479663    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-model-cache\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.481489 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.481459    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-dshm\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.481705 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.481690    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b03a4df-aa8d-416f-b233-361a33318593-tls-certs\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.486834 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.486816    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg27p\" (UniqueName: \"kubernetes.io/projected/5b03a4df-aa8d-416f-b233-361a33318593-kube-api-access-tg27p\") pod \"test-model-717c2b-kserve-54b67589df-g5scm\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") " pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.620547 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.620487    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:13.759348 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:13.759324    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"]
Jul 08 23:42:13.761152 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:42:13.761119    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b03a4df_aa8d_416f_b233_361a33318593.slice/crio-5b72763932e29e381a3bce6d51bbbab56d7f1ff8980b1fdeeb2582de7392f1c1 WatchSource:0}: Error finding container 5b72763932e29e381a3bce6d51bbbab56d7f1ff8980b1fdeeb2582de7392f1c1: Status 404 returned error can't find the container with id 5b72763932e29e381a3bce6d51bbbab56d7f1ff8980b1fdeeb2582de7392f1c1
Jul 08 23:42:14.216452 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:14.216411    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm" event={"ID":"5b03a4df-aa8d-416f-b233-361a33318593","Type":"ContainerStarted","Data":"b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1"}
Jul 08 23:42:14.216637 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:14.216460    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm" event={"ID":"5b03a4df-aa8d-416f-b233-361a33318593","Type":"ContainerStarted","Data":"5b72763932e29e381a3bce6d51bbbab56d7f1ff8980b1fdeeb2582de7392f1c1"}
Jul 08 23:42:14.233664 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:14.233619    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm" podStartSLOduration=1.233603691 podStartE2EDuration="1.233603691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:42:14.232871042 +0000 UTC m=+2077.781930633" watchObservedRunningTime="2026-07-08 23:42:14.233603691 +0000 UTC m=+2077.782663683"
Jul 08 23:42:18.502412 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:18.502378    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:42:23.620850 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:23.620816    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:23.621232 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:23.620876    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:23.633347 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:23.633320    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:24.287149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:24.287119    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:36.852187 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:36.852156    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"]
Jul 08 23:42:37.077133 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:37.077107    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:42:37.082548 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:37.082498    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:42:37.084601 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:37.084579    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:42:37.089574 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:37.089558    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:42:42.698795 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:42.698759    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:42:44.505027 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:44.504998    2586 scope.go:117] "RemoveContainer" containerID="2e967213de4db53873d127baa325e97f1a72f8000a06fa77073fcc6587c4a8ba"
Jul 08 23:42:51.876398 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:51.876335    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm" podUID="5b03a4df-aa8d-416f-b233-361a33318593" containerName="main" containerID="cri-o://b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1" gracePeriod=45
Jul 08 23:42:52.131735 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.131677    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:52.238797 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.238770    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg27p\" (UniqueName: \"kubernetes.io/projected/5b03a4df-aa8d-416f-b233-361a33318593-kube-api-access-tg27p\") pod \"5b03a4df-aa8d-416f-b233-361a33318593\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") "
Jul 08 23:42:52.238979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.238810    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-home\") pod \"5b03a4df-aa8d-416f-b233-361a33318593\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") "
Jul 08 23:42:52.238979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.238850    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b03a4df-aa8d-416f-b233-361a33318593-tls-certs\") pod \"5b03a4df-aa8d-416f-b233-361a33318593\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") "
Jul 08 23:42:52.238979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.238900    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-dshm\") pod \"5b03a4df-aa8d-416f-b233-361a33318593\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") "
Jul 08 23:42:52.238979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.238959    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-model-cache\") pod \"5b03a4df-aa8d-416f-b233-361a33318593\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") "
Jul 08 23:42:52.239222 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.238991    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-tmp-dir\") pod \"5b03a4df-aa8d-416f-b233-361a33318593\" (UID: \"5b03a4df-aa8d-416f-b233-361a33318593\") "
Jul 08 23:42:52.239222 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.239154    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-home" (OuterVolumeSpecName: "home") pod "5b03a4df-aa8d-416f-b233-361a33318593" (UID: "5b03a4df-aa8d-416f-b233-361a33318593"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:42:52.239340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.239255    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b03a4df-aa8d-416f-b233-361a33318593" (UID: "5b03a4df-aa8d-416f-b233-361a33318593"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:42:52.239340 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.239305    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b03a4df-aa8d-416f-b233-361a33318593" (UID: "5b03a4df-aa8d-416f-b233-361a33318593"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:42:52.241157 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.241132    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-dshm" (OuterVolumeSpecName: "dshm") pod "5b03a4df-aa8d-416f-b233-361a33318593" (UID: "5b03a4df-aa8d-416f-b233-361a33318593"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:42:52.241259 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.241215    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b03a4df-aa8d-416f-b233-361a33318593-kube-api-access-tg27p" (OuterVolumeSpecName: "kube-api-access-tg27p") pod "5b03a4df-aa8d-416f-b233-361a33318593" (UID: "5b03a4df-aa8d-416f-b233-361a33318593"). InnerVolumeSpecName "kube-api-access-tg27p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:42:52.241336 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.241285    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b03a4df-aa8d-416f-b233-361a33318593-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b03a4df-aa8d-416f-b233-361a33318593" (UID: "5b03a4df-aa8d-416f-b233-361a33318593"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:42:52.339901 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.339874    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-model-cache\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:42:52.339901 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.339898    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-tmp-dir\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:42:52.340045 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.339912    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg27p\" (UniqueName: \"kubernetes.io/projected/5b03a4df-aa8d-416f-b233-361a33318593-kube-api-access-tg27p\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:42:52.340045 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.339924    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-home\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:42:52.340045 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.339936    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b03a4df-aa8d-416f-b233-361a33318593-tls-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:42:52.340045 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.339947    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b03a4df-aa8d-416f-b233-361a33318593-dshm\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:42:52.449807 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.449745    2586 generic.go:356] "Generic (PLEG): container finished" podID="5b03a4df-aa8d-416f-b233-361a33318593" containerID="b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1" exitCode=0
Jul 08 23:42:52.449807 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.449790    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"
Jul 08 23:42:52.449939 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.449785    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm" event={"ID":"5b03a4df-aa8d-416f-b233-361a33318593","Type":"ContainerDied","Data":"b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1"}
Jul 08 23:42:52.449939 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.449900    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm" event={"ID":"5b03a4df-aa8d-416f-b233-361a33318593","Type":"ContainerDied","Data":"5b72763932e29e381a3bce6d51bbbab56d7f1ff8980b1fdeeb2582de7392f1c1"}
Jul 08 23:42:52.449939 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.449921    2586 scope.go:117] "RemoveContainer" containerID="b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1"
Jul 08 23:42:52.459719 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.459703    2586 scope.go:117] "RemoveContainer" containerID="b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1"
Jul 08 23:42:52.459960 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:42:52.459940    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1\": container with ID starting with b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1 not found: ID does not exist" containerID="b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1"
Jul 08 23:42:52.460002 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.459974    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1"} err="failed to get container status \"b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1\": rpc error: code = NotFound desc = could not find container \"b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1\": container with ID starting with b09355cc5bb060c9e201282bb39b1fdf7fe09cc64a744035e1248f66cb367ff1 not found: ID does not exist"
Jul 08 23:42:52.471211 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.471191    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"]
Jul 08 23:42:52.474844 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:52.474826    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-717c2b/test-model-717c2b-kserve-54b67589df-g5scm"]
Jul 08 23:42:53.533330 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:42:53.533295    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b03a4df-aa8d-416f-b233-361a33318593" path="/var/lib/kubelet/pods/5b03a4df-aa8d-416f-b233-361a33318593/volumes"
Jul 08 23:43:19.440114 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:19.440081    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"]
Jul 08 23:43:19.441005 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:19.440427    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy" containerID="cri-o://d298bb0720ca6fa70e6e017c53b326e8236181c6b04ececa5cb897b3105b7a1e" gracePeriod=30
Jul 08 23:43:23.702196 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:23.702161    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:43:24.642194 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.642141    2586 generic.go:356] "Generic (PLEG): container finished" podID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerID="d298bb0720ca6fa70e6e017c53b326e8236181c6b04ececa5cb897b3105b7a1e" exitCode=0
Jul 08 23:43:24.642392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.642293    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" event={"ID":"7eda727b-b1f1-4c79-850f-0f9dd5451481","Type":"ContainerDied","Data":"d298bb0720ca6fa70e6e017c53b326e8236181c6b04ececa5cb897b3105b7a1e"}
Jul 08 23:43:24.642514 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.642402    2586 scope.go:117] "RemoveContainer" containerID="ed0e7e8f56939364608b40eda399b9d762ba4843adf7167442e69607ec87a0f8"
Jul 08 23:43:24.707583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.707512    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:43:24.721399 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721370    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-certs\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.721511 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721408    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-envoy\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.721511 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721436    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-data\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.721511 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721463    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-socket\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.721738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721563    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eda727b-b1f1-4c79-850f-0f9dd5451481-istiod-ca-cert\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.721738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721590    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-credential-socket\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.721738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721627    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-podinfo\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.721738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721680    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm65h\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-kube-api-access-tm65h\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.721738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721706    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:24.721738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721722    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-token\") pod \"7eda727b-b1f1-4c79-850f-0f9dd5451481\" (UID: \"7eda727b-b1f1-4c79-850f-0f9dd5451481\") "
Jul 08 23:43:24.722064 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.721919    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:24.722064 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.722015    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eda727b-b1f1-4c79-850f-0f9dd5451481-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:43:24.722064 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.722059    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:24.722223 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.722079    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:24.722297 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.722275    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:24.722493 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.722472    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-data" (OuterVolumeSpecName: "istio-data") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:24.723985 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.723959    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-kube-api-access-tm65h" (OuterVolumeSpecName: "kube-api-access-tm65h") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "kube-api-access-tm65h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:43:24.724082 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.723982    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-token" (OuterVolumeSpecName: "istio-token") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:43:24.724125 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.724078    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:24.724211 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.724189    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7eda727b-b1f1-4c79-850f-0f9dd5451481" (UID: "7eda727b-b1f1-4c79-850f-0f9dd5451481"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:43:24.823503 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.823474    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eda727b-b1f1-4c79-850f-0f9dd5451481-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:24.823503 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.823500    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:24.823503 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.823510    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm65h\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-kube-api-access-tm65h\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:24.823764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.823543    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:24.823764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.823552    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:24.823764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.823560    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:24.823764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:24.823567    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eda727b-b1f1-4c79-850f-0f9dd5451481-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:25.649357 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:25.649329    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"
Jul 08 23:43:25.649357 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:25.649350    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6" event={"ID":"7eda727b-b1f1-4c79-850f-0f9dd5451481","Type":"ContainerDied","Data":"bcf4e4a20b5672d919a0c935506590a8d88e444148b87b832391d488754734a1"}
Jul 08 23:43:25.649586 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:25.649399    2586 scope.go:117] "RemoveContainer" containerID="d298bb0720ca6fa70e6e017c53b326e8236181c6b04ececa5cb897b3105b7a1e"
Jul 08 23:43:25.668794 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:25.668772    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"]
Jul 08 23:43:25.674000 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:25.673974    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-08d361-openshift-default-69f57c8c85-m59h6"]
Jul 08 23:43:26.477473 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:26.477436    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"]
Jul 08 23:43:26.477959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:26.477733    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy" containerID="cri-o://5533c51185a0dd7acb8159c4752a74a1b61b7a3e912011e07b420c9854d92015" gracePeriod=30
Jul 08 23:43:27.341349 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.341318    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"]
Jul 08 23:43:27.341724 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.341712    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy"
Jul 08 23:43:27.341782 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.341725    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy"
Jul 08 23:43:27.341782 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.341738    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b03a4df-aa8d-416f-b233-361a33318593" containerName="main"
Jul 08 23:43:27.341782 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.341744    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b03a4df-aa8d-416f-b233-361a33318593" containerName="main"
Jul 08 23:43:27.341883 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.341822    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy"
Jul 08 23:43:27.341883 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.341831    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b03a4df-aa8d-416f-b233-361a33318593" containerName="main"
Jul 08 23:43:27.345018 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.344995    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.347726 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.347703    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-932212-openshift-default-dockercfg-gxfmv\""
Jul 08 23:43:27.357084 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.357059    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"]
Jul 08 23:43:27.445971 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.445944    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-socket\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.446165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.445976    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-certs\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.446165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.446041    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-data\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.446165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.446090    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-podinfo\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.446165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.446134    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhxf\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-kube-api-access-qfhxf\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.446165 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.446159    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istiod-ca-cert\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.446436 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.446187    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-credential-socket\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.446436 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.446203    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-envoy\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.446436 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.446230    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-token\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.535938 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.535903    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" path="/var/lib/kubelet/pods/7eda727b-b1f1-4c79-850f-0f9dd5451481/volumes"
Jul 08 23:43:27.546962 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.546931    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-credential-socket\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547127 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.546976    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-envoy\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547127 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547004    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-token\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547127 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547047    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-socket\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547127 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547076    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-certs\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547360 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547194    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-data\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547360 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547228    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-podinfo\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547360 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547275    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhxf\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-kube-api-access-qfhxf\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547360 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547308    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istiod-ca-cert\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547599 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547364    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-credential-socket\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547599 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547432    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-socket\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.547599 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.547513    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-data\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.548052 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.548018    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-certs\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.548251 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.548226    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istiod-ca-cert\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.549695 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.549674    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-envoy\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.549993 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.549973    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-podinfo\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.561500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.561478    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-token\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.562199 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.562182    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhxf\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-kube-api-access-qfhxf\") pod \"e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") " pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.658209 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.658189    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:27.800134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.800111    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"]
Jul 08 23:43:27.801466 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:43:27.801441    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d6b6cb_e748_4dd8_8ffd_c084883b501e.slice/crio-d6a6839b657a8d511d49c0defefd5bfbee235ab0f1925945932545ab45d51601 WatchSource:0}: Error finding container d6a6839b657a8d511d49c0defefd5bfbee235ab0f1925945932545ab45d51601: Status 404 returned error can't find the container with id d6a6839b657a8d511d49c0defefd5bfbee235ab0f1925945932545ab45d51601
Jul 08 23:43:27.803482 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.803447    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:27.803604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.803539    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:27.803604 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:27.803586    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:28.669079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:28.668996    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" event={"ID":"b5d6b6cb-e748-4dd8-8ffd-c084883b501e","Type":"ContainerStarted","Data":"b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e"}
Jul 08 23:43:28.669079 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:28.669051    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" event={"ID":"b5d6b6cb-e748-4dd8-8ffd-c084883b501e","Type":"ContainerStarted","Data":"d6a6839b657a8d511d49c0defefd5bfbee235ab0f1925945932545ab45d51601"}
Jul 08 23:43:28.693034 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:28.692973    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" podStartSLOduration=1.69295485 podStartE2EDuration="1.69295485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:43:28.688991395 +0000 UTC m=+2152.238051187" watchObservedRunningTime="2026-07-08 23:43:28.69295485 +0000 UTC m=+2152.242014446"
Jul 08 23:43:29.658452 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:29.658419    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:29.664158 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:29.664138    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:29.674427 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:29.674397    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:29.675102 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:29.675083    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:31.689628 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.689588    2586 generic.go:356] "Generic (PLEG): container finished" podID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerID="5533c51185a0dd7acb8159c4752a74a1b61b7a3e912011e07b420c9854d92015" exitCode=0
Jul 08 23:43:31.690373 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.690174    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" event={"ID":"2daf351b-7619-4b25-8545-46f4276c1cfb","Type":"ContainerDied","Data":"5533c51185a0dd7acb8159c4752a74a1b61b7a3e912011e07b420c9854d92015"}
Jul 08 23:43:31.690373 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.690259    2586 scope.go:117] "RemoveContainer" containerID="e67842a9f05d15a90bcf81f71ff4808959eb0beef72e1b92a4702f61a9b7779d"
Jul 08 23:43:31.745941 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.745889    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:43:31.791384 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791362    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djphh\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-kube-api-access-djphh\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.791567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791439    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-credential-socket\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.791567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791475    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-certs\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.791567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791499    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-data\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.791567 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791566    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-token\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.791787 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791603    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-socket\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.791847 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791792    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:31.791847 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791798    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:31.791847 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791795    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2daf351b-7619-4b25-8545-46f4276c1cfb-istiod-ca-cert\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.792003 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791845    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:31.792003 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791854    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-podinfo\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.792003 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.791889    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-envoy\") pod \"2daf351b-7619-4b25-8545-46f4276c1cfb\" (UID: \"2daf351b-7619-4b25-8545-46f4276c1cfb\") "
Jul 08 23:43:31.792169 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.792123    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2daf351b-7619-4b25-8545-46f4276c1cfb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:43:31.792608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.792330    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:31.792608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.792354    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:31.792608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.792370    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2daf351b-7619-4b25-8545-46f4276c1cfb-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:31.792608 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.792385    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:31.792852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.792802    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-data" (OuterVolumeSpecName: "istio-data") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:31.793728 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.793709    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-kube-api-access-djphh" (OuterVolumeSpecName: "kube-api-access-djphh") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "kube-api-access-djphh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:43:31.794178 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.794154    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-token" (OuterVolumeSpecName: "istio-token") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:43:31.794338 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.794323    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:43:31.795197 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.795182    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2daf351b-7619-4b25-8545-46f4276c1cfb" (UID: "2daf351b-7619-4b25-8545-46f4276c1cfb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:43:31.892838 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.892810    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:31.892838 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.892833    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:31.892838 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.892842    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djphh\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-kube-api-access-djphh\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:31.893034 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.892851    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:31.893034 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:31.892864    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2daf351b-7619-4b25-8545-46f4276c1cfb-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:43:32.697294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:32.697262    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh" event={"ID":"2daf351b-7619-4b25-8545-46f4276c1cfb","Type":"ContainerDied","Data":"ea41e25ee6fe41b2e63dee5aaa12117c40e67ac4a39954316c7569d643d25d66"}
Jul 08 23:43:32.697294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:32.697293    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"
Jul 08 23:43:32.697807 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:32.697322    2586 scope.go:117] "RemoveContainer" containerID="5533c51185a0dd7acb8159c4752a74a1b61b7a3e912011e07b420c9854d92015"
Jul 08 23:43:32.719236 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:32.719214    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"]
Jul 08 23:43:32.726130 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:32.726109    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-717c2b-openshift-default-66f5c685c9-v2xxh"]
Jul 08 23:43:33.534056 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:33.534021    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" path="/var/lib/kubelet/pods/2daf351b-7619-4b25-8545-46f4276c1cfb/volumes"
Jul 08 23:43:35.821027 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.820996    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"]
Jul 08 23:43:35.821635 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.821620    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy"
Jul 08 23:43:35.821697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.821638    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy"
Jul 08 23:43:35.821697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.821654    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy"
Jul 08 23:43:35.821697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.821662    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy"
Jul 08 23:43:35.821697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.821682    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy"
Jul 08 23:43:35.821697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.821691    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy"
Jul 08 23:43:35.821854 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.821771    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy"
Jul 08 23:43:35.821854 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.821786    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eda727b-b1f1-4c79-850f-0f9dd5451481" containerName="istio-proxy"
Jul 08 23:43:35.826470 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.826451    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.828869 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.828846    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1f3801-openshift-default-dockercfg-j4lhh\""
Jul 08 23:43:35.835701 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.835674    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"]
Jul 08 23:43:35.930556 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.930505    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aa65376-9555-49e9-a49c-5578fda0d612-istiod-ca-cert\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.930760 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.930648    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-envoy\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.930760 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.930736    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-data\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.930906 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.930855    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-socket\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.930906 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.930885    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-credential-socket\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.931016 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.930941    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-certs\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.931097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.931081    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aa65376-9555-49e9-a49c-5578fda0d612-istio-podinfo\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.931235 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.931210    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-istio-token\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:35.931370 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:35.931261    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7jgp\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-kube-api-access-r7jgp\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.031786 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.031755    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7jgp\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-kube-api-access-r7jgp\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.031964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.031795    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aa65376-9555-49e9-a49c-5578fda0d612-istiod-ca-cert\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.031964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.031818    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-envoy\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.031964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.031855    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-data\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.031964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.031894    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-socket\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.031964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.031912    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-credential-socket\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.031964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.031927    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-certs\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.032299 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.032061    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aa65376-9555-49e9-a49c-5578fda0d612-istio-podinfo\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.032299 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.032098    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-istio-token\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.032434 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.032410    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-data\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.032498 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.032471    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-socket\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.032498 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.032484    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-certs\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.032613 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.032511    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-credential-socket\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.032841 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.032816    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aa65376-9555-49e9-a49c-5578fda0d612-istiod-ca-cert\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.034489 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.034470    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-envoy\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.034667 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.034648    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aa65376-9555-49e9-a49c-5578fda0d612-istio-podinfo\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.040353 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.040327    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-istio-token\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.040643 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.040626    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7jgp\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-kube-api-access-r7jgp\") pod \"e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") " pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.138691 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.138668    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:36.284659 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.284634    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"]
Jul 08 23:43:36.286072 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:43:36.286044    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa65376_9555_49e9_a49c_5578fda0d612.slice/crio-e2537770d98bc228414ed63d1ef7a35a042b4e53d9b8505b30b1f7785abae0e0 WatchSource:0}: Error finding container e2537770d98bc228414ed63d1ef7a35a042b4e53d9b8505b30b1f7785abae0e0: Status 404 returned error can't find the container with id e2537770d98bc228414ed63d1ef7a35a042b4e53d9b8505b30b1f7785abae0e0
Jul 08 23:43:36.288217 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.288184    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:36.288321 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.288259    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:36.288321 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.288307    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:36.721792 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.721755    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" event={"ID":"9aa65376-9555-49e9-a49c-5578fda0d612","Type":"ContainerStarted","Data":"5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819"}
Jul 08 23:43:36.721975 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.721814    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" event={"ID":"9aa65376-9555-49e9-a49c-5578fda0d612","Type":"ContainerStarted","Data":"e2537770d98bc228414ed63d1ef7a35a042b4e53d9b8505b30b1f7785abae0e0"}
Jul 08 23:43:36.743652 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:36.743601    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" podStartSLOduration=1.743581937 podStartE2EDuration="1.743581937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:43:36.741315554 +0000 UTC m=+2160.290375147" watchObservedRunningTime="2026-07-08 23:43:36.743581937 +0000 UTC m=+2160.292641530"
Jul 08 23:43:37.139141 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:37.139115    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:37.140695 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:37.140673    2586 patch_prober.go:28] interesting pod/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 08 23:43:37.140815 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:37.140737    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 08 23:43:38.143455 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:38.143415    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:38.734715 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:38.734682    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:38.735588 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:38.735569    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:39.006135 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:39.006055    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:43:45.716688 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:45.716645    2586 patch_prober.go:28] interesting pod/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 23:43:45.717049 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:45.716712    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 23:43:47.806307 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:47.806276    2586 generic.go:356] "Generic (PLEG): container finished" podID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerID="b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e" exitCode=0
Jul 08 23:43:47.806785 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:47.806352    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" event={"ID":"b5d6b6cb-e748-4dd8-8ffd-c084883b501e","Type":"ContainerDied","Data":"b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e"}
Jul 08 23:43:47.806785 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:47.806746    2586 scope.go:117] "RemoveContainer" containerID="b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e"
Jul 08 23:43:47.807703 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:47.807674    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:47.807804 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:47.807739    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:47.807804 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:47.807770    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:48.813643 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:48.813610    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" event={"ID":"b5d6b6cb-e748-4dd8-8ffd-c084883b501e","Type":"ContainerStarted","Data":"db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b"}
Jul 08 23:43:49.658740 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:49.658705    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:49.659134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:49.659053    2586 patch_prober.go:28] interesting pod/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 23:43:49.659301 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:49.659278    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 23:43:50.659118 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:50.659079    2586 patch_prober.go:28] interesting pod/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 23:43:50.659766 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:50.659143    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 23:43:51.658651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:51.658608    2586 patch_prober.go:28] interesting pod/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 23:43:51.658884 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:51.658680    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 23:43:52.659593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:52.659554    2586 patch_prober.go:28] interesting pod/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 23:43:52.660207 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:52.660173    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 23:43:53.669648 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:53.669614    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:53.670164 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:53.670135    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:53.670936 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:53.670912    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:43:55.600031 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:55.599995    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:43:57.432376 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:57.432343    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"]
Jul 08 23:43:57.432920 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:57.432584    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy" containerID="cri-o://db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b" gracePeriod=30
Jul 08 23:43:57.870095 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:57.870064    2586 generic.go:356] "Generic (PLEG): container finished" podID="9aa65376-9555-49e9-a49c-5578fda0d612" containerID="5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819" exitCode=0
Jul 08 23:43:57.870287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:57.870142    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" event={"ID":"9aa65376-9555-49e9-a49c-5578fda0d612","Type":"ContainerDied","Data":"5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819"}
Jul 08 23:43:57.870707 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:57.870687    2586 scope.go:117] "RemoveContainer" containerID="5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819"
Jul 08 23:43:57.871862 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:57.871834    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:57.871960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:57.871916    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:57.872020 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:57.871962    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:43:58.878793 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:58.878760    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" event={"ID":"9aa65376-9555-49e9-a49c-5578fda0d612","Type":"ContainerStarted","Data":"1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc"}
Jul 08 23:43:59.139825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:59.139745    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:43:59.139964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:59.139940    2586 patch_prober.go:28] interesting pod/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 08 23:43:59.140006 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:43:59.139987    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 08 23:44:00.139133 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:00.139100    2586 patch_prober.go:28] interesting pod/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 08 23:44:00.139504 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:00.139162    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 08 23:44:01.140056 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:01.140025    2586 patch_prober.go:28] interesting pod/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 08 23:44:01.140443 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:01.140086    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 08 23:44:02.139584 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.139548    2586 patch_prober.go:28] interesting pod/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 08 23:44:02.139761 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.139601    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 08 23:44:02.724874 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.724851    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:44:02.804181 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804138    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-token\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804207    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfhxf\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-kube-api-access-qfhxf\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804245    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-certs\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804275    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-socket\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804330    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-envoy\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804360    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-podinfo\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804679 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804418    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-data\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804679 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804458    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istiod-ca-cert\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804679 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804489    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-credential-socket\") pod \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\" (UID: \"b5d6b6cb-e748-4dd8-8ffd-c084883b501e\") "
Jul 08 23:44:02.804679 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804614    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:02.804886 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804852    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:02.804946 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804917    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.804999 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.804972    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:44:02.805167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.805119    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:02.805437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.805387    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:02.806726 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.806690    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:02.807066 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.807046    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:44:02.807152 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.807072    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:44:02.807363 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.807339    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-kube-api-access-qfhxf" (OuterVolumeSpecName: "kube-api-access-qfhxf") pod "b5d6b6cb-e748-4dd8-8ffd-c084883b501e" (UID: "b5d6b6cb-e748-4dd8-8ffd-c084883b501e"). InnerVolumeSpecName "kube-api-access-qfhxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:44:02.902996 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.902967    2586 generic.go:356] "Generic (PLEG): container finished" podID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerID="db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b" exitCode=0
Jul 08 23:44:02.903193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.903016    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"
Jul 08 23:44:02.903193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.903056    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" event={"ID":"b5d6b6cb-e748-4dd8-8ffd-c084883b501e","Type":"ContainerDied","Data":"db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b"}
Jul 08 23:44:02.903193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.903119    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k" event={"ID":"b5d6b6cb-e748-4dd8-8ffd-c084883b501e","Type":"ContainerDied","Data":"d6a6839b657a8d511d49c0defefd5bfbee235ab0f1925945932545ab45d51601"}
Jul 08 23:44:02.903193 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.903149    2586 scope.go:117] "RemoveContainer" containerID="db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b"
Jul 08 23:44:02.905480 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.905463    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.905572 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.905487    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfhxf\" (UniqueName: \"kubernetes.io/projected/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-kube-api-access-qfhxf\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.905572 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.905503    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.905657 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.905598    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.905657 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.905613    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.905657 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.905628    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.905657 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.905640    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.905657 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.905652    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5d6b6cb-e748-4dd8-8ffd-c084883b501e-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:02.912771 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.912753    2586 scope.go:117] "RemoveContainer" containerID="b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e"
Jul 08 23:44:02.920975 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.920959    2586 scope.go:117] "RemoveContainer" containerID="db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b"
Jul 08 23:44:02.921215 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:44:02.921198    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b\": container with ID starting with db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b not found: ID does not exist" containerID="db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b"
Jul 08 23:44:02.921260 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.921221    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b"} err="failed to get container status \"db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b\": rpc error: code = NotFound desc = could not find container \"db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b\": container with ID starting with db88f838fc9fac90398ca0f68a6b6c15d1ed138fbef3d5621594aa8d4a69587b not found: ID does not exist"
Jul 08 23:44:02.921260 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.921236    2586 scope.go:117] "RemoveContainer" containerID="b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e"
Jul 08 23:44:02.921458 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:44:02.921441    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e\": container with ID starting with b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e not found: ID does not exist" containerID="b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e"
Jul 08 23:44:02.921500 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.921464    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e"} err="failed to get container status \"b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e\": rpc error: code = NotFound desc = could not find container \"b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e\": container with ID starting with b6cf8e78f3b1619e142d68d1dd1aa8024a32ce4132e180656b289c2da1ce4f9e not found: ID does not exist"
Jul 08 23:44:02.924360 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.924339    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"]
Jul 08 23:44:02.932253 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:02.932227    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-932212-openshift-default-5f46f4d4b9-hmr7k"]
Jul 08 23:44:03.142298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:03.142269    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:44:03.142574 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:03.142551    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:44:03.143264 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:03.143246    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:44:03.533906 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:03.533821    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" path="/var/lib/kubelet/pods/b5d6b6cb-e748-4dd8-8ffd-c084883b501e/volumes"
Jul 08 23:44:04.351167 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:04.351131    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"]
Jul 08 23:44:04.915450 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:04.915413    2586 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" secret="" err="secret \"e2e-api-b-1f3801-openshift-default-dockercfg-j4lhh\" not found"
Jul 08 23:44:05.205298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.205222    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"]
Jul 08 23:44:05.205820 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.205798    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy"
Jul 08 23:44:05.205820 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.205819    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy"
Jul 08 23:44:05.205977 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.205830    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy"
Jul 08 23:44:05.205977 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.205835    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy"
Jul 08 23:44:05.205977 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.205905    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="2daf351b-7619-4b25-8545-46f4276c1cfb" containerName="istio-proxy"
Jul 08 23:44:05.205977 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.205914    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy"
Jul 08 23:44:05.205977 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.205920    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d6b6cb-e748-4dd8-8ffd-c084883b501e" containerName="istio-proxy"
Jul 08 23:44:05.210273 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.210256    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.212658 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.212640    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-310c89-openshift-default-dockercfg-2dccd\""
Jul 08 23:44:05.220775 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.220752    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"]
Jul 08 23:44:05.225431 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225407    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-podinfo\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.225569 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225442    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-data\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.225569 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225459    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istiod-ca-cert\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.225569 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225490    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-socket\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.225748 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225578    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-certs\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.225748 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225609    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-token\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.225748 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225646    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-envoy\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.225748 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225721    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-credential-socket\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.225902 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.225789    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf8t5\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-kube-api-access-rf8t5\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.326843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.326809    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-socket\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.326857    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-certs\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.326874    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-token\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.326899    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-envoy\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.326932    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-credential-socket\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.326968    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf8t5\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-kube-api-access-rf8t5\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327028 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.327025    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-podinfo\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.327053    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-data\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.327070    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istiod-ca-cert\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.327229    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-socket\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.327284    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-certs\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327584 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.327477    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-data\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327651 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.327596    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-credential-socket\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.327856 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.327836    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istiod-ca-cert\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.329231 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.329215    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-envoy\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.329609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.329588    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-podinfo\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.334711 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.334690    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf8t5\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-kube-api-access-rf8t5\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.334824 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.334750    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-token\") pod \"e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") " pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.521906 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.521823    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:05.662435 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.662407    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"]
Jul 08 23:44:05.664535 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:44:05.664489    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6cc6f3_5073_4d6f_b57f_c60d145eeb0c.slice/crio-4ff3443a732e382a1413291b623f8cae088b21365074ede4882264fd0afda50b WatchSource:0}: Error finding container 4ff3443a732e382a1413291b623f8cae088b21365074ede4882264fd0afda50b: Status 404 returned error can't find the container with id 4ff3443a732e382a1413291b623f8cae088b21365074ede4882264fd0afda50b
Jul 08 23:44:05.666823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.666793    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:05.666923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.666858    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:05.666923 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.666889    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:05.923593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.923555    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" event={"ID":"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c","Type":"ContainerStarted","Data":"6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e"}
Jul 08 23:44:05.923834 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.923621    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" event={"ID":"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c","Type":"ContainerStarted","Data":"4ff3443a732e382a1413291b623f8cae088b21365074ede4882264fd0afda50b"}
Jul 08 23:44:05.923834 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.923721    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy" containerID="cri-o://1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc" gracePeriod=30
Jul 08 23:44:05.946141 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:05.946087    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" podStartSLOduration=0.946068108 podStartE2EDuration="946.068108ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:44:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:44:05.942139029 +0000 UTC m=+2189.491198620" watchObservedRunningTime="2026-07-08 23:44:05.946068108 +0000 UTC m=+2189.495127685"
Jul 08 23:44:06.522600 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:06.522571    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:06.527744 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:06.527721    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:06.929407 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:06.929378    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:06.930478 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:06.930457    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:09.398537 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:09.398500    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:44:11.188989 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.188934    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:44:11.282176 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282147    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7jgp\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-kube-api-access-r7jgp\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282316 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282184    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-istio-token\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282316 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282207    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aa65376-9555-49e9-a49c-5578fda0d612-istiod-ca-cert\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282316 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282222    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-data\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282316 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282285    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-certs\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282316 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282304    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-envoy\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282618 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282348    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-socket\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282618 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282377    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-credential-socket\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282618 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282423    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aa65376-9555-49e9-a49c-5578fda0d612-istio-podinfo\") pod \"9aa65376-9555-49e9-a49c-5578fda0d612\" (UID: \"9aa65376-9555-49e9-a49c-5578fda0d612\") "
Jul 08 23:44:11.282779 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282620    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:11.282779 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282637    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa65376-9555-49e9-a49c-5578fda0d612-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:44:11.282884 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282801    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:11.282943 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282913    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.282943 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282933    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.283043 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282945    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aa65376-9555-49e9-a49c-5578fda0d612-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.283043 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.282955    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:11.283235 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.283214    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-data" (OuterVolumeSpecName: "istio-data") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:11.284371 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.284344    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-istio-token" (OuterVolumeSpecName: "istio-token") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:44:11.284689 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.284663    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9aa65376-9555-49e9-a49c-5578fda0d612-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:44:11.284834 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.284809    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:44:11.284880 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.284827    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-kube-api-access-r7jgp" (OuterVolumeSpecName: "kube-api-access-r7jgp") pod "9aa65376-9555-49e9-a49c-5578fda0d612" (UID: "9aa65376-9555-49e9-a49c-5578fda0d612"). InnerVolumeSpecName "kube-api-access-r7jgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:44:11.383910 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.383884    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.383910 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.383906    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.384050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.383916    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aa65376-9555-49e9-a49c-5578fda0d612-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.384050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.383925    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7jgp\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-kube-api-access-r7jgp\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.384050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.383933    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aa65376-9555-49e9-a49c-5578fda0d612-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.384050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.383941    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aa65376-9555-49e9-a49c-5578fda0d612-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:44:11.958153 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.958118    2586 generic.go:356] "Generic (PLEG): container finished" podID="9aa65376-9555-49e9-a49c-5578fda0d612" containerID="1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc" exitCode=0
Jul 08 23:44:11.958364 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.958161    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" event={"ID":"9aa65376-9555-49e9-a49c-5578fda0d612","Type":"ContainerDied","Data":"1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc"}
Jul 08 23:44:11.958364 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.958170    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"
Jul 08 23:44:11.958364 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.958202    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt" event={"ID":"9aa65376-9555-49e9-a49c-5578fda0d612","Type":"ContainerDied","Data":"e2537770d98bc228414ed63d1ef7a35a042b4e53d9b8505b30b1f7785abae0e0"}
Jul 08 23:44:11.958364 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.958225    2586 scope.go:117] "RemoveContainer" containerID="1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc"
Jul 08 23:44:11.968055 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.968038    2586 scope.go:117] "RemoveContainer" containerID="5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819"
Jul 08 23:44:11.976277 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.976229    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"]
Jul 08 23:44:11.976360 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.976311    2586 scope.go:117] "RemoveContainer" containerID="1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc"
Jul 08 23:44:11.976588 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:44:11.976568    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc\": container with ID starting with 1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc not found: ID does not exist" containerID="1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc"
Jul 08 23:44:11.976697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.976593    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc"} err="failed to get container status \"1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc\": rpc error: code = NotFound desc = could not find container \"1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc\": container with ID starting with 1767737a15f8750d45ed0d0e0920e949ede62330e0dc04c9d6f53068cb1787dc not found: ID does not exist"
Jul 08 23:44:11.976697 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.976611    2586 scope.go:117] "RemoveContainer" containerID="5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819"
Jul 08 23:44:11.976873 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:44:11.976856    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819\": container with ID starting with 5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819 not found: ID does not exist" containerID="5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819"
Jul 08 23:44:11.976915 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.976883    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819"} err="failed to get container status \"5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819\": rpc error: code = NotFound desc = could not find container \"5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819\": container with ID starting with 5477a5d38a6e413e78445c761e55ba800279a8291cae0b282aa0c7eaf5958819 not found: ID does not exist"
Jul 08 23:44:11.980408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:11.980388    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1f3801-openshift-default-6b9c9b474c-96bzt"]
Jul 08 23:44:12.920620 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:12.920573    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"]
Jul 08 23:44:12.921076 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:12.920992    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy"
Jul 08 23:44:12.921076 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:12.921003    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy"
Jul 08 23:44:12.921192 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:12.921078    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy"
Jul 08 23:44:12.921192 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:12.921086    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy"
Jul 08 23:44:12.925802 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:12.925781    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:12.928314 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:12.928290    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-cd1865-openshift-default-dockercfg-vkfx9\""
Jul 08 23:44:12.938324 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:12.938304    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"]
Jul 08 23:44:13.007975 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.007946    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-socket\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.007975 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.007979    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-token\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.008208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.008021    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istiod-ca-cert\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.008208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.008058    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-credential-socket\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.008208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.008076    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-envoy\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.008208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.008165    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-certs\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.008208 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.008208    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-data\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.008481 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.008229    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-podinfo\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.008481 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.008244    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jw5s\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-kube-api-access-4jw5s\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109070 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109036    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istiod-ca-cert\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109217 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109080    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-credential-socket\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109279 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109244    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-envoy\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109279 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109275    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-certs\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109382 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109303    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-data\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109382 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109322    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-podinfo\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109382 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109336    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jw5s\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-kube-api-access-4jw5s\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109382 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109363    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-socket\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109397    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-token\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109630 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109563    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-credential-socket\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109704    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-certs\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109722    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-data\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109916 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109898    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istiod-ca-cert\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.109959 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.109945    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-socket\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.112016 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.111999    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-envoy\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.112329 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.112307    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-podinfo\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.117396 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.117377    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-token\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.118000 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.117980    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jw5s\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-kube-api-access-4jw5s\") pod \"e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") " pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.237831 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.237748    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:13.382743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.382711    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"]
Jul 08 23:44:13.384464 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:44:13.384434    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb567d616_660e_4cf4_ba45_3c32bf9bc3ec.slice/crio-9a33f3ff49fbffd0245424cd0a26aaccd88d016558f17fa263f1cd2853b5f759 WatchSource:0}: Error finding container 9a33f3ff49fbffd0245424cd0a26aaccd88d016558f17fa263f1cd2853b5f759: Status 404 returned error can't find the container with id 9a33f3ff49fbffd0245424cd0a26aaccd88d016558f17fa263f1cd2853b5f759
Jul 08 23:44:13.386832 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.386795    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:13.386904 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.386881    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:13.386946 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.386931    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:13.535173 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.535097    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" path="/var/lib/kubelet/pods/9aa65376-9555-49e9-a49c-5578fda0d612/volumes"
Jul 08 23:44:13.973646 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.973611    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" event={"ID":"b567d616-660e-4cf4-ba45-3c32bf9bc3ec","Type":"ContainerStarted","Data":"5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630"}
Jul 08 23:44:13.974025 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.973658    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" event={"ID":"b567d616-660e-4cf4-ba45-3c32bf9bc3ec","Type":"ContainerStarted","Data":"9a33f3ff49fbffd0245424cd0a26aaccd88d016558f17fa263f1cd2853b5f759"}
Jul 08 23:44:13.993463 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:13.993410    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" podStartSLOduration=1.993391281 podStartE2EDuration="1.993391281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:44:13.992054289 +0000 UTC m=+2197.541113903" watchObservedRunningTime="2026-07-08 23:44:13.993391281 +0000 UTC m=+2197.542450874"
Jul 08 23:44:14.238904 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:14.238809    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:14.243253 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:14.243223    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:14.979965 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:14.979934    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:14.981054 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:14.981036    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:20.606699 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:20.606669    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:44:21.930612 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:21.930581    2586 patch_prober.go:28] interesting pod/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:44:21.931061 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:21.930640    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 23:44:22.022854 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:22.022823    2586 generic.go:356] "Generic (PLEG): container finished" podID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerID="6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e" exitCode=0
Jul 08 23:44:22.023035 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:22.022874    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" event={"ID":"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c","Type":"ContainerDied","Data":"6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e"}
Jul 08 23:44:22.023266 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:22.023251    2586 scope.go:117] "RemoveContainer" containerID="6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e"
Jul 08 23:44:22.024271 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:22.024243    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:22.024335 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:22.024309    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:22.024380 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:22.024342    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:23.031824 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:23.031792    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" event={"ID":"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c","Type":"ContainerStarted","Data":"49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b"}
Jul 08 23:44:23.522131 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:23.522094    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:23.522327 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:23.522303    2586 patch_prober.go:28] interesting pod/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:44:23.522383 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:23.522359    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 23:44:24.522424 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:24.522388    2586 patch_prober.go:28] interesting pod/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:44:24.522880 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:24.522452    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 23:44:25.522978 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:25.522939    2586 patch_prober.go:28] interesting pod/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:44:25.523464 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:25.523006    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 23:44:26.522298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:26.522265    2586 patch_prober.go:28] interesting pod/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 23:44:26.522463 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:26.522334    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 23:44:27.535718 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:27.535689    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:27.536205 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:27.535941    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:27.536852 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:27.536834    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:44:29.982118 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:29.982083    2586 patch_prober.go:28] interesting pod/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:44:29.982597 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:29.982152    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 23:44:30.081574 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:30.081539    2586 generic.go:356] "Generic (PLEG): container finished" podID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerID="5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630" exitCode=0
Jul 08 23:44:30.081738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:30.081615    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" event={"ID":"b567d616-660e-4cf4-ba45-3c32bf9bc3ec","Type":"ContainerDied","Data":"5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630"}
Jul 08 23:44:30.082027 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:30.082014    2586 scope.go:117] "RemoveContainer" containerID="5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630"
Jul 08 23:44:30.083046 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:30.083019    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:30.083107 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:30.083084    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:30.083153 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:30.083135    2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 23:44:31.090210 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:31.090180    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" event={"ID":"b567d616-660e-4cf4-ba45-3c32bf9bc3ec","Type":"ContainerStarted","Data":"385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1"}
Jul 08 23:44:31.238592 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:31.238559    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:31.238825 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:31.238804    2586 patch_prober.go:28] interesting pod/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:44:31.238881 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:31.238860    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 23:44:32.238255 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:32.238218    2586 patch_prober.go:28] interesting pod/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:44:32.238662 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:32.238271    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 23:44:33.238459 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:33.238423    2586 patch_prober.go:28] interesting pod/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:44:33.238862 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:33.238487    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 23:44:34.238538 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:34.238490    2586 patch_prober.go:28] interesting pod/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 23:44:34.238944 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:34.238558    2586 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 23:44:35.242260 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:35.242231    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:35.242663 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:35.242572    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:35.243388 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:35.243364    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:44:36.398734 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:36.398701    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:44:56.496975 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:44:56.496936    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:45:27.604791 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:45:27.604760    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:45:46.697705 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:45:46.697671    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:46:05.302363 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:46:05.302325    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:46:19.906097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:46:19.906060    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:46:37.400559 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:46:37.400468    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:46:55.596286 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:46:55.596253    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:47:13.997339 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:13.997302    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:47:23.305859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.305830    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"]
Jul 08 23:47:23.306455 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.306435    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy"
Jul 08 23:47:23.306573 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.306457    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa65376-9555-49e9-a49c-5578fda0d612" containerName="istio-proxy"
Jul 08 23:47:23.308702 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.308681    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.311062 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.311041    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-310c89\"/\"default-dockercfg-ccd7r\""
Jul 08 23:47:23.311154 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.311101    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-310c89\"/\"openshift-service-ca.crt\""
Jul 08 23:47:23.312143 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.312123    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-310c89\"/\"sub-test-model-310c89-kserve-self-signed-certs\""
Jul 08 23:47:23.312245 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.312210    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-310c89\"/\"kube-root-ca.crt\""
Jul 08 23:47:23.318555 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.318533    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"]
Jul 08 23:47:23.438956 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.438919    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcvg9\" (UniqueName: \"kubernetes.io/projected/bca5230b-781e-4717-ba42-da27beac3fae-kube-api-access-kcvg9\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.438956 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.438956    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-model-cache\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.439169 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.439052    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-home\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.439169 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.439088    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-dshm\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.439169 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.439102    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-tmp-dir\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.439270 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.439176    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca5230b-781e-4717-ba42-da27beac3fae-tls-certs\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.540593 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.540558    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-home\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.540772 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.540607    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-dshm\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.540772 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.540630    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-tmp-dir\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.540772 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.540680    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca5230b-781e-4717-ba42-da27beac3fae-tls-certs\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.540772 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.540720    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcvg9\" (UniqueName: \"kubernetes.io/projected/bca5230b-781e-4717-ba42-da27beac3fae-kube-api-access-kcvg9\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.540973 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.540831    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-model-cache\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.541141 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.541116    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-tmp-dir\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.541268 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.541117    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-home\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.541268 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.541200    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-model-cache\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.542975 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.542951    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-dshm\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.543394 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.543373    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca5230b-781e-4717-ba42-da27beac3fae-tls-certs\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.548615 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.548587    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcvg9\" (UniqueName: \"kubernetes.io/projected/bca5230b-781e-4717-ba42-da27beac3fae-kube-api-access-kcvg9\") pod \"sub-test-model-310c89-kserve-5675585b8c-fhhvb\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") " pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.619563 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.619531    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:23.751543 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:23.751501    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"]
Jul 08 23:47:23.753471 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:47:23.753443    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbca5230b_781e_4717_ba42_da27beac3fae.slice/crio-c9ebc52444b8c62d63ae86c2661bbc89e964a2abec4ddf19decba3734c57aba2 WatchSource:0}: Error finding container c9ebc52444b8c62d63ae86c2661bbc89e964a2abec4ddf19decba3734c57aba2: Status 404 returned error can't find the container with id c9ebc52444b8c62d63ae86c2661bbc89e964a2abec4ddf19decba3734c57aba2
Jul 08 23:47:24.085067 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:24.084981    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb" event={"ID":"bca5230b-781e-4717-ba42-da27beac3fae","Type":"ContainerStarted","Data":"a32cf956566a9682766c4d120ca91558a9bfd956b0a413304e368d7d2c0edcf0"}
Jul 08 23:47:24.085067 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:24.085020    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb" event={"ID":"bca5230b-781e-4717-ba42-da27beac3fae","Type":"ContainerStarted","Data":"c9ebc52444b8c62d63ae86c2661bbc89e964a2abec4ddf19decba3734c57aba2"}
Jul 08 23:47:24.103713 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:24.103653    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb" podStartSLOduration=1.103632083 podStartE2EDuration="1.103632083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:47:24.10210714 +0000 UTC m=+2387.651166732" watchObservedRunningTime="2026-07-08 23:47:24.103632083 +0000 UTC m=+2387.652691688"
Jul 08 23:47:28.403892 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:28.403857    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:47:33.620225 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:33.620197    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:33.620631 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:33.620241    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:33.632727 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:33.632708    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:34.150398 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:34.150364    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:47:37.116130 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:37.116099    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:47:37.122973 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:37.122952    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:47:37.123110 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:37.122991    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:47:37.130047 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:37.130025    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhdh9_06e98e17-863d-4dec-b390-1dcd328b465b/ovn-acl-logging/0.log"
Jul 08 23:47:55.393303 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:47:55.393270    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:48:10.603349 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:10.603268    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:48:26.346238 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:26.346198    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"]
Jul 08 23:48:31.902755 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:31.902722    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:48:41.367932 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.367891    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb" podUID="bca5230b-781e-4717-ba42-da27beac3fae" containerName="main" containerID="cri-o://a32cf956566a9682766c4d120ca91558a9bfd956b0a413304e368d7d2c0edcf0" gracePeriod=45
Jul 08 23:48:41.527186 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.527149    2586 generic.go:356] "Generic (PLEG): container finished" podID="bca5230b-781e-4717-ba42-da27beac3fae" containerID="a32cf956566a9682766c4d120ca91558a9bfd956b0a413304e368d7d2c0edcf0" exitCode=0
Jul 08 23:48:41.532764 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.532732    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb" event={"ID":"bca5230b-781e-4717-ba42-da27beac3fae","Type":"ContainerDied","Data":"a32cf956566a9682766c4d120ca91558a9bfd956b0a413304e368d7d2c0edcf0"}
Jul 08 23:48:41.614833 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.614810    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:48:41.764082 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.763998    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcvg9\" (UniqueName: \"kubernetes.io/projected/bca5230b-781e-4717-ba42-da27beac3fae-kube-api-access-kcvg9\") pod \"bca5230b-781e-4717-ba42-da27beac3fae\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") "
Jul 08 23:48:41.764082 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764058    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-home\") pod \"bca5230b-781e-4717-ba42-da27beac3fae\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") "
Jul 08 23:48:41.764309 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764096    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca5230b-781e-4717-ba42-da27beac3fae-tls-certs\") pod \"bca5230b-781e-4717-ba42-da27beac3fae\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") "
Jul 08 23:48:41.764309 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764121    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-tmp-dir\") pod \"bca5230b-781e-4717-ba42-da27beac3fae\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") "
Jul 08 23:48:41.764309 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764169    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-dshm\") pod \"bca5230b-781e-4717-ba42-da27beac3fae\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") "
Jul 08 23:48:41.764309 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764198    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-model-cache\") pod \"bca5230b-781e-4717-ba42-da27beac3fae\" (UID: \"bca5230b-781e-4717-ba42-da27beac3fae\") "
Jul 08 23:48:41.764557 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764293    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-home" (OuterVolumeSpecName: "home") pod "bca5230b-781e-4717-ba42-da27beac3fae" (UID: "bca5230b-781e-4717-ba42-da27beac3fae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:48:41.764557 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764356    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bca5230b-781e-4717-ba42-da27beac3fae" (UID: "bca5230b-781e-4717-ba42-da27beac3fae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:48:41.764557 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764471    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-home\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:48:41.764557 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764497    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-tmp-dir\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:48:41.764557 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.764506    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-model-cache" (OuterVolumeSpecName: "model-cache") pod "bca5230b-781e-4717-ba42-da27beac3fae" (UID: "bca5230b-781e-4717-ba42-da27beac3fae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:48:41.766342 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.766317    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-dshm" (OuterVolumeSpecName: "dshm") pod "bca5230b-781e-4717-ba42-da27beac3fae" (UID: "bca5230b-781e-4717-ba42-da27beac3fae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:48:41.766460 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.766375    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca5230b-781e-4717-ba42-da27beac3fae-kube-api-access-kcvg9" (OuterVolumeSpecName: "kube-api-access-kcvg9") pod "bca5230b-781e-4717-ba42-da27beac3fae" (UID: "bca5230b-781e-4717-ba42-da27beac3fae"). InnerVolumeSpecName "kube-api-access-kcvg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:48:41.766460 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.766442    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bca5230b-781e-4717-ba42-da27beac3fae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bca5230b-781e-4717-ba42-da27beac3fae" (UID: "bca5230b-781e-4717-ba42-da27beac3fae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:48:41.864969 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.864946    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-model-cache\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:48:41.864969 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.864967    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcvg9\" (UniqueName: \"kubernetes.io/projected/bca5230b-781e-4717-ba42-da27beac3fae-kube-api-access-kcvg9\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:48:41.865116 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.864978    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca5230b-781e-4717-ba42-da27beac3fae-tls-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:48:41.865116 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:41.864989    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca5230b-781e-4717-ba42-da27beac3fae-dshm\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:48:42.533875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:42.533845    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"
Jul 08 23:48:42.533875 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:42.533857    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb" event={"ID":"bca5230b-781e-4717-ba42-da27beac3fae","Type":"ContainerDied","Data":"c9ebc52444b8c62d63ae86c2661bbc89e964a2abec4ddf19decba3734c57aba2"}
Jul 08 23:48:42.534400 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:42.533912    2586 scope.go:117] "RemoveContainer" containerID="a32cf956566a9682766c4d120ca91558a9bfd956b0a413304e368d7d2c0edcf0"
Jul 08 23:48:42.557088 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:42.557060    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"]
Jul 08 23:48:42.560671 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:42.560642    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-310c89/sub-test-model-310c89-kserve-5675585b8c-fhhvb"]
Jul 08 23:48:43.533437 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:43.533404    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca5230b-781e-4717-ba42-da27beac3fae" path="/var/lib/kubelet/pods/bca5230b-781e-4717-ba42-da27beac3fae/volumes"
Jul 08 23:48:48.604883 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:48:48.604855    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:49:01.110063 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.110027    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"]
Jul 08 23:49:01.110606 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.110589    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca5230b-781e-4717-ba42-da27beac3fae" containerName="main"
Jul 08 23:49:01.110689 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.110608    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca5230b-781e-4717-ba42-da27beac3fae" containerName="main"
Jul 08 23:49:01.110752 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.110705    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca5230b-781e-4717-ba42-da27beac3fae" containerName="main"
Jul 08 23:49:01.113378 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.113363    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.115731 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.115709    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cd1865\"/\"openshift-service-ca.crt\""
Jul 08 23:49:01.116843 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.116804    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cd1865\"/\"default-dockercfg-zlxb5\""
Jul 08 23:49:01.116960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.116868    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cd1865\"/\"kube-root-ca.crt\""
Jul 08 23:49:01.116960 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.116948    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cd1865\"/\"rate-test-model-cd1865-kserve-self-signed-certs\""
Jul 08 23:49:01.121014 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.120947    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"]
Jul 08 23:49:01.132129 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.132098    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-tmp-dir\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.132232 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.132148    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6wk9\" (UniqueName: \"kubernetes.io/projected/b273b1d2-a670-499a-b65f-718aa9e86e6d-kube-api-access-q6wk9\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.132284 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.132238    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-dshm\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.132284 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.132272    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b273b1d2-a670-499a-b65f-718aa9e86e6d-tls-certs\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.132364 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.132297    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-model-cache\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.132407 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.132390    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-home\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233001 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.232975    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-tmp-dir\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233142 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.233012    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6wk9\" (UniqueName: \"kubernetes.io/projected/b273b1d2-a670-499a-b65f-718aa9e86e6d-kube-api-access-q6wk9\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233142 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.233042    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-dshm\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233142 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.233066    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b273b1d2-a670-499a-b65f-718aa9e86e6d-tls-certs\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233142 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.233090    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-model-cache\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233142 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.233132    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-home\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233422 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.233406    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-tmp-dir\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233570 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.233548    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-home\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.233631 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.233576    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-model-cache\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.235215 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.235195    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-dshm\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.235585 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.235568    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b273b1d2-a670-499a-b65f-718aa9e86e6d-tls-certs\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.240548 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.240510    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6wk9\" (UniqueName: \"kubernetes.io/projected/b273b1d2-a670-499a-b65f-718aa9e86e6d-kube-api-access-q6wk9\") pod \"rate-test-model-cd1865-kserve-9887d6655-fhz8h\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") " pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.423956 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.423874    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:01.560687 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.560655    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"]
Jul 08 23:49:01.561761 ip-10-0-138-15 kubenswrapper[2586]: W0708 23:49:01.561735    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb273b1d2_a670_499a_b65f_718aa9e86e6d.slice/crio-23888d630db958c0165ce144a5ce2cacac98aee93cf4895999ca732e6b2c04d4 WatchSource:0}: Error finding container 23888d630db958c0165ce144a5ce2cacac98aee93cf4895999ca732e6b2c04d4: Status 404 returned error can't find the container with id 23888d630db958c0165ce144a5ce2cacac98aee93cf4895999ca732e6b2c04d4
Jul 08 23:49:01.646595 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.646558    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h" event={"ID":"b273b1d2-a670-499a-b65f-718aa9e86e6d","Type":"ContainerStarted","Data":"e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a"}
Jul 08 23:49:01.646762 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.646612    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h" event={"ID":"b273b1d2-a670-499a-b65f-718aa9e86e6d","Type":"ContainerStarted","Data":"23888d630db958c0165ce144a5ce2cacac98aee93cf4895999ca732e6b2c04d4"}
Jul 08 23:49:01.666034 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:01.665981    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h" podStartSLOduration=0.665961466 podStartE2EDuration="665.961466ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:49:01.662907369 +0000 UTC m=+2485.211966986" watchObservedRunningTime="2026-07-08 23:49:01.665961466 +0000 UTC m=+2485.215021059"
Jul 08 23:49:06.200294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:06.200260    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:49:11.424196 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:11.424164    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:11.424196 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:11.424205    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:11.436734 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:11.436716    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:11.716662 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:11.716587    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:49:21.304294 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:21.304260    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:49:40.702373 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:40.702341    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:49:48.538591 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:48.538561    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"]
Jul 08 23:49:55.094390 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:49:55.094354    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:50:03.563050 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.563007    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h" podUID="b273b1d2-a670-499a-b65f-718aa9e86e6d" containerName="main" containerID="cri-o://e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a" gracePeriod=45
Jul 08 23:50:03.810480 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.810452    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:50:03.908732 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.908706    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-model-cache\") pod \"b273b1d2-a670-499a-b65f-718aa9e86e6d\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") "
Jul 08 23:50:03.908898 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.908754    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6wk9\" (UniqueName: \"kubernetes.io/projected/b273b1d2-a670-499a-b65f-718aa9e86e6d-kube-api-access-q6wk9\") pod \"b273b1d2-a670-499a-b65f-718aa9e86e6d\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") "
Jul 08 23:50:03.908898 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.908772    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b273b1d2-a670-499a-b65f-718aa9e86e6d-tls-certs\") pod \"b273b1d2-a670-499a-b65f-718aa9e86e6d\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") "
Jul 08 23:50:03.908898 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.908802    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-dshm\") pod \"b273b1d2-a670-499a-b65f-718aa9e86e6d\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") "
Jul 08 23:50:03.908898 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.908886    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-home\") pod \"b273b1d2-a670-499a-b65f-718aa9e86e6d\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") "
Jul 08 23:50:03.909116 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.908908    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-tmp-dir\") pod \"b273b1d2-a670-499a-b65f-718aa9e86e6d\" (UID: \"b273b1d2-a670-499a-b65f-718aa9e86e6d\") "
Jul 08 23:50:03.909116 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.909032    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "b273b1d2-a670-499a-b65f-718aa9e86e6d" (UID: "b273b1d2-a670-499a-b65f-718aa9e86e6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:03.909226 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.909179    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-home" (OuterVolumeSpecName: "home") pod "b273b1d2-a670-499a-b65f-718aa9e86e6d" (UID: "b273b1d2-a670-499a-b65f-718aa9e86e6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:03.909295 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.909240    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b273b1d2-a670-499a-b65f-718aa9e86e6d" (UID: "b273b1d2-a670-499a-b65f-718aa9e86e6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:03.911049 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.911024    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b273b1d2-a670-499a-b65f-718aa9e86e6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b273b1d2-a670-499a-b65f-718aa9e86e6d" (UID: "b273b1d2-a670-499a-b65f-718aa9e86e6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:50:03.911151 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.911066    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-dshm" (OuterVolumeSpecName: "dshm") pod "b273b1d2-a670-499a-b65f-718aa9e86e6d" (UID: "b273b1d2-a670-499a-b65f-718aa9e86e6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:03.911151 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:03.911071    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b273b1d2-a670-499a-b65f-718aa9e86e6d-kube-api-access-q6wk9" (OuterVolumeSpecName: "kube-api-access-q6wk9") pod "b273b1d2-a670-499a-b65f-718aa9e86e6d" (UID: "b273b1d2-a670-499a-b65f-718aa9e86e6d"). InnerVolumeSpecName "kube-api-access-q6wk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:50:04.010438 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.010415    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6wk9\" (UniqueName: \"kubernetes.io/projected/b273b1d2-a670-499a-b65f-718aa9e86e6d-kube-api-access-q6wk9\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:04.010438 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.010436    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b273b1d2-a670-499a-b65f-718aa9e86e6d-tls-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:04.010749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.010447    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-dshm\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:04.010749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.010456    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-home\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:04.010749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.010463    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-tmp-dir\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:04.010749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.010471    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b273b1d2-a670-499a-b65f-718aa9e86e6d-model-cache\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:04.013583 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.013560    2586 generic.go:356] "Generic (PLEG): container finished" podID="b273b1d2-a670-499a-b65f-718aa9e86e6d" containerID="e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a" exitCode=0
Jul 08 23:50:04.013683 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.013598    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"
Jul 08 23:50:04.013683 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.013647    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h" event={"ID":"b273b1d2-a670-499a-b65f-718aa9e86e6d","Type":"ContainerDied","Data":"e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a"}
Jul 08 23:50:04.013763 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.013686    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h" event={"ID":"b273b1d2-a670-499a-b65f-718aa9e86e6d","Type":"ContainerDied","Data":"23888d630db958c0165ce144a5ce2cacac98aee93cf4895999ca732e6b2c04d4"}
Jul 08 23:50:04.013763 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.013704    2586 scope.go:117] "RemoveContainer" containerID="e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a"
Jul 08 23:50:04.023105 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.023089    2586 scope.go:117] "RemoveContainer" containerID="e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a"
Jul 08 23:50:04.023346 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:50:04.023327    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a\": container with ID starting with e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a not found: ID does not exist" containerID="e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a"
Jul 08 23:50:04.023408 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.023353    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a"} err="failed to get container status \"e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a\": rpc error: code = NotFound desc = could not find container \"e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a\": container with ID starting with e317f10d9a3623af28db522eede9206669b2138c644216717df37ad6ae48531a not found: ID does not exist"
Jul 08 23:50:04.035354 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.035333    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"]
Jul 08 23:50:04.039720 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:04.039697    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cd1865/rate-test-model-cd1865-kserve-9887d6655-fhz8h"]
Jul 08 23:50:05.533716 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:05.533683    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b273b1d2-a670-499a-b65f-718aa9e86e6d" path="/var/lib/kubelet/pods/b273b1d2-a670-499a-b65f-718aa9e86e6d/volumes"
Jul 08 23:50:33.499359 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:33.499326    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:50:35.898010 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:35.897976    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"]
Jul 08 23:50:35.898475 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:35.898241    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy" containerID="cri-o://49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b" gracePeriod=30
Jul 08 23:50:41.159435 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.159367    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:50:41.233261 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.233224    2586 generic.go:356] "Generic (PLEG): container finished" podID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerID="49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b" exitCode=0
Jul 08 23:50:41.233422 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.233277    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"
Jul 08 23:50:41.233422 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.233310    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" event={"ID":"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c","Type":"ContainerDied","Data":"49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b"}
Jul 08 23:50:41.233422 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.233373    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9" event={"ID":"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c","Type":"ContainerDied","Data":"4ff3443a732e382a1413291b623f8cae088b21365074ede4882264fd0afda50b"}
Jul 08 23:50:41.233422 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.233398    2586 scope.go:117] "RemoveContainer" containerID="49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b"
Jul 08 23:50:41.242574 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.242557    2586 scope.go:117] "RemoveContainer" containerID="6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e"
Jul 08 23:50:41.244752 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.244719    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-credential-socket\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.244865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.244763    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-socket\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.244865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.244811    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-token\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.244865 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.244844    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-data\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.245039 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.244948    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf8t5\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-kube-api-access-rf8t5\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.245039 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.244990    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:41.245152 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245052    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:41.245152 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245072    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-certs\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.245152 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245122    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-envoy\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.245315 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245155    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-podinfo\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.245315 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245206    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istiod-ca-cert\") pod \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\" (UID: \"3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c\") "
Jul 08 23:50:41.245418 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245314    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:41.245738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245584    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.245738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245608    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.245738 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.245622    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.246287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.246254    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:50:41.246287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.246265    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:41.247758 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.247732    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:50:41.247994 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.247964    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-kube-api-access-rf8t5" (OuterVolumeSpecName: "kube-api-access-rf8t5") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "kube-api-access-rf8t5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:50:41.248134 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.248034    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:41.248309 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.248282    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" (UID: "3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:50:41.253822 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.253800    2586 scope.go:117] "RemoveContainer" containerID="49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b"
Jul 08 23:50:41.254124 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:50:41.254101    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b\": container with ID starting with 49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b not found: ID does not exist" containerID="49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b"
Jul 08 23:50:41.254203 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.254135    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b"} err="failed to get container status \"49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b\": rpc error: code = NotFound desc = could not find container \"49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b\": container with ID starting with 49fc997e2bc770ddd9f2a54369bef1e14f88566c2917092c775a9bafbca3262b not found: ID does not exist"
Jul 08 23:50:41.254203 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.254158    2586 scope.go:117] "RemoveContainer" containerID="6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e"
Jul 08 23:50:41.254425 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:50:41.254404    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e\": container with ID starting with 6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e not found: ID does not exist" containerID="6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e"
Jul 08 23:50:41.254487 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.254432    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e"} err="failed to get container status \"6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e\": rpc error: code = NotFound desc = could not find container \"6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e\": container with ID starting with 6cc9848f17fdf9ff44fdabf51ae10a687e622c14faaf49bf86debffff85b379e not found: ID does not exist"
Jul 08 23:50:41.346506 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.346474    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.346506 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.346505    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.346691 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.346536    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf8t5\" (UniqueName: \"kubernetes.io/projected/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-kube-api-access-rf8t5\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.346691 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.346549    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.346691 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.346562    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.346691 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.346574    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:41.559439 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.559407    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"]
Jul 08 23:50:41.568147 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:41.568116    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-310c89-openshift-default-689b4cd49f-wsdb9"]
Jul 08 23:50:42.828493 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:42.828460    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"]
Jul 08 23:50:42.828907 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:42.828707    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy" containerID="cri-o://385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1" gracePeriod=30
Jul 08 23:50:43.534601 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:43.534565    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" path="/var/lib/kubelet/pods/3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c/volumes"
Jul 08 23:50:45.693619 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:45.693589    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ktc7w"]
Jul 08 23:50:48.096771 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.096751    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:50:48.209677 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209649    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-token\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.209861 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209703    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istiod-ca-cert\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.209861 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209735    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jw5s\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-kube-api-access-4jw5s\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.209861 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209755    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-credential-socket\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.209861 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209811    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-data\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.209861 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209838    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-certs\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.210128 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209885    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-envoy\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.210128 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209916    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-podinfo\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.210128 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.209951    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-socket\") pod \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\" (UID: \"b567d616-660e-4cf4-ba45-3c32bf9bc3ec\") "
Jul 08 23:50:48.210287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.210217    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:48.210287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.210233    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:48.210287 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.210241    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:50:48.210492 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.210459    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:48.210811 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.210786    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:48.212445 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.212412    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-kube-api-access-4jw5s" (OuterVolumeSpecName: "kube-api-access-4jw5s") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "kube-api-access-4jw5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:50:48.212445 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.212423    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:50:48.212605 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.212423    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:50:48.212605 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.212494    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b567d616-660e-4cf4-ba45-3c32bf9bc3ec" (UID: "b567d616-660e-4cf4-ba45-3c32bf9bc3ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 23:50:48.280086 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.280057    2586 generic.go:356] "Generic (PLEG): container finished" podID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerID="385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1" exitCode=0
Jul 08 23:50:48.280250 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.280118    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"
Jul 08 23:50:48.280250 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.280154    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" event={"ID":"b567d616-660e-4cf4-ba45-3c32bf9bc3ec","Type":"ContainerDied","Data":"385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1"}
Jul 08 23:50:48.280250 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.280248    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl" event={"ID":"b567d616-660e-4cf4-ba45-3c32bf9bc3ec","Type":"ContainerDied","Data":"9a33f3ff49fbffd0245424cd0a26aaccd88d016558f17fa263f1cd2853b5f759"}
Jul 08 23:50:48.280439 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.280279    2586 scope.go:117] "RemoveContainer" containerID="385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1"
Jul 08 23:50:48.289812 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.289797    2586 scope.go:117] "RemoveContainer" containerID="5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630"
Jul 08 23:50:48.298023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.298006    2586 scope.go:117] "RemoveContainer" containerID="385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1"
Jul 08 23:50:48.298271 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:50:48.298254    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1\": container with ID starting with 385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1 not found: ID does not exist" containerID="385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1"
Jul 08 23:50:48.298317 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.298281    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1"} err="failed to get container status \"385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1\": rpc error: code = NotFound desc = could not find container \"385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1\": container with ID starting with 385b649a5309a68a80cc00d35e2acd54c6bc43295cb1c7f7d017438d037431a1 not found: ID does not exist"
Jul 08 23:50:48.298317 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.298298    2586 scope.go:117] "RemoveContainer" containerID="5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630"
Jul 08 23:50:48.298536 ip-10-0-138-15 kubenswrapper[2586]: E0708 23:50:48.298499    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630\": container with ID starting with 5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630 not found: ID does not exist" containerID="5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630"
Jul 08 23:50:48.298585 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.298534    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630"} err="failed to get container status \"5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630\": rpc error: code = NotFound desc = could not find container \"5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630\": container with ID starting with 5245d7aad200aac99d91db2bd9bc96131e384d333a829de5539420536087e630 not found: ID does not exist"
Jul 08 23:50:48.302268 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.302247    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"]
Jul 08 23:50:48.307609 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.307589    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-cd1865-openshift-default-6996579b47-p54bl"]
Jul 08 23:50:48.311513 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311497    2586 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-podinfo\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.311587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311539    2586 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.311587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311550    2586 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-token\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.311587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311561    2586 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istiod-ca-cert\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.311587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311569    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jw5s\" (UniqueName: \"kubernetes.io/projected/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-kube-api-access-4jw5s\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.311587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311578    2586 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-credential-socket\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.311587 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311585    2586 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-data\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.311776 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311593    2586 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-workload-certs\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.311776 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.311601    2586 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b567d616-660e-4cf4-ba45-3c32bf9bc3ec-istio-envoy\") on node \"ip-10-0-138-15.ec2.internal\" DevicePath \"\""
Jul 08 23:50:48.340974 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.340955    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c6mhn_a73777e5-e394-4284-acb7-63fe2e210a7d/manager/0.log"
Jul 08 23:50:48.457839 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.457766    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-swk7h_7979a909-70f9-4c5b-a51f-a363c062fd73/manager/0.log"
Jul 08 23:50:48.693804 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:48.693778    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-drc67_96ae783b-d769-4140-ade2-159d65dcdf83/server/0.log"
Jul 08 23:50:49.052418 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:49.052389    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b86895794-lsvqj_be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84/copy-manifests/0.log"
Jul 08 23:50:49.059281 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:49.059258    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b86895794-lsvqj_be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84/manager/0.log"
Jul 08 23:50:49.534504 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:49.534475    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" path="/var/lib/kubelet/pods/b567d616-660e-4cf4-ba45-3c32bf9bc3ec/volumes"
Jul 08 23:50:50.441964 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.441938    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm_a9cf0ce4-4f02-4da6-b746-c872f011ed34/util/0.log"
Jul 08 23:50:50.448743 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.448717    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm_a9cf0ce4-4f02-4da6-b746-c872f011ed34/pull/0.log"
Jul 08 23:50:50.455154 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.455135    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm_a9cf0ce4-4f02-4da6-b746-c872f011ed34/extract/0.log"
Jul 08 23:50:50.578097 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.578073    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx_8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a/util/0.log"
Jul 08 23:50:50.584463 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.584441    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx_8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a/pull/0.log"
Jul 08 23:50:50.592456 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.592437    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx_8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a/extract/0.log"
Jul 08 23:50:50.717984 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.717917    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg_fb67938b-b919-446f-8c3f-73ce4717c661/util/0.log"
Jul 08 23:50:50.724831 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.724811    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg_fb67938b-b919-446f-8c3f-73ce4717c661/pull/0.log"
Jul 08 23:50:50.731321 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.731304    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg_fb67938b-b919-446f-8c3f-73ce4717c661/extract/0.log"
Jul 08 23:50:50.859912 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.859891    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245_a4236f30-3ffc-4ee5-8485-dd813d3bffd3/extract/0.log"
Jul 08 23:50:50.866065 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.866041    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245_a4236f30-3ffc-4ee5-8485-dd813d3bffd3/util/0.log"
Jul 08 23:50:50.872149 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:50.872131    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245_a4236f30-3ffc-4ee5-8485-dd813d3bffd3/pull/0.log"
Jul 08 23:50:51.122618 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:51.122589    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n25mc_b3f7fd26-c1fe-4403-8156-a72e477ad504/manager/0.log"
Jul 08 23:50:51.250420 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:51.250395    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-h27w4_cedde334-a802-4993-918c-e5715bdfcc4f/manager/0.log"
Jul 08 23:50:51.371123 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:51.371099    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-csc9r_1e592360-1666-4c7b-895b-5aba3fe797c2/kuadrant-console-plugin/0.log"
Jul 08 23:50:51.493088 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:51.493011    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6mzwb_6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd/registry-server/0.log"
Jul 08 23:50:51.617747 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:51.617719    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vmgbt_e33114d1-3cc4-422e-a2a9-4fa5bfd19e64/manager/0.log"
Jul 08 23:50:51.736530 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:51.736504    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ktc7w_8287b403-04ca-41f2-9c21-201d252aaa64/limitador/0.log"
Jul 08 23:50:51.857349 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:51.857320    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h66xn_c5333a7c-80f9-4a06-994c-99ef238ff885/manager/0.log"
Jul 08 23:50:52.213080 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:52.213003    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678782z5_667e2567-fe6b-44da-a667-baa657a03a6e/istio-proxy/0.log"
Jul 08 23:50:52.447877 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:52.447848    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b8998bd98-85tk7_14014473-eccb-4371-95a9-fd3370066aa0/kube-auth-proxy/0.log"
Jul 08 23:50:52.675015 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:52.674987    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vp674_df1aba57-ac38-4dde-86ba-22bc6dbe4528/istio-proxy/1.log"
Jul 08 23:50:53.021600 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:53.021507    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fff4f6f5-rhps2_8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5/router/0.log"
Jul 08 23:50:53.919886 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:53.919859    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wsbsg_a2a95f55-7d25-4750-b45a-d53cfc335f88/main/0.log"
Jul 08 23:50:58.290596 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.290555    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bcsht/must-gather-xtspx"]
Jul 08 23:50:58.291041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.290953    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy"
Jul 08 23:50:58.291041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.290966    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy"
Jul 08 23:50:58.291041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.290973    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy"
Jul 08 23:50:58.291041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.290979    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy"
Jul 08 23:50:58.291041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.290996    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b273b1d2-a670-499a-b65f-718aa9e86e6d" containerName="main"
Jul 08 23:50:58.291041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291001    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b273b1d2-a670-499a-b65f-718aa9e86e6d" containerName="main"
Jul 08 23:50:58.291041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291007    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy"
Jul 08 23:50:58.291041 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291012    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy"
Jul 08 23:50:58.291298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291082    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy"
Jul 08 23:50:58.291298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291089    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy"
Jul 08 23:50:58.291298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291095    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy"
Jul 08 23:50:58.291298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291102    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6cc6f3-5073-4d6f-b57f-c60d145eeb0c" containerName="istio-proxy"
Jul 08 23:50:58.291298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291109    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b273b1d2-a670-499a-b65f-718aa9e86e6d" containerName="main"
Jul 08 23:50:58.291298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291160    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy"
Jul 08 23:50:58.291298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.291166    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b567d616-660e-4cf4-ba45-3c32bf9bc3ec" containerName="istio-proxy"
Jul 08 23:50:58.295749 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.295731    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bcsht/must-gather-xtspx"
Jul 08 23:50:58.298240 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.298213    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bcsht\"/\"default-dockercfg-twmx9\""
Jul 08 23:50:58.299222 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.299195    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bcsht\"/\"openshift-service-ca.crt\""
Jul 08 23:50:58.299327 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.299202    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bcsht\"/\"kube-root-ca.crt\""
Jul 08 23:50:58.305140 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.305113    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bcsht/must-gather-xtspx"]
Jul 08 23:50:58.400180 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.400105    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f150c4db-a418-480f-9adc-4eb704bec565-must-gather-output\") pod \"must-gather-xtspx\" (UID: \"f150c4db-a418-480f-9adc-4eb704bec565\") " pod="openshift-must-gather-bcsht/must-gather-xtspx"
Jul 08 23:50:58.400180 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.400155    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtdk6\" (UniqueName: \"kubernetes.io/projected/f150c4db-a418-480f-9adc-4eb704bec565-kube-api-access-rtdk6\") pod \"must-gather-xtspx\" (UID: \"f150c4db-a418-480f-9adc-4eb704bec565\") " pod="openshift-must-gather-bcsht/must-gather-xtspx"
Jul 08 23:50:58.500850 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.500816    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdk6\" (UniqueName: \"kubernetes.io/projected/f150c4db-a418-480f-9adc-4eb704bec565-kube-api-access-rtdk6\") pod \"must-gather-xtspx\" (UID: \"f150c4db-a418-480f-9adc-4eb704bec565\") " pod="openshift-must-gather-bcsht/must-gather-xtspx"
Jul 08 23:50:58.501011 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.500915    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f150c4db-a418-480f-9adc-4eb704bec565-must-gather-output\") pod \"must-gather-xtspx\" (UID: \"f150c4db-a418-480f-9adc-4eb704bec565\") " pod="openshift-must-gather-bcsht/must-gather-xtspx"
Jul 08 23:50:58.501225 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.501208    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f150c4db-a418-480f-9adc-4eb704bec565-must-gather-output\") pod \"must-gather-xtspx\" (UID: \"f150c4db-a418-480f-9adc-4eb704bec565\") " pod="openshift-must-gather-bcsht/must-gather-xtspx"
Jul 08 23:50:58.508803 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.508776    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtdk6\" (UniqueName: \"kubernetes.io/projected/f150c4db-a418-480f-9adc-4eb704bec565-kube-api-access-rtdk6\") pod \"must-gather-xtspx\" (UID: \"f150c4db-a418-480f-9adc-4eb704bec565\") " pod="openshift-must-gather-bcsht/must-gather-xtspx"
Jul 08 23:50:58.606196 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.606171    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bcsht/must-gather-xtspx"
Jul 08 23:50:58.739405 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.739381    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bcsht/must-gather-xtspx"]
Jul 08 23:50:58.748072 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:58.748046    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:50:59.345035 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:50:59.345002    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bcsht/must-gather-xtspx" event={"ID":"f150c4db-a418-480f-9adc-4eb704bec565","Type":"ContainerStarted","Data":"73a8525cf260512de1b1a5c963e3007fca5fe2edaa92bf0647506a39e4646d75"}
Jul 08 23:51:00.359392 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:00.359350    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bcsht/must-gather-xtspx" event={"ID":"f150c4db-a418-480f-9adc-4eb704bec565","Type":"ContainerStarted","Data":"58ddead4017a1db054c4923040b4de98feb8a1972d57ce1281a8d4557725f525"}
Jul 08 23:51:00.359902 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:00.359406    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bcsht/must-gather-xtspx" event={"ID":"f150c4db-a418-480f-9adc-4eb704bec565","Type":"ContainerStarted","Data":"f9d588c0980d59a20c7889257a47d5d5ff59bfa0b5e0e802a786764cc649dc87"}
Jul 08 23:51:00.374482 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:00.374434    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bcsht/must-gather-xtspx" podStartSLOduration=1.59817836 podStartE2EDuration="2.374420336s" totalImagesPullingTime="776.241976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:51:00.373614785 +0000 UTC m=+2603.922674379" watchObservedRunningTime="2026-07-08 23:51:00.374420336 +0000 UTC m=+2603.923479928"
Jul 08 23:51:01.054577 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:01.054543    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p6sv7_b09f1d67-537f-4e5d-889e-6a5164aadf32/global-pull-secret-syncer/0.log"
Jul 08 23:51:01.173298 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:01.173263    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cw9wl_0cb739af-dcea-41ee-af74-e07c4b2c016b/konnectivity-agent/0.log"
Jul 08 23:51:01.277141 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:01.277116    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-15.ec2.internal_9d1aa91a25fa6212282656141f669b7b/haproxy/0.log"
Jul 08 23:51:05.932013 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:05.931975    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm_a9cf0ce4-4f02-4da6-b746-c872f011ed34/extract/0.log"
Jul 08 23:51:05.954015 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:05.953986    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm_a9cf0ce4-4f02-4da6-b746-c872f011ed34/util/0.log"
Jul 08 23:51:05.978769 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:05.978745    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759822sm_a9cf0ce4-4f02-4da6-b746-c872f011ed34/pull/0.log"
Jul 08 23:51:06.014353 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.014313    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx_8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a/extract/0.log"
Jul 08 23:51:06.037004 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.036977    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx_8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a/util/0.log"
Jul 08 23:51:06.061182 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.061157    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gx7qx_8e3a3de4-8f6c-49f9-a369-e3f9294d7b6a/pull/0.log"
Jul 08 23:51:06.090308 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.090209    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg_fb67938b-b919-446f-8c3f-73ce4717c661/extract/0.log"
Jul 08 23:51:06.113661 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.113635    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg_fb67938b-b919-446f-8c3f-73ce4717c661/util/0.log"
Jul 08 23:51:06.134836 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.134781    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sfkhg_fb67938b-b919-446f-8c3f-73ce4717c661/pull/0.log"
Jul 08 23:51:06.161798 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.161736    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245_a4236f30-3ffc-4ee5-8485-dd813d3bffd3/extract/0.log"
Jul 08 23:51:06.182768 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.182612    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245_a4236f30-3ffc-4ee5-8485-dd813d3bffd3/util/0.log"
Jul 08 23:51:06.205888 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.205862    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15b245_a4236f30-3ffc-4ee5-8485-dd813d3bffd3/pull/0.log"
Jul 08 23:51:06.755542 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.755490    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n25mc_b3f7fd26-c1fe-4403-8156-a72e477ad504/manager/0.log"
Jul 08 23:51:06.791762 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.791732    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-h27w4_cedde334-a802-4993-918c-e5715bdfcc4f/manager/0.log"
Jul 08 23:51:06.831121 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.831097    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-csc9r_1e592360-1666-4c7b-895b-5aba3fe797c2/kuadrant-console-plugin/0.log"
Jul 08 23:51:06.881360 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:06.881326    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6mzwb_6d335b9f-2dfb-462a-84f1-bbbfdbe68ecd/registry-server/0.log"
Jul 08 23:51:07.004548 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:07.002727    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vmgbt_e33114d1-3cc4-422e-a2a9-4fa5bfd19e64/manager/0.log"
Jul 08 23:51:07.028337 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:07.028148    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ktc7w_8287b403-04ca-41f2-9c21-201d252aaa64/limitador/0.log"
Jul 08 23:51:07.107541 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:07.107495    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h66xn_c5333a7c-80f9-4a06-994c-99ef238ff885/manager/0.log"
Jul 08 23:51:09.001108 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.001071    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-trrth_833aa9c8-2900-4ad7-b09d-f89317da05f5/monitoring-plugin/0.log"
Jul 08 23:51:09.193456 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.193403    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qfwbj_c2f0c9c7-7ca9-418d-8b68-4aebff383aed/node-exporter/0.log"
Jul 08 23:51:09.216295 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.216261    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qfwbj_c2f0c9c7-7ca9-418d-8b68-4aebff383aed/kube-rbac-proxy/0.log"
Jul 08 23:51:09.238801 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.238775    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qfwbj_c2f0c9c7-7ca9-418d-8b68-4aebff383aed/init-textfile/0.log"
Jul 08 23:51:09.651310 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.651275    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd587b-p8zdf_a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a/thanos-query/0.log"
Jul 08 23:51:09.672881 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.672857    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd587b-p8zdf_a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a/kube-rbac-proxy-web/0.log"
Jul 08 23:51:09.698021 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.697996    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd587b-p8zdf_a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a/kube-rbac-proxy/0.log"
Jul 08 23:51:09.720808 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.720770    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd587b-p8zdf_a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a/prom-label-proxy/0.log"
Jul 08 23:51:09.745433 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.745408    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd587b-p8zdf_a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a/kube-rbac-proxy-rules/0.log"
Jul 08 23:51:09.768190 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:09.768165    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd587b-p8zdf_a6d3ad5d-b6cd-46b5-aed9-10d9cc3a5f9a/kube-rbac-proxy-metrics/0.log"
Jul 08 23:51:11.039333 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.039289    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"]
Jul 08 23:51:11.044013 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.043989    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.053823 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.053800    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"]
Jul 08 23:51:11.152577 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.152537    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-sys\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.152770 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.152622    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sj9x\" (UniqueName: \"kubernetes.io/projected/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-kube-api-access-2sj9x\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.152770 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.152703    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-podres\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.152770 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.152734    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-proc\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.152969 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.152792    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-lib-modules\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.253481 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.253442    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-sys\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.253767 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.253745    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sj9x\" (UniqueName: \"kubernetes.io/projected/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-kube-api-access-2sj9x\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.253954 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.253936    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-podres\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.254083 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.254068    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-proc\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.254195 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.253626    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-sys\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.254349 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.254328    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-lib-modules\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.254432 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.254200    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-lib-modules\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.254581 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.254537    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-proc\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.254712 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.254693    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-podres\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.263137 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.263108    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sj9x\" (UniqueName: \"kubernetes.io/projected/144a8fcb-9410-4fa1-a50c-e59d3aab7c1d-kube-api-access-2sj9x\") pod \"perf-node-gather-daemonset-gfz8b\" (UID: \"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.357878 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.357848    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:11.495821 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.495774    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/1.log"
Jul 08 23:51:11.503599 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.503558    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hmdh5_b1a2b0d2-ad03-40f9-9bb6-b3c8d17e93ed/console-operator/2.log"
Jul 08 23:51:11.541780 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.539091    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"]
Jul 08 23:51:11.977700 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:11.977617    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c95c75cb-nz9hh_9d077928-2fab-4c25-89bc-762266624e55/console/0.log"
Jul 08 23:51:12.473178 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:12.473144    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b" event={"ID":"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d","Type":"ContainerStarted","Data":"5b98624e56962a8f445bd7a571f236d0099aec4f9e2628fe915b34ff68fdb238"}
Jul 08 23:51:12.473677 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:12.473204    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b" event={"ID":"144a8fcb-9410-4fa1-a50c-e59d3aab7c1d","Type":"ContainerStarted","Data":"1f25ad424ec5cab3bd8e1e6fc127484d121e3ca5b2137cb87d7bf115770585c4"}
Jul 08 23:51:12.473677 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:12.473355    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:12.491057 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:12.490997    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b" podStartSLOduration=1.4909779539999999 podStartE2EDuration="1.490977954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:51:12.488293822 +0000 UTC m=+2616.037353415" watchObservedRunningTime="2026-07-08 23:51:12.490977954 +0000 UTC m=+2616.040037547"
Jul 08 23:51:12.582742 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:12.582718    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-ghgjx_95a9f4ca-d35d-4b00-bcd2-aaca8cf5d376/volume-data-source-validator/0.log"
Jul 08 23:51:13.643314 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:13.643291    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gpfsz_db460404-b805-4b07-b594-e85ba66ea2e2/dns/0.log"
Jul 08 23:51:13.665200 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:13.665165    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gpfsz_db460404-b805-4b07-b594-e85ba66ea2e2/kube-rbac-proxy/0.log"
Jul 08 23:51:13.732488 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:13.732461    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sm9fr_4b7f3241-2369-452d-be9d-b62f0c496956/dns-node-resolver/0.log"
Jul 08 23:51:14.422775 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:14.422747    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d2kh5_bd51c369-2f70-4c75-841c-9d7e762a70b4/node-ca/0.log"
Jul 08 23:51:15.362043 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:15.362014    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678782z5_667e2567-fe6b-44da-a667-baa657a03a6e/istio-proxy/0.log"
Jul 08 23:51:15.494109 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:15.494083    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b8998bd98-85tk7_14014473-eccb-4371-95a9-fd3370066aa0/kube-auth-proxy/0.log"
Jul 08 23:51:15.552884 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:15.552853    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vp674_df1aba57-ac38-4dde-86ba-22bc6dbe4528/istio-proxy/0.log"
Jul 08 23:51:15.591859 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:15.591832    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vp674_df1aba57-ac38-4dde-86ba-22bc6dbe4528/istio-proxy/1.log"
Jul 08 23:51:15.718928 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:15.718854    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fff4f6f5-rhps2_8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5/router/0.log"
Jul 08 23:51:16.388866 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:16.388833    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xcktj_0972dfb7-4183-42cb-b206-f64251b15d45/serve-healthcheck-canary/0.log"
Jul 08 23:51:16.860074 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:16.860042    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-tbn49_06f33d43-cab9-4703-8fe0-320176063683/insights-operator/0.log"
Jul 08 23:51:16.862026 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:16.861998    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-tbn49_06f33d43-cab9-4703-8fe0-320176063683/insights-operator/1.log"
Jul 08 23:51:17.018683 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:17.018650    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ptcvp_66e2e7ee-e66e-46b3-805e-a87d0169e79e/kube-rbac-proxy/0.log"
Jul 08 23:51:17.041925 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:17.041891    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ptcvp_66e2e7ee-e66e-46b3-805e-a87d0169e79e/exporter/0.log"
Jul 08 23:51:17.064477 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:17.064452    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ptcvp_66e2e7ee-e66e-46b3-805e-a87d0169e79e/extractor/0.log"
Jul 08 23:51:18.490854 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:18.490829    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-gfz8b"
Jul 08 23:51:19.094337 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:19.094295    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c6mhn_a73777e5-e394-4284-acb7-63fe2e210a7d/manager/0.log"
Jul 08 23:51:19.272674 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:19.272642    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-swk7h_7979a909-70f9-4c5b-a51f-a363c062fd73/manager/0.log"
Jul 08 23:51:19.466681 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:19.466641    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-drc67_96ae783b-d769-4140-ade2-159d65dcdf83/server/0.log"
Jul 08 23:51:19.652331 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:19.650190    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b86895794-lsvqj_be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84/manager/0.log"
Jul 08 23:51:19.670907 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:19.670882    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b86895794-lsvqj_be6e6072-9d7d-4b61-a2d7-9e9cd5d56b84/copy-manifests/0.log"
Jul 08 23:51:21.736307 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:21.736277    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678782z5_667e2567-fe6b-44da-a667-baa657a03a6e/istio-proxy/0.log"
Jul 08 23:51:21.869640 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:21.869608    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b8998bd98-85tk7_14014473-eccb-4371-95a9-fd3370066aa0/kube-auth-proxy/0.log"
Jul 08 23:51:21.907637 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:21.907606    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vp674_df1aba57-ac38-4dde-86ba-22bc6dbe4528/istio-proxy/0.log"
Jul 08 23:51:21.943300 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:21.943272    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vp674_df1aba57-ac38-4dde-86ba-22bc6dbe4528/istio-proxy/1.log"
Jul 08 23:51:22.047511 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:22.047428    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fff4f6f5-rhps2_8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5/router/0.log"
Jul 08 23:51:23.187655 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:23.187624    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678782z5_667e2567-fe6b-44da-a667-baa657a03a6e/istio-proxy/0.log"
Jul 08 23:51:23.303744 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:23.303675    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b8998bd98-85tk7_14014473-eccb-4371-95a9-fd3370066aa0/kube-auth-proxy/0.log"
Jul 08 23:51:23.361004 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:23.360970    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vp674_df1aba57-ac38-4dde-86ba-22bc6dbe4528/istio-proxy/0.log"
Jul 08 23:51:23.394442 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:23.394413    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vp674_df1aba57-ac38-4dde-86ba-22bc6dbe4528/istio-proxy/1.log"
Jul 08 23:51:23.502981 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:23.502955    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fff4f6f5-rhps2_8ec5ac05-7ffb-4fab-adc6-4fd83ae018d5/router/0.log"
Jul 08 23:51:26.657175 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:26.657143    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-56k62_0ef29118-3f96-440b-bb5b-ab884e67b8bc/kube-storage-version-migrator-operator/1.log"
Jul 08 23:51:26.658428 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:26.658402    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-56k62_0ef29118-3f96-440b-bb5b-ab884e67b8bc/kube-storage-version-migrator-operator/0.log"
Jul 08 23:51:27.732585 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:27.732549    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl9rq_681c6287-4fea-4dd1-90bc-cdb82b6a2591/kube-multus-additional-cni-plugins/0.log"
Jul 08 23:51:27.753748 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:27.753718    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl9rq_681c6287-4fea-4dd1-90bc-cdb82b6a2591/egress-router-binary-copy/0.log"
Jul 08 23:51:27.775023 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:27.775001    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl9rq_681c6287-4fea-4dd1-90bc-cdb82b6a2591/cni-plugins/0.log"
Jul 08 23:51:27.795280 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:27.795254    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl9rq_681c6287-4fea-4dd1-90bc-cdb82b6a2591/bond-cni-plugin/0.log"
Jul 08 23:51:27.815711 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:27.815683    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl9rq_681c6287-4fea-4dd1-90bc-cdb82b6a2591/routeoverride-cni/0.log"
Jul 08 23:51:27.836537 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:27.836498    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl9rq_681c6287-4fea-4dd1-90bc-cdb82b6a2591/whereabouts-cni-bincopy/0.log"
Jul 08 23:51:27.863597 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:27.863572    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl9rq_681c6287-4fea-4dd1-90bc-cdb82b6a2591/whereabouts-cni/0.log"
Jul 08 23:51:28.052966 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:28.052884    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gdknf_59a33c2b-9f6a-4084-868f-32636e1cf0a8/kube-multus/0.log"
Jul 08 23:51:28.221365 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:28.221325    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txmkb_5d90721e-9094-4a91-a701-0cfcfdeebf1f/network-metrics-daemon/0.log"
Jul 08 23:51:28.240979 ip-10-0-138-15 kubenswrapper[2586]: I0708 23:51:28.240955    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txmkb_5d90721e-9094-4a91-a701-0cfcfdeebf1f/kube-rbac-proxy/0.log"