Jul 20 18:11:13.825750 ip-10-0-138-45 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 18:11:13.825760 ip-10-0-138-45 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 18:11:13.825768 ip-10-0-138-45 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 18:11:13.825993 ip-10-0-138-45 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 18:11:23.845765 ip-10-0-138-45 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 18:11:23.845785 ip-10-0-138-45 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot facbfed77c804528aad3f33cf15d4109 --
Jul 20 18:13:22.645733 ip-10-0-138-45 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.079522    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083565    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083576    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083580    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083583    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083586    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083590    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083593    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 18:13:23.153995 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083595    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083599    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083605    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083608    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083612    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083615    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083617    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083620    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083623    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083626    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083630    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083633    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083635    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083638    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083641    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083644    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083648    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083652    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 18:13:23.155936 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083654    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083659    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083663    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083667    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083672    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083675    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083678    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083681    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083683    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083686    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083688    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083691    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083694    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083697    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083700    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083702    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083705    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083708    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083710    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 18:13:23.156806 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083714    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083717    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083719    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083722    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083725    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083728    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083730    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083733    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083735    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083738    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083740    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083742    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083745    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083748    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083750    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083753    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083756    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083759    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083761    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083764    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 18:13:23.158739 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083766    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083768    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083771    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083773    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083776    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083778    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083781    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083783    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083786    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083788    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083791    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083793    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083796    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083799    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083802    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083804    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083807    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083809    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083812    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 18:13:23.159616 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083814    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083817    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083820    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083822    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083824    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083827    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083830    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083832    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083834    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083837    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083840    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083843    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083845    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083848    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083850    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.083853    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085536    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085547    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085550    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085553    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 18:13:23.160694 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085557    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085562    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085567    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085570    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085573    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085576    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085580    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085582    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085585    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085588    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085590    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085593    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085596    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085599    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085602    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085605    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085607    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085610    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085613    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 18:13:23.161566 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085615    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085618    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085621    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085624    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085627    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085630    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085632    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085635    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085638    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085640    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085643    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085645    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085647    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085650    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085652    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085655    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085658    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085661    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085663    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085666    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 18:13:23.163063 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085668    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085671    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085674    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085677    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085679    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085682    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085684    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085687    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085689    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085694    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085697    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085700    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085703    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085706    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085709    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085712    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085714    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085725    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085729    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085731    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 18:13:23.163941 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085734    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085737    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085739    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085742    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085745    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085747    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085750    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085753    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085755    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085758    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085761    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085763    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085766    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085769    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085772    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085775    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085778    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085780    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085782    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085785    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 18:13:23.165269 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085788    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085790    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085792    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085795    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085798    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085801    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085803    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085806    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085809    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085811    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085814    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085817    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085819    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085823    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085826    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.085829    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086192    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086197    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086200    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 18:13:23.166139 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086203    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086206    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086209    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086211    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086214    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086217    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086219    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086222    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086225    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086227    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086230    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086232    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086235    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086238    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086240    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086243    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086245    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086247    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086250    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086252    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 18:13:23.167844 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086255    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086258    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086260    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086264    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086266    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086269    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086271    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086273    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086276    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086278    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086281    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086283    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086286    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086289    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086292    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086294    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086297    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086300    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086302    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086305    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 18:13:23.168700 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086307    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086310    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086312    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086314    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086317    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086319    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086322    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086324    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086327    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086330    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086332    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086334    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086337    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086340    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086343    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086345    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086348    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086350    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086353    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086355    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 18:13:23.170185 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086358    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086362    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086365    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086368    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086371    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086375    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086379    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086382    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086385    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086390    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086393    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086396    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086399    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086402    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086405    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086408    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086411    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086413    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086416    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 18:13:23.171034 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086419    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086422    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086424    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086427    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086429    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086431    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086434    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086452    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086455    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086457    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086460    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086463    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086467    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086470    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086473    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086476    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.086479    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086544    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086550    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086557    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 18:13:23.172314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086562    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086567    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086572    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086576    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086580    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086583    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086586    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086589    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086593    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086596    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086599    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086602    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086605    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086608    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086611    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086615    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086617    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086621    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086624    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086627    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086630    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086633    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086636    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 18:13:23.173164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086640    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086643    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086646    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086649    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086652    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086655    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086659    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086662    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086665    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086667    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086671    2560 flags.go:64] FLAG: --enable-server="true"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086676    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086681    2560 flags.go:64] FLAG: --event-burst="100"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086684    2560 flags.go:64] FLAG: --event-qps="50"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086687    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086690    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086693    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086697    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086700    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086703    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086706    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086709    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086711    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086715    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086717    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 18:13:23.174481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086720    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086723    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086726    2560 flags.go:64] FLAG: --feature-gates=""
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086729    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086732    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086735    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086738    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086741    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086745    2560 flags.go:64] FLAG: --help="false"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086748    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086751    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086754    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086757    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086760    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086764    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086767    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086769    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086775    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086779    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086781    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086785    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086787    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086790    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086793    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 18:13:23.175564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086796    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086799    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086802    2560 flags.go:64] FLAG: --lock-file=""
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086805    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086808    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086811    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086816    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086819    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086822    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086825    2560 flags.go:64] FLAG: --logging-format="text"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086828    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086831    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086834    2560 flags.go:64] FLAG: --manifest-url=""
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086837    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086841    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086844    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086847    2560 flags.go:64] FLAG: --max-pods="110"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086851    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086854    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086857    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086860    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086863    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086866    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086869    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086876    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 18:13:23.176658 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086880    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086884    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086887    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086890    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086895    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086898    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086901    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086904    2560 flags.go:64] FLAG: --port="10250"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086907    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086910    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0689969c4f624a9a3"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086914    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086916    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086919    2560 flags.go:64] FLAG: --register-node="true"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086922    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086926    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086928    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086931    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086934    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086937    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086941    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086944    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086946    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086949    2560 flags.go:64] FLAG: --runonce="false"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086952    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086955    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 18:13:23.177754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086967    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086970    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086973    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086976    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086979    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086982    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086985    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086988    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086994    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.086997    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087000    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087003    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087005    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087011    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087013    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087016    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087020    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087023    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087026    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087028    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087031    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087034    2560 flags.go:64] FLAG: --v="2"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087038    2560 flags.go:64] FLAG: --version="false"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087042    2560 flags.go:64] FLAG: --vmodule=""
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087045    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 18:13:23.178932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087049    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087226    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087230    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087233    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087236    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087239    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087242    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087245    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087253    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087262    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087265    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087267    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087270    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087272    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087275    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087281    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087283    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087286    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087290    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087293    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 18:13:23.180040 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087296    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087300    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087303    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087306    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087308    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087311    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087313    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087316    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087319    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087321    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087324    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087326    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087329    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087331    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087334    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087336    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087338    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087341    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087343    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087346    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 18:13:23.180924 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087348    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087356    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087359    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087362    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087364    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087366    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087369    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087374    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087377    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087379    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087382    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087384    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087387    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087389    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087392    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087395    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087397    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087400    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087403    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 18:13:23.181805 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087406    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087409    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087413    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087416    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087419    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087422    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087424    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087426    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087429    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087431    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087434    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087452    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087455    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087458    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087460    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087471    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087474    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087476    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087479    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087482    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 18:13:23.184842 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087487    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087490    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087492    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087495    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087497    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087500    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087502    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087514    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087517    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087520    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087523    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087525    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087528    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087531    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087533    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087536    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087538    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087541    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087544    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 18:13:23.185732 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087546    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.087549    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.087554    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.096246    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.096261    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.097084    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.097093    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097151    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097156    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097160    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097163    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097166    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097169    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097173    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097175    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 18:13:23.186645 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097178    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097181    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097184    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097186    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097190    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097195    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097198    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097201    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097204    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097206    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097209    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097212    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097215    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097218    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097221    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097223    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097226    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097229    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097232    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097234    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 18:13:23.187953 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097238    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097241    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097244    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097246    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097249    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097251    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097254    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097256    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097259    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097262    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097265    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097268    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097270    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097273    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097276    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097279    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097281    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097284    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097293    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097296    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 18:13:23.188827 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097299    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097301    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097304    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097307    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097309    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097312    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097316    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097320    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097324    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097327    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097330    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097333    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097336    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097339    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097342    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097344    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097347    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097349    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097352    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 18:13:23.189706 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097354    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097359    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097362    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097365    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097367    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097370    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097373    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097375    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097378    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097380    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097383    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097386    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097394    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097397    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097399    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097402    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097405    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097407    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097410    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 18:13:23.190996 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097412    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097415    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097419    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097421    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097424    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097427    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097429    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097432    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097434    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097452    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097456    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097482    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097493    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.097500    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097625    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 18:13:23.191852 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097631    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097635    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097638    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097641    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097644    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097647    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097649    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097652    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097654    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097659    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097663    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097674    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097677    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097680    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097683    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097686    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097689    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097692    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097694    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097697    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 18:13:23.192920 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097700    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097703    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097706    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097708    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097711    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097713    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097717    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097719    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097722    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097725    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097728    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097730    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097733    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097736    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097738    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097741    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097743    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097746    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097748    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097751    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 18:13:23.193777 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097753    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097756    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097759    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097762    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097770    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097773    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097776    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097779    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097781    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097784    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097786    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097790    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097794    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097797    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097799    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097802    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097805    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097808    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097811    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097814    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 18:13:23.194857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097816    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097819    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097822    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097825    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097827    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097830    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097832    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097835    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097838    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097840    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097843    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097845    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097848    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097850    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097853    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097856    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097859    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097867    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097870    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 18:13:23.195723 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097873    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097875    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097878    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097880    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097883    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097885    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097889    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097893    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097895    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097898    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097901    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097903    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097906    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097908    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097911    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097913    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097916    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097918    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 18:13:23.197257 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:23.097921    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.097926    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.098026    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.099930    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.101400    2560 server.go:1019] "Starting client certificate rotation"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.101492    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.102306    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.103879    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.105190    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.111793    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.113678    2560 log.go:25] "Validated CRI v1 image API"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.114419    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 18:13:23.198118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.118296    2560 fs.go:135] Filesystem UUIDs: map[15b47c5a-4b96-41fa-92b4-0e9b515f403c:/dev/nvme0n1p3 2571d102-b91b-4e07-8595-0364c179212d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 20 18:13:23.198980 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.118315    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 18:13:23.199188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.125782    2560 manager.go:216] Machine: {Timestamp:2026-07-20 18:13:23.123832995 +0000 UTC m=+0.360101403 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3182735 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a357656e3ce2217dd83f4dbe2b180 SystemUUID:ec2a3576-56e3-ce22-17dd-83f4dbe2b180 BootID:facbfed7-7c80-4528-aad3-f33cf15d4109 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:a3:d5:e0:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:a3:d5:e0:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:01:dc:f8:a1:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 18:13:23.199188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.126209    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 18:13:23.199188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.126331    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 18:13:23.199188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.130190    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 18:13:23.199188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.130227    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 18:13:23.199188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.131196    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 18:13:23.199188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.131209    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 18:13:23.199188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.131219    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.131246    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.132419    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.133308    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.135585    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.135732    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.135762    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.135775    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.135807    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.135820    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.135832    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.138309    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.138349    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.141567    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.143739    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.143784    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144857    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144872    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144878    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144884    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144894    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144903    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144913    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144919    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144927    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144933    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144941    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.144946    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.145583    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.145589    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.150584    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.150745    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.150814    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.185230    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4nswx"
Jul 20 18:13:23.199838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.193370    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4nswx"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.208326    2560 server.go:1268] "Started kubelet"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.208699    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.209789    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.210673    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.210709    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.213227    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217043    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.217157    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217181    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217765    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217767    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217797    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217840    2560 factory.go:55] Registering systemd factory
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217853    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217934    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.217946    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.218058    2560 factory.go:153] Registering CRI-O factory
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.218067    2560 factory.go:223] Registration of the crio container factory successfully
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.218154    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.218191    2560 factory.go:103] Registering Raw factory
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.218233    2560 manager.go:1196] Started watching for new ooms in manager
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.218727    2560 manager.go:349] Starting recovery of all containers
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.218614    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-45.ec2.internal.18c4120de39f4045  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-45.ec2.internal,UID:ip-10-0-138-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-45.ec2.internal,},FirstTimestamp:2026-07-20 18:13:23.208298565 +0000 UTC m=+0.444567034,LastTimestamp:2026-07-20 18:13:23.208298565 +0000 UTC m=+0.444567034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-45.ec2.internal,}"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.235845    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.238037    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-45.ec2.internal\" not found" node="ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.243228    2560 manager.go:354] Recovery completed
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.254274    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.256063    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.256089    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.256101    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.256614    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.256623    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.256629    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.256643    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.257258    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.257285    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 18:13:23.299153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.257295    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 18:13:23.208971 ip-10-0-138-45 systemd[1]: Started Kubernetes Kubelet.
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.257859    2560 policy_none.go:49] "None policy: Start"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.257874    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.257885    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.258896    2560 policy_none.go:47] "Start"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.293209    2560 manager.go:337] "Starting Device Plugin manager"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.293244    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.293260    2560 server.go:87] "Starting device plugin registration server"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.293548    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.293563    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.293784    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.293857    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.293865    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.294373    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 18:13:23.301412 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.294434    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:23.434726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.393653    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 18:13:23.434726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.405205    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 18:13:23.434726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.405236    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 18:13:23.434726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.405248    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 18:13:23.434726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.405277    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.434726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.415487    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.434726 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.415508    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-45.ec2.internal\": node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:23.452577 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.449322    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:23.563020 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.480431    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 18:13:23.563020 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.481814    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 18:13:23.563020 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.481863    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 18:13:23.563020 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.481895    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 18:13:23.563020 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.481936    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 18:13:23.563020 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.484278    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 18:13:23.563020 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.551935    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.584515    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"]
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.584590    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.585742    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.585775    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.585791    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.587280    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.587418    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.587492    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.588064    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.588095    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.588104    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.588111    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.588123    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.588136    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.589531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.589561    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.590222    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.590247    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.590261    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.619497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d60d12c01b2cf8d5bb8e5f62f694d733-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"d60d12c01b2cf8d5bb8e5f62f694d733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.619519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60d12c01b2cf8d5bb8e5f62f694d733-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"d60d12c01b2cf8d5bb8e5f62f694d733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.619538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2c28caece7ac4aa08342defb3f5e63b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-45.ec2.internal\" (UID: \"e2c28caece7ac4aa08342defb3f5e63b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.632267    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-45.ec2.internal\" not found" node="ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.637011    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-45.ec2.internal\" not found" node="ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.708056 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.652713    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:23.853220 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.720246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d60d12c01b2cf8d5bb8e5f62f694d733-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"d60d12c01b2cf8d5bb8e5f62f694d733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.853220 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.720277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60d12c01b2cf8d5bb8e5f62f694d733-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"d60d12c01b2cf8d5bb8e5f62f694d733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.853220 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.720296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2c28caece7ac4aa08342defb3f5e63b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-45.ec2.internal\" (UID: \"e2c28caece7ac4aa08342defb3f5e63b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.853220 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.720362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d60d12c01b2cf8d5bb8e5f62f694d733-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"d60d12c01b2cf8d5bb8e5f62f694d733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.853220 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.720381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60d12c01b2cf8d5bb8e5f62f694d733-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal\" (UID: \"d60d12c01b2cf8d5bb8e5f62f694d733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.853220 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.720362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2c28caece7ac4aa08342defb3f5e63b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-45.ec2.internal\" (UID: \"e2c28caece7ac4aa08342defb3f5e63b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.853220 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.754953    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:23.857187 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.856887    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:23.935144 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.935108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.940328 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:23.940309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:23.957620 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:23.957597    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:24.059365 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:24.059268    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:24.101245 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.101213    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 18:13:24.101390 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.101373    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 18:13:24.101438 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.101413    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 18:13:24.160023 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:24.159994    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:24.197804 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.197758    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 18:08:23 +0000 UTC" deadline="2028-02-18 13:08:30.446112764 +0000 UTC"
Jul 20 18:13:24.197804 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.197796    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13866h55m6.248320335s"
Jul 20 18:13:24.260351 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:24.260314    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:24.361225 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:24.361138    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:24.461567 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:24.461529    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-45.ec2.internal\" not found"
Jul 20 18:13:24.496741 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.496714    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 18:13:24.518173 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.518145    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:24.531052 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.531019    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 18:13:24.533186 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.533172    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal"
Jul 20 18:13:24.541728 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.541710    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 18:13:24.561994 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.561970    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 18:13:24.849017 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:24.848977    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c28caece7ac4aa08342defb3f5e63b.slice/crio-fdb1a6675d8780b163a3c7e12f1e88253f803cc49c592de3aa196eefa720b1ed WatchSource:0}: Error finding container fdb1a6675d8780b163a3c7e12f1e88253f803cc49c592de3aa196eefa720b1ed: Status 404 returned error can't find the container with id fdb1a6675d8780b163a3c7e12f1e88253f803cc49c592de3aa196eefa720b1ed
Jul 20 18:13:24.855162 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.855141    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:13:24.862102 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:24.862080    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60d12c01b2cf8d5bb8e5f62f694d733.slice/crio-4052f772cf86899645bd672010e1d38fb7df8a1489bd350b331b12bfd6d2cd1f WatchSource:0}: Error finding container 4052f772cf86899645bd672010e1d38fb7df8a1489bd350b331b12bfd6d2cd1f: Status 404 returned error can't find the container with id 4052f772cf86899645bd672010e1d38fb7df8a1489bd350b331b12bfd6d2cd1f
Jul 20 18:13:24.939641 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:24.939616    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 18:13:25.138719 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.138686    2560 apiserver.go:52] "Watching apiserver"
Jul 20 18:13:25.145068 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.145041    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 18:13:25.145451 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.145428    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-q8hts","openshift-multus/multus-additional-cni-plugins-n522l","openshift-multus/multus-ghzr4","openshift-network-operator/iptables-alerter-qbz4p","kube-system/konnectivity-agent-qx2d7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn","openshift-cluster-node-tuning-operator/tuned-rwnrv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal","openshift-multus/network-metrics-daemon-f5q8s","openshift-network-diagnostics/network-check-target-mpt7b","openshift-ovn-kubernetes/ovnkube-node-4w7hx","kube-system/global-pull-secret-syncer-5hxn6","kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal","openshift-dns/node-resolver-244j2"]
Jul 20 18:13:25.148717 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.148698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.150936 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.150917    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 18:13:25.151052 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.151033    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 18:13:25.151307 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.151292    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-775jc\""
Jul 20 18:13:25.151672 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.151657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.153760 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.153743    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 18:13:25.153941 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.153895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.154342 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.154123    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 18:13:25.154342 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.154166    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 18:13:25.154342 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.154196    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 18:13:25.154631 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.154614    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 18:13:25.154687 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.154635    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 18:13:25.154735 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.154710    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cg6j5\""
Jul 20 18:13:25.156346 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.156323    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.156453 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.156412    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 18:13:25.156590 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.156486    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 18:13:25.156724 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.156707    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 18:13:25.156793 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.156781    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 18:13:25.157062 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.157041    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w285p\""
Jul 20 18:13:25.158534 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.158491    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 18:13:25.158623 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.158515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 18:13:25.158684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.158641    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-597tm\""
Jul 20 18:13:25.158739 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.158695    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 18:13:25.159458 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.159096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:25.161832 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.161403    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 18:13:25.161832 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.161540    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 18:13:25.162445 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.161940    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.162445 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.162023    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k9zql\""
Jul 20 18:13:25.162664 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.162639    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 18:13:25.164096 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.164077    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 18:13:25.164508 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.164488    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 18:13:25.164614 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.164563    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 18:13:25.164709 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.164693    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jkf4p\""
Jul 20 18:13:25.165079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.165064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:25.165171 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.165147    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:25.167565 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.167548    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.169632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.169610    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 18:13:25.169632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.169629    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5scjm\""
Jul 20 18:13:25.169790 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.169687    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 18:13:25.169982 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.169965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.172188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.172174    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 18:13:25.172593 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.172577    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:25.172693 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.172629    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mhhpr\""
Jul 20 18:13:25.172693 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.172641    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 18:13:25.172693 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.172652    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:25.175031 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.175013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.177125 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.177104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6kvwq\""
Jul 20 18:13:25.177220 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.177144    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 18:13:25.177388 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.177377    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 18:13:25.177641 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.177621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.177728 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.177684    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:25.177811 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.177753    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 18:13:25.218717 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.218691    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 18:13:25.219088 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.219071    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 18:13:25.228024 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.228001    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 18:13:25.229377 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkbwz\" (UniqueName: \"kubernetes.io/projected/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-kube-api-access-qkbwz\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:25.229462 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmfdg\" (UniqueName: \"kubernetes.io/projected/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-kube-api-access-tmfdg\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.229462 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-cni-binary-copy\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.229591 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-k8s-cni-cncf-io\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.229591 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-iptables-alerter-script\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.229591 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2e22dc2-1a0a-410f-a007-c904b419e154-konnectivity-ca\") pod \"konnectivity-agent-qx2d7\" (UID: \"d2e22dc2-1a0a-410f-a007-c904b419e154\") " pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:25.229591 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysconfig\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.229794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-run\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.229794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:25.229794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-cni-netd\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.229794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.229794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-host\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.229794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-tuned\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.229794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d68d36a-6400-465b-939c-6a634d194eea-tmp-dir\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.229794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5a88467-7161-4264-9cf6-4dd9953c73eb-host\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-systemd\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94b72186-398e-4d73-99b4-1eb9cd0ec618-kubelet-config\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovnkube-script-lib\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-netns\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.229952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-etc-kubernetes\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-tmp\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94b72186-398e-4d73-99b4-1eb9cd0ec618-dbus\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-hostroot\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.230136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230162    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d68d36a-6400-465b-939c-6a634d194eea-hosts-file\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-systemd-units\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-modprobe-d\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysctl-d\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-sys-fs\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-slash\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69xh\" (UniqueName: \"kubernetes.io/projected/4b9a1d81-f0cc-4557-b479-e6fb01437078-kube-api-access-c69xh\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cnibin\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-ovn\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-cnibin\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-cni-multus\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230511    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-conf-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.230662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-run-netns\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovn-node-metrics-cert\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-system-cni-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-os-release\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdrrv\" (UniqueName: \"kubernetes.io/projected/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-kube-api-access-hdrrv\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-sys\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpns7\" (UniqueName: \"kubernetes.io/projected/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-kube-api-access-zpns7\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-socket-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-env-overrides\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-kubelet\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-var-lib-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysctl-conf\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-systemd\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-etc-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-cni-bin\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkxss\" (UniqueName: \"kubernetes.io/projected/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-kube-api-access-gkxss\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-var-lib-kubelet\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qkfj\" (UniqueName: \"kubernetes.io/projected/c5a88467-7161-4264-9cf6-4dd9953c73eb-kube-api-access-4qkfj\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm64v\" (UniqueName: \"kubernetes.io/projected/9d68d36a-6400-465b-939c-6a634d194eea-kube-api-access-qm64v\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovnkube-config\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.230970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-multus-certs\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-host-slash\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2e22dc2-1a0a-410f-a007-c904b419e154-agent-certs\") pod \"konnectivity-agent-qx2d7\" (UID: \"d2e22dc2-1a0a-410f-a007-c904b419e154\") " pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-node-log\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-os-release\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.231900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-socket-dir-parent\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.232619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdfx8\" (UniqueName: \"kubernetes.io/projected/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-kube-api-access-pdfx8\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.232619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-kubernetes\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.232619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-lib-modules\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.232619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.231658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-registration-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.232619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-device-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.232619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.232619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-log-socket\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.232944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:25.232944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5a88467-7161-4264-9cf6-4dd9953c73eb-serviceca\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.232944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-cni-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.232944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-cni-bin\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.232944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-kubelet\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.232944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-daemon-config\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.232944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.232822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.252527 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.252500    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bh724"
Jul 20 18:13:25.261159 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.261136    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bh724"
Jul 20 18:13:25.333209 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-os-release\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.333209 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdrrv\" (UniqueName: \"kubernetes.io/projected/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-kube-api-access-hdrrv\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-sys\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpns7\" (UniqueName: \"kubernetes.io/projected/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-kube-api-access-zpns7\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-socket-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-os-release\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-env-overrides\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-sys\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-kubelet\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-var-lib-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysctl-conf\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-systemd\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-kubelet\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-etc-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.333501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-socket-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-cni-bin\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-systemd\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkxss\" (UniqueName: \"kubernetes.io/projected/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-kube-api-access-gkxss\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333558    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-var-lib-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-var-lib-kubelet\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333607    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-cni-bin\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-etc-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysctl-conf\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-var-lib-kubelet\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qkfj\" (UniqueName: \"kubernetes.io/projected/c5a88467-7161-4264-9cf6-4dd9953c73eb-kube-api-access-4qkfj\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.334156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm64v\" (UniqueName: \"kubernetes.io/projected/9d68d36a-6400-465b-939c-6a634d194eea-kube-api-access-qm64v\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-etc-selinux\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-env-overrides\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovnkube-config\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-multus-certs\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-host-slash\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-multus-certs\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2e22dc2-1a0a-410f-a007-c904b419e154-agent-certs\") pod \"konnectivity-agent-qx2d7\" (UID: \"d2e22dc2-1a0a-410f-a007-c904b419e154\") " pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-node-log\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-host-slash\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.333965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-os-release\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-socket-dir-parent\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-os-release\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-node-log\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdfx8\" (UniqueName: \"kubernetes.io/projected/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-kube-api-access-pdfx8\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.334886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-kubernetes\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-socket-dir-parent\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-lib-modules\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-registration-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334185    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334198    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-kubernetes\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-device-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334264    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-log-socket\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-lib-modules\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-device-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-registration-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-openvswitch\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.335674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-log-socket\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334351    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovnkube-config\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5a88467-7161-4264-9cf6-4dd9953c73eb-serviceca\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-cni-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-cni-bin\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-kubelet\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-daemon-config\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-cni-bin\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkbwz\" (UniqueName: \"kubernetes.io/projected/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-kube-api-access-qkbwz\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-cni-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334681    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmfdg\" (UniqueName: \"kubernetes.io/projected/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-kube-api-access-tmfdg\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-kubelet\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-cni-binary-copy\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.336461 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-k8s-cni-cncf-io\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-iptables-alerter-script\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-k8s-cni-cncf-io\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2e22dc2-1a0a-410f-a007-c904b419e154-konnectivity-ca\") pod \"konnectivity-agent-qx2d7\" (UID: \"d2e22dc2-1a0a-410f-a007-c904b419e154\") " pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.334979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5a88467-7161-4264-9cf6-4dd9953c73eb-serviceca\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysconfig\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-run\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-cni-netd\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysconfig\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-host\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-tuned\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-daemon-config\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.337074 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d68d36a-6400-465b-939c-6a634d194eea-tmp-dir\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-cni-netd\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5a88467-7161-4264-9cf6-4dd9953c73eb-host\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-systemd\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-host\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94b72186-398e-4d73-99b4-1eb9cd0ec618-kubelet-config\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-run\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-cni-binary-copy\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.335318    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5a88467-7161-4264-9cf6-4dd9953c73eb-host\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-systemd\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.337676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-iptables-alerter-script\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.335402    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:25.835378543 +0000 UTC m=+3.071646938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovnkube-script-lib\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-netns\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94b72186-398e-4d73-99b4-1eb9cd0ec618-kubelet-config\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-etc-kubernetes\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-run-netns\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2e22dc2-1a0a-410f-a007-c904b419e154-konnectivity-ca\") pod \"konnectivity-agent-qx2d7\" (UID: \"d2e22dc2-1a0a-410f-a007-c904b419e154\") " pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-etc-kubernetes\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-tmp\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94b72186-398e-4d73-99b4-1eb9cd0ec618-dbus\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-hostroot\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d68d36a-6400-465b-939c-6a634d194eea-tmp-dir\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.338152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94b72186-398e-4d73-99b4-1eb9cd0ec618-dbus\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovnkube-script-lib\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.335971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-hostroot\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d68d36a-6400-465b-939c-6a634d194eea-hosts-file\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-systemd-units\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-modprobe-d\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d68d36a-6400-465b-939c-6a634d194eea-hosts-file\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysctl-d\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-systemd-units\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.338652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-sys-fs\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-slash\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69xh\" (UniqueName: \"kubernetes.io/projected/4b9a1d81-f0cc-4557-b479-e6fb01437078-kube-api-access-c69xh\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b9a1d81-f0cc-4557-b479-e6fb01437078-sys-fs\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cnibin\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.336282    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-slash\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336394    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-sysctl-d\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336413    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-ovn\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-modprobe-d\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-cnibin\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.336454    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret podName:94b72186-398e-4d73-99b4-1eb9cd0ec618 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:25.836436666 +0000 UTC m=+3.072705065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret") pod "global-pull-secret-syncer-5hxn6" (UID: "94b72186-398e-4d73-99b4-1eb9cd0ec618") : object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-run-ovn\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.339079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-cni-multus\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-conf-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-cnibin\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-run-netns\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336582    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-multus-conf-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-host-var-lib-cni-multus\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovn-node-metrics-cert\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-system-cni-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-host-run-netns\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-cnibin\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.336813    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-system-cni-dir\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.338338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-tmp\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.338440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-etc-tuned\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.338490    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2e22dc2-1a0a-410f-a007-c904b419e154-agent-certs\") pod \"konnectivity-agent-qx2d7\" (UID: \"d2e22dc2-1a0a-410f-a007-c904b419e154\") " pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:25.339495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.338991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-ovn-node-metrics-cert\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.342956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.342928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdrrv\" (UniqueName: \"kubernetes.io/projected/5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5-kube-api-access-hdrrv\") pod \"multus-additional-cni-plugins-n522l\" (UID: \"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5\") " pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.343168 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.343149    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 18:13:25.343217 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.343176    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 18:13:25.343217 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.343192    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md8fl for pod openshift-network-diagnostics/network-check-target-mpt7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:25.343295 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.343256    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl podName:059e8efc-16a1-4054-a954-e870227ca6a0 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:25.843237268 +0000 UTC m=+3.079505716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-md8fl" (UniqueName: "kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl") pod "network-check-target-mpt7b" (UID: "059e8efc-16a1-4054-a954-e870227ca6a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:25.343866 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.343837    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdfx8\" (UniqueName: \"kubernetes.io/projected/07ee5f71-fd9e-4f79-b55d-308c8f91e4ca-kube-api-access-pdfx8\") pod \"iptables-alerter-qbz4p\" (UID: \"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca\") " pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.344217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.344187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qkfj\" (UniqueName: \"kubernetes.io/projected/c5a88467-7161-4264-9cf6-4dd9953c73eb-kube-api-access-4qkfj\") pod \"node-ca-q8hts\" (UID: \"c5a88467-7161-4264-9cf6-4dd9953c73eb\") " pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.344587 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.344557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkxss\" (UniqueName: \"kubernetes.io/projected/8c7932b2-8e1c-4ff4-a64e-c78b003647f6-kube-api-access-gkxss\") pod \"multus-ghzr4\" (UID: \"8c7932b2-8e1c-4ff4-a64e-c78b003647f6\") " pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.345635 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.345606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkbwz\" (UniqueName: \"kubernetes.io/projected/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-kube-api-access-qkbwz\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:25.345877 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.345855    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmfdg\" (UniqueName: \"kubernetes.io/projected/3ddbe2ad-bd37-49a9-8155-0b17dbc295ff-kube-api-access-tmfdg\") pod \"ovnkube-node-4w7hx\" (UID: \"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.346226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.346209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm64v\" (UniqueName: \"kubernetes.io/projected/9d68d36a-6400-465b-939c-6a634d194eea-kube-api-access-qm64v\") pod \"node-resolver-244j2\" (UID: \"9d68d36a-6400-465b-939c-6a634d194eea\") " pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.347023 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.347004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpns7\" (UniqueName: \"kubernetes.io/projected/c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d-kube-api-access-zpns7\") pod \"tuned-rwnrv\" (UID: \"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d\") " pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.347174 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.347155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69xh\" (UniqueName: \"kubernetes.io/projected/4b9a1d81-f0cc-4557-b479-e6fb01437078-kube-api-access-c69xh\") pod \"aws-ebs-csi-driver-node-jjmgn\" (UID: \"4b9a1d81-f0cc-4557-b479-e6fb01437078\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.459842 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.459735    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rwnrv"
Jul 20 18:13:25.468996 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.468976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:25.470414 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.470388    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e97b3b_28e0_48d5_b9f1_28dbe4f7ff5d.slice/crio-1003772106ce30d966719cdb95572075f1a174010317a7b361c1f46382eaf0f1 WatchSource:0}: Error finding container 1003772106ce30d966719cdb95572075f1a174010317a7b361c1f46382eaf0f1: Status 404 returned error can't find the container with id 1003772106ce30d966719cdb95572075f1a174010317a7b361c1f46382eaf0f1
Jul 20 18:13:25.475100 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.475084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ghzr4"
Jul 20 18:13:25.478358 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.478259    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddbe2ad_bd37_49a9_8155_0b17dbc295ff.slice/crio-d1e849233bb3bc3d097231b19ee1d43fe93a42f1098d334fd4f49a6b066be907 WatchSource:0}: Error finding container d1e849233bb3bc3d097231b19ee1d43fe93a42f1098d334fd4f49a6b066be907: Status 404 returned error can't find the container with id d1e849233bb3bc3d097231b19ee1d43fe93a42f1098d334fd4f49a6b066be907
Jul 20 18:13:25.481054 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.481036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qbz4p"
Jul 20 18:13:25.484887 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.484862    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7932b2_8e1c_4ff4_a64e_c78b003647f6.slice/crio-c65dd0255cd8e910220b1cb99a8f969904db62834546eec5a5d232772af8f8bb WatchSource:0}: Error finding container c65dd0255cd8e910220b1cb99a8f969904db62834546eec5a5d232772af8f8bb: Status 404 returned error can't find the container with id c65dd0255cd8e910220b1cb99a8f969904db62834546eec5a5d232772af8f8bb
Jul 20 18:13:25.485964 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.485947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:25.487869 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.487833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal" event={"ID":"d60d12c01b2cf8d5bb8e5f62f694d733","Type":"ContainerStarted","Data":"4052f772cf86899645bd672010e1d38fb7df8a1489bd350b331b12bfd6d2cd1f"}
Jul 20 18:13:25.489314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.489286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal" event={"ID":"e2c28caece7ac4aa08342defb3f5e63b","Type":"ContainerStarted","Data":"fdb1a6675d8780b163a3c7e12f1e88253f803cc49c592de3aa196eefa720b1ed"}
Jul 20 18:13:25.490457 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.490434    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"d1e849233bb3bc3d097231b19ee1d43fe93a42f1098d334fd4f49a6b066be907"}
Jul 20 18:13:25.491008 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.490988    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ee5f71_fd9e_4f79_b55d_308c8f91e4ca.slice/crio-1d1fced2ac29805659c709cc84c8cada0a861be9098314e0c5b7f090d4dcb348 WatchSource:0}: Error finding container 1d1fced2ac29805659c709cc84c8cada0a861be9098314e0c5b7f090d4dcb348: Status 404 returned error can't find the container with id 1d1fced2ac29805659c709cc84c8cada0a861be9098314e0c5b7f090d4dcb348
Jul 20 18:13:25.491605 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.491584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rwnrv" event={"ID":"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d","Type":"ContainerStarted","Data":"1003772106ce30d966719cdb95572075f1a174010317a7b361c1f46382eaf0f1"}
Jul 20 18:13:25.491685 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.491639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn"
Jul 20 18:13:25.496417 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.496395    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e22dc2_1a0a_410f_a007_c904b419e154.slice/crio-062823be41b2b9f623680eca9240efe9bfc15648eeeda2e8d93d55a7e71c0106 WatchSource:0}: Error finding container 062823be41b2b9f623680eca9240efe9bfc15648eeeda2e8d93d55a7e71c0106: Status 404 returned error can't find the container with id 062823be41b2b9f623680eca9240efe9bfc15648eeeda2e8d93d55a7e71c0106
Jul 20 18:13:25.497521 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.497491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-244j2"
Jul 20 18:13:25.502837 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.502170    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9a1d81_f0cc_4557_b479_e6fb01437078.slice/crio-225fa83017dba8aa6ed5b9fa424bc0ec6f32e0a6008d76b629778ad55ecc8bfe WatchSource:0}: Error finding container 225fa83017dba8aa6ed5b9fa424bc0ec6f32e0a6008d76b629778ad55ecc8bfe: Status 404 returned error can't find the container with id 225fa83017dba8aa6ed5b9fa424bc0ec6f32e0a6008d76b629778ad55ecc8bfe
Jul 20 18:13:25.503360 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.503339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n522l"
Jul 20 18:13:25.507943 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.507923    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8hts"
Jul 20 18:13:25.508232 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.508214    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d68d36a_6400_465b_939c_6a634d194eea.slice/crio-1dd9edac8ec8a01d985d9855c3c51ce0023b6e888d0abf2e8f56b96585a725ad WatchSource:0}: Error finding container 1dd9edac8ec8a01d985d9855c3c51ce0023b6e888d0abf2e8f56b96585a725ad: Status 404 returned error can't find the container with id 1dd9edac8ec8a01d985d9855c3c51ce0023b6e888d0abf2e8f56b96585a725ad
Jul 20 18:13:25.514271 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.514247    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3abdcb_8a3e_445c_a0fe_6c361eeb6bd5.slice/crio-0f511a482cbd07a9da27a6f94e91aacec883c1d8aac18ab2238b7ae744908e61 WatchSource:0}: Error finding container 0f511a482cbd07a9da27a6f94e91aacec883c1d8aac18ab2238b7ae744908e61: Status 404 returned error can't find the container with id 0f511a482cbd07a9da27a6f94e91aacec883c1d8aac18ab2238b7ae744908e61
Jul 20 18:13:25.518249 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:13:25.518225    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a88467_7161_4264_9cf6_4dd9953c73eb.slice/crio-5216ef18b14998e0ce090cdc14c70dbde547f75f110eb976584a597f7127296b WatchSource:0}: Error finding container 5216ef18b14998e0ce090cdc14c70dbde547f75f110eb976584a597f7127296b: Status 404 returned error can't find the container with id 5216ef18b14998e0ce090cdc14c70dbde547f75f110eb976584a597f7127296b
Jul 20 18:13:25.841154 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.841063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:25.841154 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.841113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:25.841374 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.841247    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:25.841374 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.841249    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:25.841374 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.841319    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret podName:94b72186-398e-4d73-99b4-1eb9cd0ec618 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:26.841298967 +0000 UTC m=+4.077567361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret") pod "global-pull-secret-syncer-5hxn6" (UID: "94b72186-398e-4d73-99b4-1eb9cd0ec618") : object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:25.841374 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.841341    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:26.841328942 +0000 UTC m=+4.077597342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:25.941838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:25.941800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:25.942038 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.942014    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 18:13:25.942107 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.942051    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 18:13:25.942107 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.942067    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md8fl for pod openshift-network-diagnostics/network-check-target-mpt7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:25.942175 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:25.942135    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl podName:059e8efc-16a1-4054-a954-e870227ca6a0 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:26.942111002 +0000 UTC m=+4.178379413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-md8fl" (UniqueName: "kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl") pod "network-check-target-mpt7b" (UID: "059e8efc-16a1-4054-a954-e870227ca6a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:26.264550 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.264497    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:08:25 +0000 UTC" deadline="2028-05-05 04:10:05.298522454 +0000 UTC"
Jul 20 18:13:26.264550 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.264547    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15705h56m39.033980761s"
Jul 20 18:13:26.482433 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.482395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:26.482705 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.482558    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:26.483017 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.482996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:26.483126 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.483105    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:26.506674 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.506637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8hts" event={"ID":"c5a88467-7161-4264-9cf6-4dd9953c73eb","Type":"ContainerStarted","Data":"5216ef18b14998e0ce090cdc14c70dbde547f75f110eb976584a597f7127296b"}
Jul 20 18:13:26.528495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.528417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n522l" event={"ID":"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5","Type":"ContainerStarted","Data":"0f511a482cbd07a9da27a6f94e91aacec883c1d8aac18ab2238b7ae744908e61"}
Jul 20 18:13:26.537226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.537187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn" event={"ID":"4b9a1d81-f0cc-4557-b479-e6fb01437078","Type":"ContainerStarted","Data":"225fa83017dba8aa6ed5b9fa424bc0ec6f32e0a6008d76b629778ad55ecc8bfe"}
Jul 20 18:13:26.540312 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.540242    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qx2d7" event={"ID":"d2e22dc2-1a0a-410f-a007-c904b419e154","Type":"ContainerStarted","Data":"062823be41b2b9f623680eca9240efe9bfc15648eeeda2e8d93d55a7e71c0106"}
Jul 20 18:13:26.544797 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.544767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qbz4p" event={"ID":"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca","Type":"ContainerStarted","Data":"1d1fced2ac29805659c709cc84c8cada0a861be9098314e0c5b7f090d4dcb348"}
Jul 20 18:13:26.547129 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.547065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-244j2" event={"ID":"9d68d36a-6400-465b-939c-6a634d194eea","Type":"ContainerStarted","Data":"1dd9edac8ec8a01d985d9855c3c51ce0023b6e888d0abf2e8f56b96585a725ad"}
Jul 20 18:13:26.548588 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.548564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ghzr4" event={"ID":"8c7932b2-8e1c-4ff4-a64e-c78b003647f6","Type":"ContainerStarted","Data":"c65dd0255cd8e910220b1cb99a8f969904db62834546eec5a5d232772af8f8bb"}
Jul 20 18:13:26.848789 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.848702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:26.848789 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.848766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:26.849002 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.848895    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:26.849002 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.848957    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret podName:94b72186-398e-4d73-99b4-1eb9cd0ec618 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:28.848937929 +0000 UTC m=+6.085206327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret") pod "global-pull-secret-syncer-5hxn6" (UID: "94b72186-398e-4d73-99b4-1eb9cd0ec618") : object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:26.849361 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.849342    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:26.849453 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.849399    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:28.849382134 +0000 UTC m=+6.085650535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:26.949804 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:26.949766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:26.949978 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.949935    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 18:13:26.949978 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.949958    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 18:13:26.949978 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.949972    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md8fl for pod openshift-network-diagnostics/network-check-target-mpt7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:26.950215 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:26.950047    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl podName:059e8efc-16a1-4054-a954-e870227ca6a0 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:28.950025517 +0000 UTC m=+6.186293917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-md8fl" (UniqueName: "kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl") pod "network-check-target-mpt7b" (UID: "059e8efc-16a1-4054-a954-e870227ca6a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:27.265897 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:27.265823    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:08:25 +0000 UTC" deadline="2028-04-13 04:16:20.208737628 +0000 UTC"
Jul 20 18:13:27.265897 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:27.265871    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15178h2m52.942871662s"
Jul 20 18:13:27.483700 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:27.483668    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:27.483922 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:27.483813    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:28.482932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:28.482899    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:28.483441 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:28.482907    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:28.483441 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.483060    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:28.483441 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.483233    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:28.868021 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:28.867278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:28.868021 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:28.867340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:28.868021 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.867502    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:28.868021 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.867572    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret podName:94b72186-398e-4d73-99b4-1eb9cd0ec618 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:32.867550486 +0000 UTC m=+10.103818880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret") pod "global-pull-secret-syncer-5hxn6" (UID: "94b72186-398e-4d73-99b4-1eb9cd0ec618") : object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:28.868021 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.867928    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:28.868021 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.868004    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:32.867984061 +0000 UTC m=+10.104252475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:28.968060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:28.968014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:28.968242 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.968230    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 18:13:28.968310 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.968252    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 18:13:28.968310 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.968266    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md8fl for pod openshift-network-diagnostics/network-check-target-mpt7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:28.968416 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:28.968329    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl podName:059e8efc-16a1-4054-a954-e870227ca6a0 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:32.968309537 +0000 UTC m=+10.204577936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-md8fl" (UniqueName: "kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl") pod "network-check-target-mpt7b" (UID: "059e8efc-16a1-4054-a954-e870227ca6a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:29.485603 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:29.485568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:29.486206 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:29.485730    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:30.482555 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:30.482518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:30.482730 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:30.482665    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:30.482794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:30.482716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:30.482872 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:30.482817    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:31.483087 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:31.483049    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:31.483597 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:31.483212    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:32.482914 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:32.482858    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:32.483112 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:32.482996    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:32.483112 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:32.483057    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:32.483553 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:32.483187    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:32.901202 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:32.901168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:32.901392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:32.901258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:32.901392 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:32.901339    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:32.901392 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:32.901364    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:32.901741 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:32.901415    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret podName:94b72186-398e-4d73-99b4-1eb9cd0ec618 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:40.901393801 +0000 UTC m=+18.137662211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret") pod "global-pull-secret-syncer-5hxn6" (UID: "94b72186-398e-4d73-99b4-1eb9cd0ec618") : object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:32.901741 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:32.901438    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:40.901425641 +0000 UTC m=+18.137694042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:33.001989 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:33.001956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:33.002188 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:33.002159    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 18:13:33.002188 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:33.002192    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 18:13:33.002376 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:33.002208    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md8fl for pod openshift-network-diagnostics/network-check-target-mpt7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:33.002376 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:33.002273    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl podName:059e8efc-16a1-4054-a954-e870227ca6a0 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:41.002252079 +0000 UTC m=+18.238520481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-md8fl" (UniqueName: "kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl") pod "network-check-target-mpt7b" (UID: "059e8efc-16a1-4054-a954-e870227ca6a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:33.484871 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:33.484565    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:33.485318 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:33.484900    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:34.482754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:34.482691    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:34.482936 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:34.482890    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:34.483008 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:34.482943    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:34.483086 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:34.483064    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:35.482836 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:35.482801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:35.483339 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:35.482949    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:36.482116 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:36.482074    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:36.482290 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:36.482214    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:36.482290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:36.482233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:36.482424 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:36.482304    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:37.482690 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:37.482516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:37.482690 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:37.482690    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:38.482934 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:38.482891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:38.483398 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:38.483015    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:38.483398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:38.483072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:38.483398 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:38.483180    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:39.482750 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:39.482719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:39.482927 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:39.482858    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:40.482816 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:40.482782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:40.483289 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:40.482782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:40.483289 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:40.482900    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:40.483289 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:40.482967    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:40.967103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:40.967072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:40.967231 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:40.967125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:40.967231 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:40.967208    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:40.967355 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:40.967237    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:40.967355 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:40.967293    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:56.967271336 +0000 UTC m=+34.203539751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:40.967355 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:40.967341    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret podName:94b72186-398e-4d73-99b4-1eb9cd0ec618 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:56.967324362 +0000 UTC m=+34.203592760 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret") pod "global-pull-secret-syncer-5hxn6" (UID: "94b72186-398e-4d73-99b4-1eb9cd0ec618") : object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:41.067973 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:41.067925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:41.068145 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:41.068112    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 18:13:41.068145 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:41.068140    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 18:13:41.068229 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:41.068156    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md8fl for pod openshift-network-diagnostics/network-check-target-mpt7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:41.068229 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:41.068219    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl podName:059e8efc-16a1-4054-a954-e870227ca6a0 nodeName:}" failed. No retries permitted until 2026-07-20 18:13:57.06820082 +0000 UTC m=+34.304469217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-md8fl" (UniqueName: "kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl") pod "network-check-target-mpt7b" (UID: "059e8efc-16a1-4054-a954-e870227ca6a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:41.482563 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:41.482504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:41.482764 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:41.482658    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:42.482367 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:42.482333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:42.482819 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:42.482334    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:42.482819 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:42.482477    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:42.482819 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:42.482564    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:43.483707 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:43.483667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:43.484176 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:43.483797    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:44.483003 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:44.482967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:44.483188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:44.482970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:44.483188 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:44.483085    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:44.483292 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:44.483192    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:45.482505 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:45.482221    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:45.482839 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:45.482548    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:46.483103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.482919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:46.483663 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.482919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:46.483663 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:46.483151    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:46.483663 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:46.483215    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:46.602591 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.602564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"68841995d324c37fee567b92e74ce0aa4eeb56f9939ca5e9f2cc9ff16769b3b9"}
Jul 20 18:13:46.602738 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.602631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"c03397bc5a399267bd17c3b41543f34275e00e6836699e0e9dc6d9f962073a5d"}
Jul 20 18:13:46.602738 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.602665    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"d8a98a3631c70435cf11e9c74a5c9e0eb18177dfb81233606f1cc00113e55f33"}
Jul 20 18:13:46.602738 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.602706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"9a2931114de8b9dfdc096f2d83b930b1e6638a45b3043d716a52a2abb8dd2b48"}
Jul 20 18:13:46.602738 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.602736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"47bfb86f5a365f1a18eaef83d5cd58f9e572af991f7332107a1b7d7f2d518962"}
Jul 20 18:13:46.602890 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.602765    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"13018f3cae6ff9d1ac3958bd8c4feb210d6496de7abe1f33293270dc0f10da47"}
Jul 20 18:13:46.604017 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.603990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8hts" event={"ID":"c5a88467-7161-4264-9cf6-4dd9953c73eb","Type":"ContainerStarted","Data":"d42d8b7932b4da39f6d6d36d52c255a60e0a6fce5789b7c2743b64a4ae9e26be"}
Jul 20 18:13:46.605573 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.605541    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5" containerID="c41cf27141822f79be44dd8dbf503310e1cd5e24f681c9386cba5280957b0f6e" exitCode=0
Jul 20 18:13:46.605670 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.605627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n522l" event={"ID":"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5","Type":"ContainerDied","Data":"c41cf27141822f79be44dd8dbf503310e1cd5e24f681c9386cba5280957b0f6e"}
Jul 20 18:13:46.607179 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.607154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn" event={"ID":"4b9a1d81-f0cc-4557-b479-e6fb01437078","Type":"ContainerStarted","Data":"b012d6c04fa90d85251d4886b9b77554ce7ff5d403b0082b8a2b04f14cf1ced0"}
Jul 20 18:13:46.608693 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.608603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qx2d7" event={"ID":"d2e22dc2-1a0a-410f-a007-c904b419e154","Type":"ContainerStarted","Data":"eed0508c9a93611734c16dedd2ab57fe3c921bee4b647b3278942edb437d36ec"}
Jul 20 18:13:46.610060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.610039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rwnrv" event={"ID":"c6e97b3b-28e0-48d5-b9f1-28dbe4f7ff5d","Type":"ContainerStarted","Data":"9bfc010339cbac05dfc0d024b9448f48263012e5d69a08b61dab3ee1cb600bf5"}
Jul 20 18:13:46.611565 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.611545    2560 generic.go:356] "Generic (PLEG): container finished" podID="d60d12c01b2cf8d5bb8e5f62f694d733" containerID="252e27c732c1e2f2ea2b239df04f43986fcbfe927ae8b85565f96edcaa20e6e9" exitCode=0
Jul 20 18:13:46.611659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.611611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal" event={"ID":"d60d12c01b2cf8d5bb8e5f62f694d733","Type":"ContainerDied","Data":"252e27c732c1e2f2ea2b239df04f43986fcbfe927ae8b85565f96edcaa20e6e9"}
Jul 20 18:13:46.614788 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.614759    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal" event={"ID":"e2c28caece7ac4aa08342defb3f5e63b","Type":"ContainerStarted","Data":"3bf30031e81940ec6625d1420cb46d2518eb71c82e884f8186fc726f4e0fcf33"}
Jul 20 18:13:46.616912 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.616886    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-244j2" event={"ID":"9d68d36a-6400-465b-939c-6a634d194eea","Type":"ContainerStarted","Data":"9caad2a76c18e958344c91f3ec3bdf10b6d4b3c324d51eec13c0ad1747ff35a9"}
Jul 20 18:13:46.618288 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.618259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ghzr4" event={"ID":"8c7932b2-8e1c-4ff4-a64e-c78b003647f6","Type":"ContainerStarted","Data":"ad9e79d6a662b1678795af5bff4781f41b53ccc549f7519fbc21b1ae7df3783c"}
Jul 20 18:13:46.620692 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.620655    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q8hts" podStartSLOduration=2.749080249 podStartE2EDuration="22.620642963s" totalImagesPullingTime="19.871562714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:46.620082197 +0000 UTC m=+23.856350612" watchObservedRunningTime="2026-07-20 18:13:46.620642963 +0000 UTC m=+23.856911377"
Jul 20 18:13:46.647584 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.647551    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-45.ec2.internal" podStartSLOduration=21.647538768 podStartE2EDuration="21.647538768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:46.646734761 +0000 UTC m=+23.883003178" watchObservedRunningTime="2026-07-20 18:13:46.647538768 +0000 UTC m=+23.883807183"
Jul 20 18:13:46.668725 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.668692    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ghzr4" podStartSLOduration=2.727078095 podStartE2EDuration="22.668679779s" totalImagesPullingTime="19.941601684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:46.668371529 +0000 UTC m=+23.904639943" watchObservedRunningTime="2026-07-20 18:13:46.668679779 +0000 UTC m=+23.904948196"
Jul 20 18:13:46.687458 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.687296    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qx2d7" podStartSLOduration=2.794355006 podStartE2EDuration="22.687289877s" totalImagesPullingTime="19.892934871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:46.686994161 +0000 UTC m=+23.923262576" watchObservedRunningTime="2026-07-20 18:13:46.687289877 +0000 UTC m=+23.923558291"
Jul 20 18:13:46.716745 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.716707    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rwnrv" podStartSLOduration=2.769957979 podStartE2EDuration="22.716691246s" totalImagesPullingTime="19.946733267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:46.703148431 +0000 UTC m=+23.939416857" watchObservedRunningTime="2026-07-20 18:13:46.716691246 +0000 UTC m=+23.952959662"
Jul 20 18:13:46.717206 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:46.717174    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-244j2" podStartSLOduration=2.835681709 podStartE2EDuration="22.717166635s" totalImagesPullingTime="19.881484926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:46.716477679 +0000 UTC m=+23.952746091" watchObservedRunningTime="2026-07-20 18:13:46.717166635 +0000 UTC m=+23.953435054"
Jul 20 18:13:47.482458 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:47.482417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:47.482690 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:47.482586    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:47.621965 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:47.621925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qbz4p" event={"ID":"07ee5f71-fd9e-4f79-b55d-308c8f91e4ca","Type":"ContainerStarted","Data":"c270932c027622f9c816dab4fe489a5f5765eb4b7d72fd70fa5e7bdef9cb31d1"}
Jul 20 18:13:47.624103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:47.624072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal" event={"ID":"d60d12c01b2cf8d5bb8e5f62f694d733","Type":"ContainerStarted","Data":"0235115df35340ec2f31716f96c9e95a614d23031281e057e50eac6fc693541a"}
Jul 20 18:13:47.636858 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:47.636810    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qbz4p" podStartSLOduration=8.222941419 podStartE2EDuration="23.636790969s" totalImagesPullingTime="15.41384955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:47.636220438 +0000 UTC m=+24.872488852" watchObservedRunningTime="2026-07-20 18:13:47.636790969 +0000 UTC m=+24.873059384"
Jul 20 18:13:47.650194 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:47.650149    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-45.ec2.internal" podStartSLOduration=22.650130706 podStartE2EDuration="22.650130706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:47.64966486 +0000 UTC m=+24.885933278" watchObservedRunningTime="2026-07-20 18:13:47.650130706 +0000 UTC m=+24.886399122"
Jul 20 18:13:48.453595 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:48.453567    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 18:13:48.482911 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:48.482876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:48.482911 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:48.482902    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:48.483073 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:48.482985    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:48.483160 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:48.483131    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:48.630113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:48.630080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"cf9467ce9edd9c6b6e837920587346f4e52ef312a6b09604a8d602cf6324f05c"}
Jul 20 18:13:48.631995 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:48.631970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn" event={"ID":"4b9a1d81-f0cc-4557-b479-e6fb01437078","Type":"ContainerStarted","Data":"1f7b79702c61928b26c0b88c8575fd3bc3547bbbd556e84ab3859cf6dcb383b2"}
Jul 20 18:13:49.310090 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:49.310001    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T18:13:48.453601591Z","UUID":"1e256dd5-afd5-43a6-915c-eca318132524","Handler":null,"Name":"","Endpoint":""}
Jul 20 18:13:49.311542 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:49.311515    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 18:13:49.311645 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:49.311551    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 18:13:49.482147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:49.482128    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:49.482255 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:49.482224    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:49.635905 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:49.635878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn" event={"ID":"4b9a1d81-f0cc-4557-b479-e6fb01437078","Type":"ContainerStarted","Data":"4f307dcc47cd78bbe21976da6e8d8ad13e0b4e5c93fe2768fe292c85fb8a9aab"}
Jul 20 18:13:49.651930 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:49.651894    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jjmgn" podStartSLOduration=2.5539056860000002 podStartE2EDuration="25.651882123s" totalImagesPullingTime="23.097976437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:49.651615647 +0000 UTC m=+26.887884061" watchObservedRunningTime="2026-07-20 18:13:49.651882123 +0000 UTC m=+26.888150538"
Jul 20 18:13:50.405939 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:50.405907    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:50.406564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:50.406544    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:50.482195 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:50.482169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:50.482297 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:50.482263    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:50.482338 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:50.482320    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:50.482419 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:50.482401    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:50.642731 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:50.642561    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" event={"ID":"3ddbe2ad-bd37-49a9-8155-0b17dbc295ff","Type":"ContainerStarted","Data":"ca80f5e55589a980f783b902ac728f35a5970ab773867a273962a6069d3428b9"}
Jul 20 18:13:50.643107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:50.642987    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:50.643306 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:50.643288    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qx2d7"
Jul 20 18:13:51.482601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:51.482566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:51.482756 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:51.482731    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:51.644755 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:51.644724    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:51.645400 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:51.644803    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:51.645400 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:51.644875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:51.661150 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:51.661117    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:51.662787 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:51.662764    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:13:51.670111 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:51.670059    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx" podStartSLOduration=7.493907449 podStartE2EDuration="27.670047313s" totalImagesPullingTime="20.176139864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:51.669621379 +0000 UTC m=+28.905889806" watchObservedRunningTime="2026-07-20 18:13:51.670047313 +0000 UTC m=+28.906315728"
Jul 20 18:13:52.482325 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.482308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:52.482394 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.482338    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:52.482426 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:52.482404    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:52.482582 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:52.482552    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:52.648418 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.648391    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5" containerID="74553ceaf2808b4b1c7ec0c36d431afc85c4ec45c59bfa29f7ecba99f981dac4" exitCode=0
Jul 20 18:13:52.648910 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.648470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n522l" event={"ID":"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5","Type":"ContainerDied","Data":"74553ceaf2808b4b1c7ec0c36d431afc85c4ec45c59bfa29f7ecba99f981dac4"}
Jul 20 18:13:52.816368 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.816291    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mpt7b"]
Jul 20 18:13:52.816534 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.816382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:52.816534 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:52.816481    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:52.818951 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.818925    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5hxn6"]
Jul 20 18:13:52.819078 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.819009    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:52.819137 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:52.819101    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:52.828749 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.828723    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5q8s"]
Jul 20 18:13:52.828839 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:52.828827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:52.828918 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:52.828902    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:54.482723 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:54.482564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:54.483180 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:54.482608    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:54.483180 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:54.482797    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:54.483180 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:54.482901    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:54.483180 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:54.482616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:54.483180 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:54.483018    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:54.654840 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:54.654812    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5" containerID="5f179e0db72b4090ae3f96ad66f5d8d51ad4f7abe0d30f3db4888fd4b1ade935" exitCode=0
Jul 20 18:13:54.654949 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:54.654865    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n522l" event={"ID":"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5","Type":"ContainerDied","Data":"5f179e0db72b4090ae3f96ad66f5d8d51ad4f7abe0d30f3db4888fd4b1ade935"}
Jul 20 18:13:56.483035 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:56.483004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:56.483353 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:56.483013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:56.483353 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:56.483132    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:56.483353 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:56.483184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:56.483353 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:56.483270    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:56.483505 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:56.483350    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:56.661583 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:56.661553    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5" containerID="d37d32851c02e1909ba751016fc0168cc788bbfbbc1bc01f90fd76dfe49562ba" exitCode=0
Jul 20 18:13:56.661713 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:56.661593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n522l" event={"ID":"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5","Type":"ContainerDied","Data":"d37d32851c02e1909ba751016fc0168cc788bbfbbc1bc01f90fd76dfe49562ba"}
Jul 20 18:13:56.990341 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:56.990301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:56.990511 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:56.990361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:56.990511 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:56.990485    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:56.990609 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:56.990515    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:56.990609 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:56.990544    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:28.990530356 +0000 UTC m=+66.226798749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 18:13:56.990609 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:56.990558    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret podName:94b72186-398e-4d73-99b4-1eb9cd0ec618 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:28.990552539 +0000 UTC m=+66.226820931 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret") pod "global-pull-secret-syncer-5hxn6" (UID: "94b72186-398e-4d73-99b4-1eb9cd0ec618") : object "kube-system"/"original-pull-secret" not registered
Jul 20 18:13:57.090768 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:57.090737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:57.090933 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:57.090905    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 18:13:57.090933 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:57.090927    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 18:13:57.091044 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:57.090940    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md8fl for pod openshift-network-diagnostics/network-check-target-mpt7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:57.091044 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:57.091002    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl podName:059e8efc-16a1-4054-a954-e870227ca6a0 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:29.09098439 +0000 UTC m=+66.327252803 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-md8fl" (UniqueName: "kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl") pod "network-check-target-mpt7b" (UID: "059e8efc-16a1-4054-a954-e870227ca6a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 18:13:58.482513 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:58.482482    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:13:58.482969 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:58.482600    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:13:58.482969 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:58.482614    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5hxn6" podUID="94b72186-398e-4d73-99b4-1eb9cd0ec618"
Jul 20 18:13:58.482969 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:58.482630    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:13:58.482969 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:58.482705    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpt7b" podUID="059e8efc-16a1-4054-a954-e870227ca6a0"
Jul 20 18:13:58.482969 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:58.482789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:13:59.552657 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.552627    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-45.ec2.internal" event="NodeReady"
Jul 20 18:13:59.553086 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.552747    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 18:13:59.605564 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.605536    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gc6bn"]
Jul 20 18:13:59.607673 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.607656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.608719 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.608696    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-btgjx"]
Jul 20 18:13:59.610371 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.610356    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-btgjx"
Jul 20 18:13:59.610761 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.610744    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 18:13:59.610820 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.610760    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wr2zv\""
Jul 20 18:13:59.611069 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.611046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 18:13:59.613525 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.612652    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 18:13:59.613525 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.613145    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9f5rk\""
Jul 20 18:13:59.613525 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.613320    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 18:13:59.613525 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.613376    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 18:13:59.618876 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.618854    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gc6bn"]
Jul 20 18:13:59.622550 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.622506    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-btgjx"]
Jul 20 18:13:59.710030 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.710002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzvp\" (UniqueName: \"kubernetes.io/projected/f834878a-ddb3-4474-8e63-7ba9b1228509-kube-api-access-9kzvp\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.710186 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.710045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kbl\" (UniqueName: \"kubernetes.io/projected/156f71cb-4b57-469a-b9c9-b4016addfb1e-kube-api-access-v7kbl\") pod \"ingress-canary-btgjx\" (UID: \"156f71cb-4b57-469a-b9c9-b4016addfb1e\") " pod="openshift-ingress-canary/ingress-canary-btgjx"
Jul 20 18:13:59.710186 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.710067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f834878a-ddb3-4474-8e63-7ba9b1228509-config-volume\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.710186 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.710130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.710186 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.710153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156f71cb-4b57-469a-b9c9-b4016addfb1e-cert\") pod \"ingress-canary-btgjx\" (UID: \"156f71cb-4b57-469a-b9c9-b4016addfb1e\") " pod="openshift-ingress-canary/ingress-canary-btgjx"
Jul 20 18:13:59.710336 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.710204    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f834878a-ddb3-4474-8e63-7ba9b1228509-tmp-dir\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.811326 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.811235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f834878a-ddb3-4474-8e63-7ba9b1228509-tmp-dir\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.811326 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.811316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzvp\" (UniqueName: \"kubernetes.io/projected/f834878a-ddb3-4474-8e63-7ba9b1228509-kube-api-access-9kzvp\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.811567 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.811363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kbl\" (UniqueName: \"kubernetes.io/projected/156f71cb-4b57-469a-b9c9-b4016addfb1e-kube-api-access-v7kbl\") pod \"ingress-canary-btgjx\" (UID: \"156f71cb-4b57-469a-b9c9-b4016addfb1e\") " pod="openshift-ingress-canary/ingress-canary-btgjx"
Jul 20 18:13:59.811567 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.811394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f834878a-ddb3-4474-8e63-7ba9b1228509-config-volume\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.811567 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.811456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.811567 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.811480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156f71cb-4b57-469a-b9c9-b4016addfb1e-cert\") pod \"ingress-canary-btgjx\" (UID: \"156f71cb-4b57-469a-b9c9-b4016addfb1e\") " pod="openshift-ingress-canary/ingress-canary-btgjx"
Jul 20 18:13:59.811753 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.811631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f834878a-ddb3-4474-8e63-7ba9b1228509-tmp-dir\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.811753 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:59.811715    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:13:59.811841 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:13:59.811772    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:00.311755846 +0000 UTC m=+37.548024240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:13:59.812150 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.811997    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f834878a-ddb3-4474-8e63-7ba9b1228509-config-volume\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.816566 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.816541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156f71cb-4b57-469a-b9c9-b4016addfb1e-cert\") pod \"ingress-canary-btgjx\" (UID: \"156f71cb-4b57-469a-b9c9-b4016addfb1e\") " pod="openshift-ingress-canary/ingress-canary-btgjx"
Jul 20 18:13:59.821715 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.821691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzvp\" (UniqueName: \"kubernetes.io/projected/f834878a-ddb3-4474-8e63-7ba9b1228509-kube-api-access-9kzvp\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:13:59.821959 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.821932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kbl\" (UniqueName: \"kubernetes.io/projected/156f71cb-4b57-469a-b9c9-b4016addfb1e-kube-api-access-v7kbl\") pod \"ingress-canary-btgjx\" (UID: \"156f71cb-4b57-469a-b9c9-b4016addfb1e\") " pod="openshift-ingress-canary/ingress-canary-btgjx"
Jul 20 18:13:59.926017 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:13:59.925985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-btgjx"
Jul 20 18:14:00.065875 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.065804    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-btgjx"]
Jul 20 18:14:00.069889 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:14:00.069866    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156f71cb_4b57_469a_b9c9_b4016addfb1e.slice/crio-9584ecb4435279eb3e3ef6d9267e6c0ddd2137c94d38c7adaf50c8b7e8c32f13 WatchSource:0}: Error finding container 9584ecb4435279eb3e3ef6d9267e6c0ddd2137c94d38c7adaf50c8b7e8c32f13: Status 404 returned error can't find the container with id 9584ecb4435279eb3e3ef6d9267e6c0ddd2137c94d38c7adaf50c8b7e8c32f13
Jul 20 18:14:00.316069 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.315983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:14:00.316298 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:00.316154    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:14:00.316298 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:00.316232    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:01.316212006 +0000 UTC m=+38.552480404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:14:00.482456 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.482407    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:14:00.482616 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.482467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:14:00.482616 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.482468    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:14:00.485685 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.485658    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 18:14:00.485685 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.485673    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 18:14:00.485862 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.485671    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 18:14:00.485862 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.485762    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 18:14:00.485862 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.485674    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7qbr\""
Jul 20 18:14:00.485862 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.485811    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ls8qp\""
Jul 20 18:14:00.671352 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:00.671310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-btgjx" event={"ID":"156f71cb-4b57-469a-b9c9-b4016addfb1e","Type":"ContainerStarted","Data":"9584ecb4435279eb3e3ef6d9267e6c0ddd2137c94d38c7adaf50c8b7e8c32f13"}
Jul 20 18:14:01.323920 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:01.323889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:14:01.324070 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:01.324055    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:14:01.324153 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:01.324141    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:03.324119051 +0000 UTC m=+40.560387469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:14:03.341049 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:03.341011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:14:03.341504 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:03.341139    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:14:03.341504 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:03.341196    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:07.341177036 +0000 UTC m=+44.577445436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:14:05.685716 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:05.685432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-btgjx" event={"ID":"156f71cb-4b57-469a-b9c9-b4016addfb1e","Type":"ContainerStarted","Data":"c69f20bef0cd798de257bc9c3de501ef569da1cb5ec01bace77a8a679b11b8ce"}
Jul 20 18:14:05.688122 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:05.688097    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5" containerID="9a55ccf727263f2a598f01c2cad32ea7a404e5d7ea7b3ec22ecfc131580d97aa" exitCode=0
Jul 20 18:14:05.688245 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:05.688144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n522l" event={"ID":"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5","Type":"ContainerDied","Data":"9a55ccf727263f2a598f01c2cad32ea7a404e5d7ea7b3ec22ecfc131580d97aa"}
Jul 20 18:14:05.699577 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:05.699540    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-btgjx" podStartSLOduration=2.1970674470000002 podStartE2EDuration="6.699525579s" totalImagesPullingTime="4.502458132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:05.699199926 +0000 UTC m=+42.935468341" watchObservedRunningTime="2026-07-20 18:14:05.699525579 +0000 UTC m=+42.935793995"
Jul 20 18:14:06.693256 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:06.693221    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5" containerID="eeb9d44617ffba11568b621a50f5c1408961a1cab0c1b7a280ad2018578fbcb1" exitCode=0
Jul 20 18:14:06.693638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:06.693304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n522l" event={"ID":"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5","Type":"ContainerDied","Data":"eeb9d44617ffba11568b621a50f5c1408961a1cab0c1b7a280ad2018578fbcb1"}
Jul 20 18:14:07.002785 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.002700    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"]
Jul 20 18:14:07.019854 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.019832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"]
Jul 20 18:14:07.019966 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.019915    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:14:07.022339 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.022321    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 18:14:07.022578 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.022324    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 20 18:14:07.022578 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.022380    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 18:14:07.022578 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.022432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wl6cj\""
Jul 20 18:14:07.022789 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.022775    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 18:14:07.171346 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.171309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrmv2\" (UniqueName: \"kubernetes.io/projected/441aeaaa-ef15-4215-ab63-b13fb8925400-kube-api-access-hrmv2\") pod \"managed-serviceaccount-addon-agent-78f97b4954-cgrv4\" (UID: \"441aeaaa-ef15-4215-ab63-b13fb8925400\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:14:07.171522 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.171364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/441aeaaa-ef15-4215-ab63-b13fb8925400-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f97b4954-cgrv4\" (UID: \"441aeaaa-ef15-4215-ab63-b13fb8925400\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:14:07.272637 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.272569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/441aeaaa-ef15-4215-ab63-b13fb8925400-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f97b4954-cgrv4\" (UID: \"441aeaaa-ef15-4215-ab63-b13fb8925400\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:14:07.272637 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.272635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrmv2\" (UniqueName: \"kubernetes.io/projected/441aeaaa-ef15-4215-ab63-b13fb8925400-kube-api-access-hrmv2\") pod \"managed-serviceaccount-addon-agent-78f97b4954-cgrv4\" (UID: \"441aeaaa-ef15-4215-ab63-b13fb8925400\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:14:07.275800 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.275777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/441aeaaa-ef15-4215-ab63-b13fb8925400-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f97b4954-cgrv4\" (UID: \"441aeaaa-ef15-4215-ab63-b13fb8925400\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:14:07.280844 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.280821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrmv2\" (UniqueName: \"kubernetes.io/projected/441aeaaa-ef15-4215-ab63-b13fb8925400-kube-api-access-hrmv2\") pod \"managed-serviceaccount-addon-agent-78f97b4954-cgrv4\" (UID: \"441aeaaa-ef15-4215-ab63-b13fb8925400\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:14:07.341945 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.341921    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:14:07.373260 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.373238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:14:07.373376 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:07.373362    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:14:07.373431 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:07.373418    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:15.373403759 +0000 UTC m=+52.609672153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:14:07.480643 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.480615    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"]
Jul 20 18:14:07.483934 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:14:07.483900    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod441aeaaa_ef15_4215_ab63_b13fb8925400.slice/crio-96e072131c62fd7f207b564f0da32bc3b304ec59ab10b01b42f02ab5d94e2bb8 WatchSource:0}: Error finding container 96e072131c62fd7f207b564f0da32bc3b304ec59ab10b01b42f02ab5d94e2bb8: Status 404 returned error can't find the container with id 96e072131c62fd7f207b564f0da32bc3b304ec59ab10b01b42f02ab5d94e2bb8
Jul 20 18:14:07.698861 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.698829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n522l" event={"ID":"5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5","Type":"ContainerStarted","Data":"e88868065babe1051a1f3dfc7a9cd2f5409f12ac80f75ddd0c9cc23afa39708c"}
Jul 20 18:14:07.699981 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.699956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" event={"ID":"441aeaaa-ef15-4215-ab63-b13fb8925400","Type":"ContainerStarted","Data":"96e072131c62fd7f207b564f0da32bc3b304ec59ab10b01b42f02ab5d94e2bb8"}
Jul 20 18:14:07.722760 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:07.722721    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n522l" podStartSLOduration=7.809571314 podStartE2EDuration="43.722691411s" totalImagesPullingTime="35.913120097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:07.721128101 +0000 UTC m=+44.957396515" watchObservedRunningTime="2026-07-20 18:14:07.722691411 +0000 UTC m=+44.958959826"
Jul 20 18:14:11.710620 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:11.710584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" event={"ID":"441aeaaa-ef15-4215-ab63-b13fb8925400","Type":"ContainerStarted","Data":"b4dd41b46a125c8255e96beff28c8bd60416e1e8ea138cae9cc39ac5d72a73f2"}
Jul 20 18:14:11.727000 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:11.726954    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" podStartSLOduration=2.5188178629999998 podStartE2EDuration="5.726936103s" totalImagesPullingTime="3.20811824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:11.726480666 +0000 UTC m=+48.962749080" watchObservedRunningTime="2026-07-20 18:14:11.726936103 +0000 UTC m=+48.963204518"
Jul 20 18:14:15.424028 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:15.423989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:14:15.424422 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:15.424143    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:14:15.424422 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:15.424212    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:31.424193703 +0000 UTC m=+68.660462100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:14:23.665353 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:23.665325    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w7hx"
Jul 20 18:14:29.012111 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.012075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:14:29.012671 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.012142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:14:29.014849 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.014833    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 18:14:29.014907 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.014845    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 18:14:29.022753 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:29.022740    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 18:14:29.022799 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:29.022794    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:15:33.02277836 +0000 UTC m=+130.259046756 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : secret "metrics-daemon-secret" not found
Jul 20 18:14:29.026202 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.026151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b72186-398e-4d73-99b4-1eb9cd0ec618-original-pull-secret\") pod \"global-pull-secret-syncer-5hxn6\" (UID: \"94b72186-398e-4d73-99b4-1eb9cd0ec618\") " pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:14:29.113101 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.113054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:14:29.115850 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.115832    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 18:14:29.125885 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.125868    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 18:14:29.137002 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.136976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md8fl\" (UniqueName: \"kubernetes.io/projected/059e8efc-16a1-4054-a954-e870227ca6a0-kube-api-access-md8fl\") pod \"network-check-target-mpt7b\" (UID: \"059e8efc-16a1-4054-a954-e870227ca6a0\") " pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:14:29.295677 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.295620    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ls8qp\""
Jul 20 18:14:29.302661 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.302639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5hxn6"
Jul 20 18:14:29.303729 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.303714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:14:29.433404 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.433360    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mpt7b"]
Jul 20 18:14:29.437620 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:14:29.437586    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059e8efc_16a1_4054_a954_e870227ca6a0.slice/crio-31120251bad1c6335d1a9c6d40eeb7ede7eb9b187ffde66c5dccb0124ee2095a WatchSource:0}: Error finding container 31120251bad1c6335d1a9c6d40eeb7ede7eb9b187ffde66c5dccb0124ee2095a: Status 404 returned error can't find the container with id 31120251bad1c6335d1a9c6d40eeb7ede7eb9b187ffde66c5dccb0124ee2095a
Jul 20 18:14:29.448040 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.447998    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5hxn6"]
Jul 20 18:14:29.451356 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:14:29.451336    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b72186_398e_4d73_99b4_1eb9cd0ec618.slice/crio-e659d3b0a2ea28ab1ee7aff2712910400ff16423a0819555bd18c669914abb0a WatchSource:0}: Error finding container e659d3b0a2ea28ab1ee7aff2712910400ff16423a0819555bd18c669914abb0a: Status 404 returned error can't find the container with id e659d3b0a2ea28ab1ee7aff2712910400ff16423a0819555bd18c669914abb0a
Jul 20 18:14:29.754012 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.753980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5hxn6" event={"ID":"94b72186-398e-4d73-99b4-1eb9cd0ec618","Type":"ContainerStarted","Data":"e659d3b0a2ea28ab1ee7aff2712910400ff16423a0819555bd18c669914abb0a"}
Jul 20 18:14:29.755036 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:29.755016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mpt7b" event={"ID":"059e8efc-16a1-4054-a954-e870227ca6a0","Type":"ContainerStarted","Data":"31120251bad1c6335d1a9c6d40eeb7ede7eb9b187ffde66c5dccb0124ee2095a"}
Jul 20 18:14:31.426829 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:31.426790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:14:31.427247 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:31.426939    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:14:31.427247 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:14:31.427005    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:15:03.426988256 +0000 UTC m=+100.663256649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:14:34.769354 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:34.769266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mpt7b" event={"ID":"059e8efc-16a1-4054-a954-e870227ca6a0","Type":"ContainerStarted","Data":"68f50d1b43e22cbf256a59818b0d4863aee75dfff44c8ef2fd6f09f8369429a7"}
Jul 20 18:14:34.769354 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:34.769347    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:14:34.770693 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:34.770672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5hxn6" event={"ID":"94b72186-398e-4d73-99b4-1eb9cd0ec618","Type":"ContainerStarted","Data":"2a87e7f8ecda109e7aa029918a4b9357040298627c21e14363894400197b6a75"}
Jul 20 18:14:34.783603 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:14:34.783558    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mpt7b" podStartSLOduration=65.72569644 podStartE2EDuration="1m10.783543841s" totalImagesPullingTime="5.057847401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:34.783113417 +0000 UTC m=+72.019381854" watchObservedRunningTime="2026-07-20 18:14:34.783543841 +0000 UTC m=+72.019812257"
Jul 20 18:15:03.431569 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:15:03.431530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:15:03.432016 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:15:03.431637    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:15:03.432016 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:15:03.431692    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:16:07.431674805 +0000 UTC m=+164.667943198 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:15:05.776130 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:15:05.776103    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mpt7b"
Jul 20 18:15:05.789753 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:15:05.789712    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5hxn6" podStartSLOduration=96.741484999 podStartE2EDuration="1m41.78968206s" totalImagesPullingTime="5.048197061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:34.796378302 +0000 UTC m=+72.032646727" watchObservedRunningTime="2026-07-20 18:15:05.78968206 +0000 UTC m=+103.025950476"
Jul 20 18:15:33.118915 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:15:33.118868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:15:33.119481 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:15:33.118991    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 18:15:33.119481 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:15:33.119057    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:35.119041025 +0000 UTC m=+252.355309417 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : secret "metrics-daemon-secret" not found
Jul 20 18:16:02.619729 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:16:02.619691    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gc6bn" podUID="f834878a-ddb3-4474-8e63-7ba9b1228509"
Jul 20 18:16:02.978018 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:16:02.977940    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:16:03.498244 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:16:03.498206    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:16:07.443161 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:16:07.443115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:16:07.443653 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:16:07.443251    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 18:16:07.443653 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:16:07.443310    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls podName:f834878a-ddb3-4474-8e63-7ba9b1228509 nodeName:}" failed. No retries permitted until 2026-07-20 18:18:09.443291981 +0000 UTC m=+286.679560378 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls") pod "dns-default-gc6bn" (UID: "f834878a-ddb3-4474-8e63-7ba9b1228509") : secret "dns-default-metrics-tls" not found
Jul 20 18:16:10.998686 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:16:10.998657    2560 generic.go:356] "Generic (PLEG): container finished" podID="441aeaaa-ef15-4215-ab63-b13fb8925400" containerID="b4dd41b46a125c8255e96beff28c8bd60416e1e8ea138cae9cc39ac5d72a73f2" exitCode=255
Jul 20 18:16:10.998996 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:16:10.998691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" event={"ID":"441aeaaa-ef15-4215-ab63-b13fb8925400","Type":"ContainerDied","Data":"b4dd41b46a125c8255e96beff28c8bd60416e1e8ea138cae9cc39ac5d72a73f2"}
Jul 20 18:16:11.003947 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:16:11.003929    2560 scope.go:117] "RemoveContainer" containerID="b4dd41b46a125c8255e96beff28c8bd60416e1e8ea138cae9cc39ac5d72a73f2"
Jul 20 18:16:12.002751 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:16:12.002718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" event={"ID":"441aeaaa-ef15-4215-ab63-b13fb8925400","Type":"ContainerStarted","Data":"fbf3c19bd5794da4f9483174ea6620427f258c4983823017c16630c7ab085d74"}
Jul 20 18:16:14.482780 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:16:14.482739    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:17:19.500340 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.500304    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"]
Jul 20 18:17:19.502156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.502135    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.502754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.502732    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"]
Jul 20 18:17:19.506411 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.505555    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 20 18:17:19.506411 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.505639    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lrc4c\""
Jul 20 18:17:19.506411 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.506096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 20 18:17:19.506411 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.506246    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 20 18:17:19.506749 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.506662    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 20 18:17:19.509859 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.509835    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"]
Jul 20 18:17:19.509967 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.509948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:19.511707 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.511689    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6569bb95cd-22j2r"]
Jul 20 18:17:19.511796 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.511782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:19.511952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.511932    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 20 18:17:19.512314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.512275    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 20 18:17:19.512412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.512378    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m5276\""
Jul 20 18:17:19.512412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.512403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 20 18:17:19.513539 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.513523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.513854 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.513833    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 18:17:19.513994 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.513977    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 18:17:19.514049 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.514017    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7wlgg\""
Jul 20 18:17:19.515954 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.515750    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 20 18:17:19.515954 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.515770    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ddkr6\""
Jul 20 18:17:19.515954 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.515841    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 20 18:17:19.516206 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.516182    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 20 18:17:19.516290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.516210    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 18:17:19.516701 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.516684    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"]
Jul 20 18:17:19.516765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.516748    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 20 18:17:19.516820 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.516764    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 18:17:19.520840 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.520821    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"]
Jul 20 18:17:19.522017 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.521999    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"]
Jul 20 18:17:19.529586 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.529566    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6569bb95cd-22j2r"]
Jul 20 18:17:19.592038 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.592015    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg"]
Jul 20 18:17:19.593897 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.593883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg"
Jul 20 18:17:19.596013 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.595998    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pztvx\""
Jul 20 18:17:19.598204 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598182    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.598321 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn6qw\" (UniqueName: \"kubernetes.io/projected/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-kube-api-access-tn6qw\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.598321 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57e76730-88c9-46d3-9f48-180cf3f4e378-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:19.598465 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.598465 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-stats-auth\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.598465 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljgnq\" (UniqueName: \"kubernetes.io/projected/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-kube-api-access-ljgnq\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.598623 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:19.598623 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h95j7\" (UniqueName: \"kubernetes.io/projected/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-kube-api-access-h95j7\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:19.598623 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:19.598623 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-default-certificate\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.598826 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.598826 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.598668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.599996 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.599970    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm"]
Jul 20 18:17:19.601637 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.601622    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"]
Jul 20 18:17:19.601740 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.601726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm"
Jul 20 18:17:19.603620 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.603603    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.605500 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.605421    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 20 18:17:19.605594 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.605505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 20 18:17:19.605971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.605944    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg"]
Jul 20 18:17:19.606264 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.606226    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pm5r9\""
Jul 20 18:17:19.606590 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.606572    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 20 18:17:19.606688 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.606611    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rgwtn\""
Jul 20 18:17:19.606688 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.606683    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 18:17:19.608998 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.608978    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 18:17:19.609122 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.609066    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 20 18:17:19.614629 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.614608    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm"]
Jul 20 18:17:19.629651 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.629627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"]
Jul 20 18:17:19.695093 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.695072    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77464fbc9-bsnwd"]
Jul 20 18:17:19.696952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.696939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.698904 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.698884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.698998 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.698918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-stats-auth\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.698998 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.698938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgnq\" (UniqueName: \"kubernetes.io/projected/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-kube-api-access-ljgnq\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.698998 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.698957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:19.698998 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.698978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96d1f641-f6b9-4b9a-a9d3-2439d014a479-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.699217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls6kt\" (UniqueName: \"kubernetes.io/projected/96d1f641-f6b9-4b9a-a9d3-2439d014a479-kube-api-access-ls6kt\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.699217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h95j7\" (UniqueName: \"kubernetes.io/projected/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-kube-api-access-h95j7\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:19.699217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:19.699217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-default-certificate\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.699217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699111    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzczt\""
Jul 20 18:17:19.699217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699126    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 18:17:19.699548 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.699548 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699315    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 18:17:19.699548 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.699337    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 18:17:19.699548 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.699346    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 18:17:19.699866 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.699840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.700164 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.700142    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 18:17:19.700385 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.700366    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:20.199187673 +0000 UTC m=+237.435456072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : configmap references non-existent config key: service-ca.crt
Jul 20 18:17:19.700596 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.700574    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert podName:57e76730-88c9-46d3-9f48-180cf3f4e378 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:20.20055411 +0000 UTC m=+237.436822509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-mxg4j" (UID: "57e76730-88c9-46d3-9f48-180cf3f4e378") : secret "networking-console-plugin-cert" not found
Jul 20 18:17:19.700700 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.700609    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls podName:60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:20.200592927 +0000 UTC m=+237.436861320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6sq2q" (UID: "60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6") : secret "samples-operator-tls" not found
Jul 20 18:17:19.700780 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.700762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.700842 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.700814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.700896 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.700853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xvcl\" (UniqueName: \"kubernetes.io/projected/2943ad99-1e92-44b0-8275-9a0d6876e0ea-kube-api-access-7xvcl\") pod \"network-check-source-7bc5b6bf85-56qcg\" (UID: \"2943ad99-1e92-44b0-8275-9a0d6876e0ea\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg"
Jul 20 18:17:19.700948 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.700902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.701000 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.700948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn6qw\" (UniqueName: \"kubernetes.io/projected/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-kube-api-access-tn6qw\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.701000 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.700980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57e76730-88c9-46d3-9f48-180cf3f4e378-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:19.701103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.701039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsqmx\" (UniqueName: \"kubernetes.io/projected/6662c817-7ec5-48ea-94e2-bc4991ebe698-kube-api-access-tsqmx\") pod \"volume-data-source-validator-78cf4c6f6-tnfhm\" (UID: \"6662c817-7ec5-48ea-94e2-bc4991ebe698\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm"
Jul 20 18:17:19.701320 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.701204    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 18:17:19.701320 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.701273    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:20.201255483 +0000 UTC m=+237.437523881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : secret "router-metrics-certs-default" not found
Jul 20 18:17:19.702559 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.702528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-stats-auth\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.702657 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.702573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-default-certificate\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.703253 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.703230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/57e76730-88c9-46d3-9f48-180cf3f4e378-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:19.703532 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.703511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.709247 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.709224    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 18:17:19.712755 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.712736    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77464fbc9-bsnwd"]
Jul 20 18:17:19.713998 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.713975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljgnq\" (UniqueName: \"kubernetes.io/projected/c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d-kube-api-access-ljgnq\") pod \"kube-storage-version-migrator-operator-7658d9b749-x9t5q\" (UID: \"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.714857 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.714814    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn6qw\" (UniqueName: \"kubernetes.io/projected/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-kube-api-access-tn6qw\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:19.715380 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.715361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h95j7\" (UniqueName: \"kubernetes.io/projected/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-kube-api-access-h95j7\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:19.802068 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-certificates\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.802068 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96d1f641-f6b9-4b9a-a9d3-2439d014a479-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.802181 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-bound-sa-token\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.802181 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c06c66d9-73d9-4b7e-b287-fa711dfd0432-ca-trust-extracted\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.802181 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-image-registry-private-configuration\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.802181 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.802305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-installation-pull-secrets\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.802305 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.802261    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:19.802364 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.802305    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls podName:96d1f641-f6b9-4b9a-a9d3-2439d014a479 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:20.302292123 +0000 UTC m=+237.538560515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-shj78" (UID: "96d1f641-f6b9-4b9a-a9d3-2439d014a479") : secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:19.802364 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802327    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls6kt\" (UniqueName: \"kubernetes.io/projected/96d1f641-f6b9-4b9a-a9d3-2439d014a479-kube-api-access-ls6kt\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.802364 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.802364 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7wws\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-kube-api-access-x7wws\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.802548 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xvcl\" (UniqueName: \"kubernetes.io/projected/2943ad99-1e92-44b0-8275-9a0d6876e0ea-kube-api-access-7xvcl\") pod \"network-check-source-7bc5b6bf85-56qcg\" (UID: \"2943ad99-1e92-44b0-8275-9a0d6876e0ea\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg"
Jul 20 18:17:19.802548 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-trusted-ca\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.802548 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsqmx\" (UniqueName: \"kubernetes.io/projected/6662c817-7ec5-48ea-94e2-bc4991ebe698-kube-api-access-tsqmx\") pod \"volume-data-source-validator-78cf4c6f6-tnfhm\" (UID: \"6662c817-7ec5-48ea-94e2-bc4991ebe698\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm"
Jul 20 18:17:19.802839 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.802821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96d1f641-f6b9-4b9a-a9d3-2439d014a479-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.810867 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.810837    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsqmx\" (UniqueName: \"kubernetes.io/projected/6662c817-7ec5-48ea-94e2-bc4991ebe698-kube-api-access-tsqmx\") pod \"volume-data-source-validator-78cf4c6f6-tnfhm\" (UID: \"6662c817-7ec5-48ea-94e2-bc4991ebe698\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm"
Jul 20 18:17:19.810965 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.810909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls6kt\" (UniqueName: \"kubernetes.io/projected/96d1f641-f6b9-4b9a-a9d3-2439d014a479-kube-api-access-ls6kt\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:19.811252 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.811235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xvcl\" (UniqueName: \"kubernetes.io/projected/2943ad99-1e92-44b0-8275-9a0d6876e0ea-kube-api-access-7xvcl\") pod \"network-check-source-7bc5b6bf85-56qcg\" (UID: \"2943ad99-1e92-44b0-8275-9a0d6876e0ea\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg"
Jul 20 18:17:19.813957 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.813939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"
Jul 20 18:17:19.902741 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.902714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg"
Jul 20 18:17:19.903019 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.902994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-trusted-ca\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903087 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-certificates\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903142 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-bound-sa-token\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903142 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c06c66d9-73d9-4b7e-b287-fa711dfd0432-ca-trust-extracted\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903308 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-image-registry-private-configuration\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903308 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-installation-pull-secrets\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903629 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c06c66d9-73d9-4b7e-b287-fa711dfd0432-ca-trust-extracted\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903707 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903763 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7wws\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-kube-api-access-x7wws\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903763 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.903745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-certificates\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.903941 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.903842    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 18:17:19.903941 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.903861    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77464fbc9-bsnwd: secret "image-registry-tls" not found
Jul 20 18:17:19.903941 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:19.903914    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls podName:c06c66d9-73d9-4b7e-b287-fa711dfd0432 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:20.403892455 +0000 UTC m=+237.640160847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls") pod "image-registry-77464fbc9-bsnwd" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432") : secret "image-registry-tls" not found
Jul 20 18:17:19.904203 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.904180    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-trusted-ca\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.906143 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.906116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-installation-pull-secrets\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.906521 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.906497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-image-registry-private-configuration\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.910999 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.910955    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm"
Jul 20 18:17:19.911663 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.911642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-bound-sa-token\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.911793 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.911777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7wws\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-kube-api-access-x7wws\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:19.936345 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:19.936315    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q"]
Jul 20 18:17:20.037412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.037381    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg"]
Jul 20 18:17:20.040305 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:17:20.040274    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2943ad99_1e92_44b0_8275_9a0d6876e0ea.slice/crio-d1eafcce574e9df8329785b4813dc70c477a39e636613a4a64d62be793a68d05 WatchSource:0}: Error finding container d1eafcce574e9df8329785b4813dc70c477a39e636613a4a64d62be793a68d05: Status 404 returned error can't find the container with id d1eafcce574e9df8329785b4813dc70c477a39e636613a4a64d62be793a68d05
Jul 20 18:17:20.052327 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.052286    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm"]
Jul 20 18:17:20.055563 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:17:20.055526    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6662c817_7ec5_48ea_94e2_bc4991ebe698.slice/crio-3a35ec5fdc2f98691224b498d984650b892c79fc4aa4b8f28a38b6ae560b44de WatchSource:0}: Error finding container 3a35ec5fdc2f98691224b498d984650b892c79fc4aa4b8f28a38b6ae560b44de: Status 404 returned error can't find the container with id 3a35ec5fdc2f98691224b498d984650b892c79fc4aa4b8f28a38b6ae560b44de
Jul 20 18:17:20.163351 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.163318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg" event={"ID":"2943ad99-1e92-44b0-8275-9a0d6876e0ea","Type":"ContainerStarted","Data":"1d6ab319c2b2e9dea1bee8677a974465f76fa9d7181a5bd1892eaf2d07a68e71"}
Jul 20 18:17:20.163532 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.163372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg" event={"ID":"2943ad99-1e92-44b0-8275-9a0d6876e0ea","Type":"ContainerStarted","Data":"d1eafcce574e9df8329785b4813dc70c477a39e636613a4a64d62be793a68d05"}
Jul 20 18:17:20.164515 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.164485    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm" event={"ID":"6662c817-7ec5-48ea-94e2-bc4991ebe698","Type":"ContainerStarted","Data":"3a35ec5fdc2f98691224b498d984650b892c79fc4aa4b8f28a38b6ae560b44de"}
Jul 20 18:17:20.165493 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.165464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q" event={"ID":"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d","Type":"ContainerStarted","Data":"c8c66cb551a0fdc7bfb5a0fd850acb19f56580bfd61fd720485cbc022cdb2bfb"}
Jul 20 18:17:20.178726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.178687    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-56qcg" podStartSLOduration=1.1786701179999999 podStartE2EDuration="1.178670118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:20.178478482 +0000 UTC m=+237.414746898" watchObservedRunningTime="2026-07-20 18:17:20.178670118 +0000 UTC m=+237.414938533"
Jul 20 18:17:20.205893 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.205870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:20.205984 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.205903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:20.205984 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.205937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:20.206089 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.205988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:20.206089 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.205996    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 18:17:20.206089 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.206039    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:21.206020767 +0000 UTC m=+238.442289162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : configmap references non-existent config key: service-ca.crt
Jul 20 18:17:20.206089 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.206067    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls podName:60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:21.20605708 +0000 UTC m=+238.442325476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6sq2q" (UID: "60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6") : secret "samples-operator-tls" not found
Jul 20 18:17:20.206089 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.206085    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 18:17:20.206282 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.206092    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 18:17:20.206282 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.206128    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:21.206115307 +0000 UTC m=+238.442383713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : secret "router-metrics-certs-default" not found
Jul 20 18:17:20.206282 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.206144    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert podName:57e76730-88c9-46d3-9f48-180cf3f4e378 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:21.206134742 +0000 UTC m=+238.442403147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-mxg4j" (UID: "57e76730-88c9-46d3-9f48-180cf3f4e378") : secret "networking-console-plugin-cert" not found
Jul 20 18:17:20.307027 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.306978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:20.307117 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.307102    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:20.307162 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.307148    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls podName:96d1f641-f6b9-4b9a-a9d3-2439d014a479 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:21.307135328 +0000 UTC m=+238.543403724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-shj78" (UID: "96d1f641-f6b9-4b9a-a9d3-2439d014a479") : secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:20.408225 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:20.408201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:20.408332 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.408316    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 18:17:20.408369 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.408333    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77464fbc9-bsnwd: secret "image-registry-tls" not found
Jul 20 18:17:20.408402 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:20.408370    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls podName:c06c66d9-73d9-4b7e-b287-fa711dfd0432 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:21.408357758 +0000 UTC m=+238.644626150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls") pod "image-registry-77464fbc9-bsnwd" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432") : secret "image-registry-tls" not found
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:21.215310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:21.215355    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:21.215391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:21.215460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.215533    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.215570    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.215577    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:23.215556156 +0000 UTC m=+240.451824557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : configmap references non-existent config key: service-ca.crt
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.215589    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.215606    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls podName:60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:23.215593211 +0000 UTC m=+240.451861606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6sq2q" (UID: "60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6") : secret "samples-operator-tls" not found
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.215622    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert podName:57e76730-88c9-46d3-9f48-180cf3f4e378 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:23.215612481 +0000 UTC m=+240.451880875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-mxg4j" (UID: "57e76730-88c9-46d3-9f48-180cf3f4e378") : secret "networking-console-plugin-cert" not found
Jul 20 18:17:21.215632 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.215636    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:23.215628927 +0000 UTC m=+240.451897320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : secret "router-metrics-certs-default" not found
Jul 20 18:17:21.317880 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:21.317854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:21.318063 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.318031    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:21.318175 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.318101    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls podName:96d1f641-f6b9-4b9a-a9d3-2439d014a479 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:23.318079722 +0000 UTC m=+240.554348116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-shj78" (UID: "96d1f641-f6b9-4b9a-a9d3-2439d014a479") : secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:21.418843 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:21.418814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:21.418992 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.418931    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 18:17:21.418992 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.418943    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77464fbc9-bsnwd: secret "image-registry-tls" not found
Jul 20 18:17:21.418992 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:21.418988    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls podName:c06c66d9-73d9-4b7e-b287-fa711dfd0432 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:23.418973759 +0000 UTC m=+240.655242152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls") pod "image-registry-77464fbc9-bsnwd" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432") : secret "image-registry-tls" not found
Jul 20 18:17:22.177527 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:22.177494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm" event={"ID":"6662c817-7ec5-48ea-94e2-bc4991ebe698","Type":"ContainerStarted","Data":"410e851a91ac631c410224bd7efe7a1ef1597c130cc9f47ae26e288c02afbd89"}
Jul 20 18:17:22.192095 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:22.192022    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tnfhm" podStartSLOduration=1.9852591419999999 podStartE2EDuration="3.192006696s" totalImagesPullingTime="1.206747554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:22.191547613 +0000 UTC m=+239.427816032" watchObservedRunningTime="2026-07-20 18:17:22.192006696 +0000 UTC m=+239.428275110"
Jul 20 18:17:23.182727 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.182693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q" event={"ID":"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d","Type":"ContainerStarted","Data":"1c1d530d2a074397b47f93773c1b205a76b47a019d74970418674c5c0478bf45"}
Jul 20 18:17:23.204722 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.204673    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q" podStartSLOduration=1.787160598 podStartE2EDuration="4.204657529s" totalImagesPullingTime="2.417496931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:23.20385578 +0000 UTC m=+240.440124196" watchObservedRunningTime="2026-07-20 18:17:23.204657529 +0000 UTC m=+240.440925944"
Jul 20 18:17:23.233864 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.233841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:23.233984 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.233883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:23.234062 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.234011    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 18:17:23.234062 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.234021    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 18:17:23.234166 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.234076    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.234055594 +0000 UTC m=+244.470323991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : secret "router-metrics-certs-default" not found
Jul 20 18:17:23.234166 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.234095    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert podName:57e76730-88c9-46d3-9f48-180cf3f4e378 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.234084717 +0000 UTC m=+244.470353114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-mxg4j" (UID: "57e76730-88c9-46d3-9f48-180cf3f4e378") : secret "networking-console-plugin-cert" not found
Jul 20 18:17:23.234276 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.234168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:23.234276 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.234199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:23.234370 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.234299    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 18:17:23.234370 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.234304    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.2342921 +0000 UTC m=+244.470560516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : configmap references non-existent config key: service-ca.crt
Jul 20 18:17:23.234370 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.234357    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls podName:60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.234340716 +0000 UTC m=+244.470609116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6sq2q" (UID: "60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6") : secret "samples-operator-tls" not found
Jul 20 18:17:23.334550 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.334516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:23.334785 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.334662    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:23.334785 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.334736    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls podName:96d1f641-f6b9-4b9a-a9d3-2439d014a479 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.334716445 +0000 UTC m=+244.570984841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-shj78" (UID: "96d1f641-f6b9-4b9a-a9d3-2439d014a479") : secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:23.435343 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.435253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:23.435499 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.435394    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 18:17:23.435499 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.435412    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77464fbc9-bsnwd: secret "image-registry-tls" not found
Jul 20 18:17:23.435499 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:23.435481    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls podName:c06c66d9-73d9-4b7e-b287-fa711dfd0432 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.435465711 +0000 UTC m=+244.671734105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls") pod "image-registry-77464fbc9-bsnwd" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432") : secret "image-registry-tls" not found
Jul 20 18:17:23.838424 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.838356    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2qlf5"]
Jul 20 18:17:23.840718 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.840698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:23.843198 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.843173    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-928kt\""
Jul 20 18:17:23.843338 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.843206    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 18:17:23.843338 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.843215    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 18:17:23.843499 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.843486    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 18:17:23.843499 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.843492    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 18:17:23.854633 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.854615    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qlf5"]
Jul 20 18:17:23.939842 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.939820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:23.939937 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.939869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/731543ec-13ce-406d-88d7-3d785ec5ae8d-data-volume\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:23.939937 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.939900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/731543ec-13ce-406d-88d7-3d785ec5ae8d-crio-socket\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:23.940013 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.939945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:23.940013 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:23.939962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8tgj\" (UniqueName: \"kubernetes.io/projected/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-api-access-t8tgj\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.041087 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.041050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.041189 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.041117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/731543ec-13ce-406d-88d7-3d785ec5ae8d-data-volume\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.041189 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.041165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/731543ec-13ce-406d-88d7-3d785ec5ae8d-crio-socket\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.041189 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:24.041170    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 18:17:24.041280 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.041212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.041280 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:24.041238    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:24.541218401 +0000 UTC m=+241.777486806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : configmap "kube-rbac-proxy" not found
Jul 20 18:17:24.041280 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.041263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8tgj\" (UniqueName: \"kubernetes.io/projected/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-api-access-t8tgj\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.041398 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:24.041311    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:24.041398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.041320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/731543ec-13ce-406d-88d7-3d785ec5ae8d-crio-socket\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.041398 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:24.041359    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:24.541348469 +0000 UTC m=+241.777616864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:24.041551 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.041531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/731543ec-13ce-406d-88d7-3d785ec5ae8d-data-volume\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.054322 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.054298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8tgj\" (UniqueName: \"kubernetes.io/projected/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-api-access-t8tgj\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.545147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.545118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.545529 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:24.545201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:24.545529 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:24.545235    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 18:17:24.545529 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:24.545304    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:24.545529 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:24.545313    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:25.545293956 +0000 UTC m=+242.781562366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : configmap "kube-rbac-proxy" not found
Jul 20 18:17:24.545529 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:24.545357    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:25.545346514 +0000 UTC m=+242.781614906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:25.552603 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:25.552572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:25.553014 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:25.552646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:25.553014 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:25.552730    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 18:17:25.553014 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:25.552740    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:25.553014 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:25.552781    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.552767095 +0000 UTC m=+244.789035489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : configmap "kube-rbac-proxy" not found
Jul 20 18:17:25.553014 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:25.552817    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.552798811 +0000 UTC m=+244.789067209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:26.437788 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:26.437757    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-244j2_9d68d36a-6400-465b-939c-6a634d194eea/dns-node-resolver/0.log"
Jul 20 18:17:27.265841 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.265810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:27.265841 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.265841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.265864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.265897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.265967    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.266009    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.265967    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.265976    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:35.265957312 +0000 UTC m=+252.502225705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : configmap references non-existent config key: service-ca.crt
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.266087    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:35.26607389 +0000 UTC m=+252.502342287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : secret "router-metrics-certs-default" not found
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.266098    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert podName:57e76730-88c9-46d3-9f48-180cf3f4e378 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:35.26609255 +0000 UTC m=+252.502360945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-mxg4j" (UID: "57e76730-88c9-46d3-9f48-180cf3f4e378") : secret "networking-console-plugin-cert" not found
Jul 20 18:17:27.266256 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.266108    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls podName:60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:35.266103698 +0000 UTC m=+252.502372091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6sq2q" (UID: "60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6") : secret "samples-operator-tls" not found
Jul 20 18:17:27.367144 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.367118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:27.367265 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.367240    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:27.367325 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.367284    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls podName:96d1f641-f6b9-4b9a-a9d3-2439d014a479 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:35.367271788 +0000 UTC m=+252.603540181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-shj78" (UID: "96d1f641-f6b9-4b9a-a9d3-2439d014a479") : secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:27.467987 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.467959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:27.468103 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.468088    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 18:17:27.468153 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.468105    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77464fbc9-bsnwd: secret "image-registry-tls" not found
Jul 20 18:17:27.468153 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.468144    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls podName:c06c66d9-73d9-4b7e-b287-fa711dfd0432 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:35.468132003 +0000 UTC m=+252.704400397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls") pod "image-registry-77464fbc9-bsnwd" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432") : secret "image-registry-tls" not found
Jul 20 18:17:27.568569 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.568501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:27.568691 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.568612    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 18:17:27.568691 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.568614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:27.568691 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.568665    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:31.568653033 +0000 UTC m=+248.804921427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : configmap "kube-rbac-proxy" not found
Jul 20 18:17:27.568844 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.568720    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:27.568844 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:27.568783    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:31.568767946 +0000 UTC m=+248.805036361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:27.836745 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:27.836684    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8hts_c5a88467-7161-4264-9cf6-4dd9953c73eb/node-ca/0.log"
Jul 20 18:17:28.639007 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:28.638977    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-btgjx_156f71cb-4b57-469a-b9c9-b4016addfb1e/serve-healthcheck-canary/0.log"
Jul 20 18:17:29.238938 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:29.238905    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-x9t5q_c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d/kube-storage-version-migrator-operator/0.log"
Jul 20 18:17:31.598075 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:31.598043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:31.598436 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:31.598128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:31.598436 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:31.598195    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:31.598436 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:31.598213    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 18:17:31.598436 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:31.598265    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:39.59824539 +0000 UTC m=+256.834513793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:31.598436 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:31.598278    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:39.59827242 +0000 UTC m=+256.834540813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : configmap "kube-rbac-proxy" not found
Jul 20 18:17:35.130117 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.130081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:17:35.130547 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.130142    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 18:17:35.130547 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.130214    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs podName:90c88a42-35a8-411d-9d5e-f0be7b9dacf4 nodeName:}" failed. No retries permitted until 2026-07-20 18:19:37.13019613 +0000 UTC m=+374.366464544 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs") pod "network-metrics-daemon-f5q8s" (UID: "90c88a42-35a8-411d-9d5e-f0be7b9dacf4") : secret "metrics-daemon-secret" not found
Jul 20 18:17:35.332317 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.332280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:35.332317 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.332318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:35.332489 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.332348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:35.332489 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.332432    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 18:17:35.332489 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.332463    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:51.332428222 +0000 UTC m=+268.568696614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : configmap references non-existent config key: service-ca.crt
Jul 20 18:17:35.332611 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.332495    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs podName:7a86a34c-77fd-4f28-ba1a-a62e9c2c604a nodeName:}" failed. No retries permitted until 2026-07-20 18:17:51.332479777 +0000 UTC m=+268.568748194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs") pod "router-default-6569bb95cd-22j2r" (UID: "7a86a34c-77fd-4f28-ba1a-a62e9c2c604a") : secret "router-metrics-certs-default" not found
Jul 20 18:17:35.332611 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.332518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:35.332675 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.332655    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 18:17:35.332751 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.332740    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert podName:57e76730-88c9-46d3-9f48-180cf3f4e378 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:51.332704558 +0000 UTC m=+268.568972954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-mxg4j" (UID: "57e76730-88c9-46d3-9f48-180cf3f4e378") : secret "networking-console-plugin-cert" not found
Jul 20 18:17:35.334699 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.334683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6sq2q\" (UID: \"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:35.424918 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.424860    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m5276\""
Jul 20 18:17:35.432779 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.432760    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"
Jul 20 18:17:35.432972 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.432955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:35.433050 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.433038    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:35.433087 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:35.433078    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls podName:96d1f641-f6b9-4b9a-a9d3-2439d014a479 nodeName:}" failed. No retries permitted until 2026-07-20 18:17:51.433068314 +0000 UTC m=+268.669336706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-shj78" (UID: "96d1f641-f6b9-4b9a-a9d3-2439d014a479") : secret "cluster-monitoring-operator-tls" not found
Jul 20 18:17:35.534058 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.534033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:35.536422 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.536399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"image-registry-77464fbc9-bsnwd\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") " pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:35.554966 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.554945    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q"]
Jul 20 18:17:35.626901 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.626876    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzczt\""
Jul 20 18:17:35.634970 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.634951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:35.756631 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:35.756605    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77464fbc9-bsnwd"]
Jul 20 18:17:35.759983 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:17:35.759960    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06c66d9_73d9_4b7e_b287_fa711dfd0432.slice/crio-5064b402fe22b3b2c296313dbbdcc5226c6df05d20df77a382359a47b7740931 WatchSource:0}: Error finding container 5064b402fe22b3b2c296313dbbdcc5226c6df05d20df77a382359a47b7740931: Status 404 returned error can't find the container with id 5064b402fe22b3b2c296313dbbdcc5226c6df05d20df77a382359a47b7740931
Jul 20 18:17:36.223836 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:36.223792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q" event={"ID":"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6","Type":"ContainerStarted","Data":"9a60c9d399d1042fef13fe2433ddfc6e09acecfa4ec28f928f7a60109cc2f8ab"}
Jul 20 18:17:36.225485 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:36.225454    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" event={"ID":"c06c66d9-73d9-4b7e-b287-fa711dfd0432","Type":"ContainerStarted","Data":"a36a24a92551e74c7fbd2eb10c3f98073d6a70d543d74ef8b4d4b232c1de3c90"}
Jul 20 18:17:36.225635 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:36.225504    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" event={"ID":"c06c66d9-73d9-4b7e-b287-fa711dfd0432","Type":"ContainerStarted","Data":"5064b402fe22b3b2c296313dbbdcc5226c6df05d20df77a382359a47b7740931"}
Jul 20 18:17:36.225635 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:36.225584    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:17:36.245574 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:36.245533    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" podStartSLOduration=17.245520343 podStartE2EDuration="17.245520343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:36.2435531 +0000 UTC m=+253.479821517" watchObservedRunningTime="2026-07-20 18:17:36.245520343 +0000 UTC m=+253.481788759"
Jul 20 18:17:38.232767 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:38.232729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q" event={"ID":"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6","Type":"ContainerStarted","Data":"436ce2e791d75af34a6fe8fdb4fec59140e3624d4daadbb190db1a4771eec0d0"}
Jul 20 18:17:38.233149 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:38.232788    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q" event={"ID":"60b06f7c-7fd6-4dc6-8b3a-75f6f00476c6","Type":"ContainerStarted","Data":"4347e3107d0fba144965f520baaecab32bf80839987d2625e8874cdaf6f880f8"}
Jul 20 18:17:38.248570 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:38.248525    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6sq2q" podStartSLOduration=17.288306279 podStartE2EDuration="19.248510342s" totalImagesPullingTime="1.960204063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:38.247198814 +0000 UTC m=+255.483467228" watchObservedRunningTime="2026-07-20 18:17:38.248510342 +0000 UTC m=+255.484778756"
Jul 20 18:17:39.671358 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:39.671322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:39.671771 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:39.671423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:39.671771 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:39.671569    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:39.671771 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:17:39.671632    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls podName:731543ec-13ce-406d-88d7-3d785ec5ae8d nodeName:}" failed. No retries permitted until 2026-07-20 18:17:55.671615601 +0000 UTC m=+272.907883993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlf5" (UID: "731543ec-13ce-406d-88d7-3d785ec5ae8d") : secret "insights-runtime-extractor-tls" not found
Jul 20 18:17:39.671901 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:39.671824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/731543ec-13ce-406d-88d7-3d785ec5ae8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:51.249854 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.249776    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77464fbc9-bsnwd"]
Jul 20 18:17:51.254184 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.254155    2560 patch_prober.go:28] interesting pod/image-registry-77464fbc9-bsnwd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 18:17:51.254305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.254213    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" podUID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 18:17:51.356596 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.356563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:51.356734 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.356603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:51.356734 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.356632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:51.357154 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.357132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-service-ca-bundle\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:51.358860 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.358840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a86a34c-77fd-4f28-ba1a-a62e9c2c604a-metrics-certs\") pod \"router-default-6569bb95cd-22j2r\" (UID: \"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a\") " pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:51.359103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.359083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57e76730-88c9-46d3-9f48-180cf3f4e378-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-mxg4j\" (UID: \"57e76730-88c9-46d3-9f48-180cf3f4e378\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:51.457113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.457088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:51.459106 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.459088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96d1f641-f6b9-4b9a-a9d3-2439d014a479-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-shj78\" (UID: \"96d1f641-f6b9-4b9a-a9d3-2439d014a479\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:51.637103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.637082    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7wlgg\""
Jul 20 18:17:51.637229 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.637212    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ddkr6\""
Jul 20 18:17:51.640609 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.640594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"
Jul 20 18:17:51.645925 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.645903    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:51.718627 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.718568    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rgwtn\""
Jul 20 18:17:51.725949 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.725895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"
Jul 20 18:17:51.784914 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.784878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j"]
Jul 20 18:17:51.787604 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:17:51.787574    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e76730_88c9_46d3_9f48_180cf3f4e378.slice/crio-21b7cdd83ffb52b6550b10c8d8433b051bcf376a49071bd3e1d5c25565f13895 WatchSource:0}: Error finding container 21b7cdd83ffb52b6550b10c8d8433b051bcf376a49071bd3e1d5c25565f13895: Status 404 returned error can't find the container with id 21b7cdd83ffb52b6550b10c8d8433b051bcf376a49071bd3e1d5c25565f13895
Jul 20 18:17:51.807809 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.807785    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6569bb95cd-22j2r"]
Jul 20 18:17:51.810030 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:17:51.809972    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a86a34c_77fd_4f28_ba1a_a62e9c2c604a.slice/crio-8b03ce9f37cc089e7e0784ca87c49c47ebe4ff2b965e5665a14356c91e948226 WatchSource:0}: Error finding container 8b03ce9f37cc089e7e0784ca87c49c47ebe4ff2b965e5665a14356c91e948226: Status 404 returned error can't find the container with id 8b03ce9f37cc089e7e0784ca87c49c47ebe4ff2b965e5665a14356c91e948226
Jul 20 18:17:51.862128 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:51.862105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78"]
Jul 20 18:17:51.865057 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:17:51.865035    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d1f641_f6b9_4b9a_a9d3_2439d014a479.slice/crio-eb038bbc3ca60442cc9f34627cb90f2fee5baf1ebf74f755053f49a9263899d2 WatchSource:0}: Error finding container eb038bbc3ca60442cc9f34627cb90f2fee5baf1ebf74f755053f49a9263899d2: Status 404 returned error can't find the container with id eb038bbc3ca60442cc9f34627cb90f2fee5baf1ebf74f755053f49a9263899d2
Jul 20 18:17:52.278094 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:52.278051    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78" event={"ID":"96d1f641-f6b9-4b9a-a9d3-2439d014a479","Type":"ContainerStarted","Data":"eb038bbc3ca60442cc9f34627cb90f2fee5baf1ebf74f755053f49a9263899d2"}
Jul 20 18:17:52.279409 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:52.279384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6569bb95cd-22j2r" event={"ID":"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a","Type":"ContainerStarted","Data":"f2419fdff5e51082dc96dba142bec9fe68686d290809622580b07b30b43ca7ca"}
Jul 20 18:17:52.279554 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:52.279425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6569bb95cd-22j2r" event={"ID":"7a86a34c-77fd-4f28-ba1a-a62e9c2c604a","Type":"ContainerStarted","Data":"8b03ce9f37cc089e7e0784ca87c49c47ebe4ff2b965e5665a14356c91e948226"}
Jul 20 18:17:52.280519 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:52.280499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j" event={"ID":"57e76730-88c9-46d3-9f48-180cf3f4e378","Type":"ContainerStarted","Data":"21b7cdd83ffb52b6550b10c8d8433b051bcf376a49071bd3e1d5c25565f13895"}
Jul 20 18:17:52.302478 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:52.302412    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6569bb95cd-22j2r" podStartSLOduration=33.302399843 podStartE2EDuration="33.302399843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:52.301539954 +0000 UTC m=+269.537808370" watchObservedRunningTime="2026-07-20 18:17:52.302399843 +0000 UTC m=+269.538668257"
Jul 20 18:17:52.646874 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:52.646852    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:52.649481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:52.649457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:53.284288 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:53.284260    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:53.285526 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:53.285503    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6569bb95cd-22j2r"
Jul 20 18:17:54.288287 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:54.288251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j" event={"ID":"57e76730-88c9-46d3-9f48-180cf3f4e378","Type":"ContainerStarted","Data":"e835e8cff94abadc2a7e96ba1a4fbb6becb0adf64eb134ad1af04fb742b0b2ac"}
Jul 20 18:17:54.308386 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:54.308339    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-mxg4j" podStartSLOduration=33.470763326 podStartE2EDuration="35.308324279s" totalImagesPullingTime="1.837560953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:54.307375033 +0000 UTC m=+271.543643450" watchObservedRunningTime="2026-07-20 18:17:54.308324279 +0000 UTC m=+271.544592765"
Jul 20 18:17:55.689765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:55.689734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:55.692201 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:55.692166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/731543ec-13ce-406d-88d7-3d785ec5ae8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlf5\" (UID: \"731543ec-13ce-406d-88d7-3d785ec5ae8d\") " pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:55.948994 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:55.948925    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qlf5"
Jul 20 18:17:56.093123 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:56.093100    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qlf5"]
Jul 20 18:17:56.094841 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:17:56.094821    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod731543ec_13ce_406d_88d7_3d785ec5ae8d.slice/crio-d836da8ed7216284404f1f60189a3b5cb2d58c03331eb451dd1d99222fa17c7e WatchSource:0}: Error finding container d836da8ed7216284404f1f60189a3b5cb2d58c03331eb451dd1d99222fa17c7e: Status 404 returned error can't find the container with id d836da8ed7216284404f1f60189a3b5cb2d58c03331eb451dd1d99222fa17c7e
Jul 20 18:17:56.295765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:56.295675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78" event={"ID":"96d1f641-f6b9-4b9a-a9d3-2439d014a479","Type":"ContainerStarted","Data":"28fe3a283118bf978a106494dee3e77ac3098761334a9ccfae9ac91d0b46c9f3"}
Jul 20 18:17:56.296710 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:56.296686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qlf5" event={"ID":"731543ec-13ce-406d-88d7-3d785ec5ae8d","Type":"ContainerStarted","Data":"d836da8ed7216284404f1f60189a3b5cb2d58c03331eb451dd1d99222fa17c7e"}
Jul 20 18:17:56.343387 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:17:56.343342    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-shj78" podStartSLOduration=33.911539796 podStartE2EDuration="37.343317237s" totalImagesPullingTime="3.431777441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:56.342294937 +0000 UTC m=+273.578563354" watchObservedRunningTime="2026-07-20 18:17:56.343317237 +0000 UTC m=+273.579585652"
Jul 20 18:18:01.255279 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.255243    2560 patch_prober.go:28] interesting pod/image-registry-77464fbc9-bsnwd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 18:18:01.255736 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.255305    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" podUID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 18:18:01.954294 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.954265    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"]
Jul 20 18:18:01.956496 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.956482    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:01.959031 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.959015    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 18:18:01.959933 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.959915    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 18:18:01.960053 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.959967    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 18:18:01.960053 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.959989    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wckv4\""
Jul 20 18:18:01.967488 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:01.967468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"]
Jul 20 18:18:02.138638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.138616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e168c82e-419f-496d-a4b9-0ceb80fbc58f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.138754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.138649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e168c82e-419f-496d-a4b9-0ceb80fbc58f-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.138754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.138676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrsmk\" (UniqueName: \"kubernetes.io/projected/e168c82e-419f-496d-a4b9-0ceb80fbc58f-kube-api-access-xrsmk\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.138754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.138704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e168c82e-419f-496d-a4b9-0ceb80fbc58f-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.239209 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.239154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrsmk\" (UniqueName: \"kubernetes.io/projected/e168c82e-419f-496d-a4b9-0ceb80fbc58f-kube-api-access-xrsmk\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.239209 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.239187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e168c82e-419f-496d-a4b9-0ceb80fbc58f-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.239411 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.239244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e168c82e-419f-496d-a4b9-0ceb80fbc58f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.239411 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.239266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e168c82e-419f-496d-a4b9-0ceb80fbc58f-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.239968 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.239951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e168c82e-419f-496d-a4b9-0ceb80fbc58f-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.241683 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.241664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e168c82e-419f-496d-a4b9-0ceb80fbc58f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.241838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.241820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e168c82e-419f-496d-a4b9-0ceb80fbc58f-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.249057 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.249034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrsmk\" (UniqueName: \"kubernetes.io/projected/e168c82e-419f-496d-a4b9-0ceb80fbc58f-kube-api-access-xrsmk\") pod \"prometheus-operator-5945b5cfd-5nxsr\" (UID: \"e168c82e-419f-496d-a4b9-0ceb80fbc58f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.265689 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.265665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"
Jul 20 18:18:02.324237 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.324149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qlf5" event={"ID":"731543ec-13ce-406d-88d7-3d785ec5ae8d","Type":"ContainerStarted","Data":"bf0f4f721f114d7acc785b98a45a01fe7746c7c951c8639c7570b71f6b28251b"}
Jul 20 18:18:02.389108 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:02.389082    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr"]
Jul 20 18:18:02.392883 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:18:02.392859    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode168c82e_419f_496d_a4b9_0ceb80fbc58f.slice/crio-7c44d243d7b01dbeb2f994a0182878c8b4f86e954bd626a018846b576322da94 WatchSource:0}: Error finding container 7c44d243d7b01dbeb2f994a0182878c8b4f86e954bd626a018846b576322da94: Status 404 returned error can't find the container with id 7c44d243d7b01dbeb2f994a0182878c8b4f86e954bd626a018846b576322da94
Jul 20 18:18:03.329247 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:03.329208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr" event={"ID":"e168c82e-419f-496d-a4b9-0ceb80fbc58f","Type":"ContainerStarted","Data":"7c44d243d7b01dbeb2f994a0182878c8b4f86e954bd626a018846b576322da94"}
Jul 20 18:18:04.335625 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:04.335588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr" event={"ID":"e168c82e-419f-496d-a4b9-0ceb80fbc58f","Type":"ContainerStarted","Data":"029c8418398e4cd0c48b4e9a3b765b522fbb3baf7333a8fc1d77f37fdb0f4f21"}
Jul 20 18:18:04.335976 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:04.335663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr" event={"ID":"e168c82e-419f-496d-a4b9-0ceb80fbc58f","Type":"ContainerStarted","Data":"28f9a5f89fcfa128f8aeaaa10fa3e62eb223119c284a70b143df72be61a375da"}
Jul 20 18:18:04.354772 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:04.354725    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5nxsr" podStartSLOduration=1.583219146 podStartE2EDuration="3.354704302s" totalImagesPullingTime="1.771485156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:04.354598969 +0000 UTC m=+281.590867385" watchObservedRunningTime="2026-07-20 18:18:04.354704302 +0000 UTC m=+281.590972719"
Jul 20 18:18:05.978683 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:18:05.978632    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gc6bn" podUID="f834878a-ddb3-4474-8e63-7ba9b1228509"
Jul 20 18:18:06.345048 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.345027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:18:06.345048 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.345038    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qlf5" event={"ID":"731543ec-13ce-406d-88d7-3d785ec5ae8d","Type":"ContainerStarted","Data":"0dd2fbd58ded546cae9facd409c3fbddba2828f64d63d07399f0861f8387d555"}
Jul 20 18:18:06.410955 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.410930    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-vbst2"]
Jul 20 18:18:06.413981 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.413966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.416783 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.416765    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 18:18:06.416956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.416937    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-z4tzd\""
Jul 20 18:18:06.417684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.417665    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 18:18:06.417781 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.417703    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 18:18:06.428601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.428584    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j7khc"]
Jul 20 18:18:06.431572 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.431559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.434303 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.434286    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5lp4n\""
Jul 20 18:18:06.434673 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.434652    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 18:18:06.434830 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.434815    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 18:18:06.435366 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.435346    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 18:18:06.435521 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.435504    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-vbst2"]
Jul 20 18:18:06.472351 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472465 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-textfile\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472465 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472384    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt2dw\" (UniqueName: \"kubernetes.io/projected/9a05000f-440e-4391-aaad-b93e83915ea4-kube-api-access-lt2dw\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.472465 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfgg\" (UniqueName: \"kubernetes.io/projected/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-kube-api-access-5mfgg\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472465 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-tls\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-root\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472493    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-sys\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.472659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.472659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-wtmp\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.472989 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a05000f-440e-4391-aaad-b93e83915ea4-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.472989 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-metrics-client-ca\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.472989 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.472794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a05000f-440e-4391-aaad-b93e83915ea4-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.573819 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.573770    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-sys\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.573819 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.573800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.573930 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.573822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.573930 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.573848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.573930 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.573874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-wtmp\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.573930 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.573879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-sys\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.573930 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.573902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.574148 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:18:06.573968    2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 20 18:18:06.574148 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:18:06.574012    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-tls podName:9a05000f-440e-4391-aaad-b93e83915ea4 nodeName:}" failed. No retries permitted until 2026-07-20 18:18:07.073999233 +0000 UTC m=+284.310267626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-vbst2" (UID: "9a05000f-440e-4391-aaad-b93e83915ea4") : secret "kube-state-metrics-tls" not found
Jul 20 18:18:06.574148 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a05000f-440e-4391-aaad-b93e83915ea4-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.574148 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-wtmp\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.574148 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-metrics-client-ca\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.574529 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a05000f-440e-4391-aaad-b93e83915ea4-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.574633 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.574633 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-textfile\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.574756 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt2dw\" (UniqueName: \"kubernetes.io/projected/9a05000f-440e-4391-aaad-b93e83915ea4-kube-api-access-lt2dw\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.574756 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfgg\" (UniqueName: \"kubernetes.io/projected/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-kube-api-access-5mfgg\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.574756 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-tls\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.574756 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-root\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.574756 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-metrics-client-ca\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.575039 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a05000f-440e-4391-aaad-b93e83915ea4-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.575039 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.575039 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-root\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.575039 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.574856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a05000f-440e-4391-aaad-b93e83915ea4-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.575338 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.575309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-textfile\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.575398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.575377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.576266 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.576249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.576567 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.576550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.577006 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.576991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-node-exporter-tls\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.587653 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.587633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt2dw\" (UniqueName: \"kubernetes.io/projected/9a05000f-440e-4391-aaad-b93e83915ea4-kube-api-access-lt2dw\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:06.589739 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.589720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfgg\" (UniqueName: \"kubernetes.io/projected/bc36ddb0-7d5d-431c-90ee-70f44abe88a0-kube-api-access-5mfgg\") pod \"node-exporter-j7khc\" (UID: \"bc36ddb0-7d5d-431c-90ee-70f44abe88a0\") " pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.739646 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:06.739621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7khc"
Jul 20 18:18:06.750399 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:18:06.750377    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc36ddb0_7d5d_431c_90ee_70f44abe88a0.slice/crio-6599a567379b523b5f86d0509880e50b1a16263972f90d63ebecdc8efa3f5b52 WatchSource:0}: Error finding container 6599a567379b523b5f86d0509880e50b1a16263972f90d63ebecdc8efa3f5b52: Status 404 returned error can't find the container with id 6599a567379b523b5f86d0509880e50b1a16263972f90d63ebecdc8efa3f5b52
Jul 20 18:18:07.079033 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:07.078996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:07.081684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:07.081659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a05000f-440e-4391-aaad-b93e83915ea4-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-vbst2\" (UID: \"9a05000f-440e-4391-aaad-b93e83915ea4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:07.323050 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:07.322929    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2"
Jul 20 18:18:07.352636 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:07.352576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7khc" event={"ID":"bc36ddb0-7d5d-431c-90ee-70f44abe88a0","Type":"ContainerStarted","Data":"6599a567379b523b5f86d0509880e50b1a16263972f90d63ebecdc8efa3f5b52"}
Jul 20 18:18:07.494570 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:07.494477    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-vbst2"]
Jul 20 18:18:07.500007 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:18:07.499977    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a05000f_440e_4391_aaad_b93e83915ea4.slice/crio-03daffef9ddc45667ceb5ce954c7ddac067a7713def83be0586fe1024cf7bc71 WatchSource:0}: Error finding container 03daffef9ddc45667ceb5ce954c7ddac067a7713def83be0586fe1024cf7bc71: Status 404 returned error can't find the container with id 03daffef9ddc45667ceb5ce954c7ddac067a7713def83be0586fe1024cf7bc71
Jul 20 18:18:08.357075 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:08.357040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2" event={"ID":"9a05000f-440e-4391-aaad-b93e83915ea4","Type":"ContainerStarted","Data":"03daffef9ddc45667ceb5ce954c7ddac067a7713def83be0586fe1024cf7bc71"}
Jul 20 18:18:08.358877 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:08.358846    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc36ddb0-7d5d-431c-90ee-70f44abe88a0" containerID="42282583916ab612ee20174808046c6ef1c89e13a61d523bb32a037250fe037c" exitCode=0
Jul 20 18:18:08.359044 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:08.358889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7khc" event={"ID":"bc36ddb0-7d5d-431c-90ee-70f44abe88a0","Type":"ContainerDied","Data":"42282583916ab612ee20174808046c6ef1c89e13a61d523bb32a037250fe037c"}
Jul 20 18:18:09.500114 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:09.500080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:18:09.502705 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:09.502680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f834878a-ddb3-4474-8e63-7ba9b1228509-metrics-tls\") pod \"dns-default-gc6bn\" (UID: \"f834878a-ddb3-4474-8e63-7ba9b1228509\") " pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:18:09.649118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:09.649085    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wr2zv\""
Jul 20 18:18:09.656974 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:09.656947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:18:10.246801 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.246767    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f9bb778f-6dvnp"]
Jul 20 18:18:10.250140 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.250119    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.253719 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.253670    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 18:18:10.253719 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.253674    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-99mxx\""
Jul 20 18:18:10.253719 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.253703    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 18:18:10.253944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.253739    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 18:18:10.253944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.253750    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 18:18:10.253944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.253794    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 18:18:10.253944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.253674    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 18:18:10.253944 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.253798    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 18:18:10.261689 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.261671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f9bb778f-6dvnp"]
Jul 20 18:18:10.306017 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.305983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-serving-cert\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.306113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.306026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-oauth-serving-cert\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.306113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.306070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-service-ca\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.306113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.306089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-config\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.306113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.306108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmv7r\" (UniqueName: \"kubernetes.io/projected/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-kube-api-access-zmv7r\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.306295 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.306147    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-oauth-config\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.407610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.407570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-oauth-serving-cert\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.407741 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.407627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-service-ca\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.407741 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.407661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-config\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.407741 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.407736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmv7r\" (UniqueName: \"kubernetes.io/projected/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-kube-api-access-zmv7r\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.407903 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.407788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-oauth-config\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.407903 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.407837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-serving-cert\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.408826 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.408765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-config\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.408928 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.408827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-oauth-serving-cert\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.409143 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.409123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-service-ca\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.411120 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.410987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-oauth-config\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.411298 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.411274    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-serving-cert\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.418458 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.418414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmv7r\" (UniqueName: \"kubernetes.io/projected/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-kube-api-access-zmv7r\") pod \"console-8f9bb778f-6dvnp\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") " pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.450224 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.450201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gc6bn"]
Jul 20 18:18:10.456412 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:18:10.456387    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf834878a_ddb3_4474_8e63_7ba9b1228509.slice/crio-523687f0228addce8fddd1003aea9ff3c9081335341bddf1c2898d80848aa122 WatchSource:0}: Error finding container 523687f0228addce8fddd1003aea9ff3c9081335341bddf1c2898d80848aa122: Status 404 returned error can't find the container with id 523687f0228addce8fddd1003aea9ff3c9081335341bddf1c2898d80848aa122
Jul 20 18:18:10.559798 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.559709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:10.699872 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:10.699839    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f9bb778f-6dvnp"]
Jul 20 18:18:10.704577 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:18:10.704535    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f8c0d4_8a54_4560_8e06_9fd882fe8462.slice/crio-bef2b7c1936e68616535ae6b5c15970e25816225f35aa3df55d7ac347b976788 WatchSource:0}: Error finding container bef2b7c1936e68616535ae6b5c15970e25816225f35aa3df55d7ac347b976788: Status 404 returned error can't find the container with id bef2b7c1936e68616535ae6b5c15970e25816225f35aa3df55d7ac347b976788
Jul 20 18:18:11.254064 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.254038    2560 patch_prober.go:28] interesting pod/image-registry-77464fbc9-bsnwd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 18:18:11.254187 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.254086    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" podUID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 18:18:11.375193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.375157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qlf5" event={"ID":"731543ec-13ce-406d-88d7-3d785ec5ae8d","Type":"ContainerStarted","Data":"5483c77a39ba8c8152158b83c740fc9a11f5491fb9f7668b6ffa08069f3a666e"}
Jul 20 18:18:11.377702 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.377656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7khc" event={"ID":"bc36ddb0-7d5d-431c-90ee-70f44abe88a0","Type":"ContainerStarted","Data":"2fc8ef9ae3437060449e843d072268d893a677b3506d18fa8dcfb4b210ab0b66"}
Jul 20 18:18:11.377816 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.377717    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7khc" event={"ID":"bc36ddb0-7d5d-431c-90ee-70f44abe88a0","Type":"ContainerStarted","Data":"fc2191ce4ae7185978eab20b7522ef9b1856be531d582963703d8f0c72bcdd13"}
Jul 20 18:18:11.380173 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.380147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2" event={"ID":"9a05000f-440e-4391-aaad-b93e83915ea4","Type":"ContainerStarted","Data":"1426180fc0a3a0ed80ae24b3de099e1d5fc862d0ca12baeed451054daeeda2a0"}
Jul 20 18:18:11.380300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.380202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2" event={"ID":"9a05000f-440e-4391-aaad-b93e83915ea4","Type":"ContainerStarted","Data":"2c8909e9b38756dd2338ba855afdb3dad140d48df16816bacf48f434c22e7dd3"}
Jul 20 18:18:11.380300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.380230    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2" event={"ID":"9a05000f-440e-4391-aaad-b93e83915ea4","Type":"ContainerStarted","Data":"e54728d89bfb7eb6ef97af14375f0bafebe4785fdf6ea605a5db7bba17cd946c"}
Jul 20 18:18:11.382230 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.382203    2560 generic.go:356] "Generic (PLEG): container finished" podID="441aeaaa-ef15-4215-ab63-b13fb8925400" containerID="fbf3c19bd5794da4f9483174ea6620427f258c4983823017c16630c7ab085d74" exitCode=255
Jul 20 18:18:11.382339 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.382282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" event={"ID":"441aeaaa-ef15-4215-ab63-b13fb8925400","Type":"ContainerDied","Data":"fbf3c19bd5794da4f9483174ea6620427f258c4983823017c16630c7ab085d74"}
Jul 20 18:18:11.383340 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.383308    2560 scope.go:117] "RemoveContainer" containerID="b4dd41b46a125c8255e96beff28c8bd60416e1e8ea138cae9cc39ac5d72a73f2"
Jul 20 18:18:11.383962 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.383923    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f9bb778f-6dvnp" event={"ID":"f9f8c0d4-8a54-4560-8e06-9fd882fe8462","Type":"ContainerStarted","Data":"bef2b7c1936e68616535ae6b5c15970e25816225f35aa3df55d7ac347b976788"}
Jul 20 18:18:11.385092 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.385070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc6bn" event={"ID":"f834878a-ddb3-4474-8e63-7ba9b1228509","Type":"ContainerStarted","Data":"523687f0228addce8fddd1003aea9ff3c9081335341bddf1c2898d80848aa122"}
Jul 20 18:18:11.390301 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.390281    2560 scope.go:117] "RemoveContainer" containerID="fbf3c19bd5794da4f9483174ea6620427f258c4983823017c16630c7ab085d74"
Jul 20 18:18:11.390504 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:18:11.390477    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-78f97b4954-cgrv4_open-cluster-management-agent-addon(441aeaaa-ef15-4215-ab63-b13fb8925400)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" podUID="441aeaaa-ef15-4215-ab63-b13fb8925400"
Jul 20 18:18:11.399305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.399260    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2qlf5" podStartSLOduration=34.318944897 podStartE2EDuration="48.399226855s" totalImagesPullingTime="14.080281958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:17:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:11.396931304 +0000 UTC m=+288.633199718" watchObservedRunningTime="2026-07-20 18:18:11.399226855 +0000 UTC m=+288.635495271"
Jul 20 18:18:11.443874 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.443833    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j7khc" podStartSLOduration=4.235832272 podStartE2EDuration="5.443822163s" totalImagesPullingTime="1.134628134s" totalInitContainerRuntime="73.361757ms" isStatefulPod=true podCreationTimestamp="2026-07-20 18:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:11.442041095 +0000 UTC m=+288.678309511" watchObservedRunningTime="2026-07-20 18:18:11.443822163 +0000 UTC m=+288.680090577"
Jul 20 18:18:11.462295 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:11.462253    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-vbst2" podStartSLOduration=2.6451601350000002 podStartE2EDuration="5.462238926s" totalImagesPullingTime="2.817078791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:11.460889883 +0000 UTC m=+288.697158298" watchObservedRunningTime="2026-07-20 18:18:11.462238926 +0000 UTC m=+288.698507368"
Jul 20 18:18:15.407796 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:15.407760    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f9bb778f-6dvnp" event={"ID":"f9f8c0d4-8a54-4560-8e06-9fd882fe8462","Type":"ContainerStarted","Data":"be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678"}
Jul 20 18:18:15.409500 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:15.409473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc6bn" event={"ID":"f834878a-ddb3-4474-8e63-7ba9b1228509","Type":"ContainerStarted","Data":"2c056e812ea090d4945e96446138827e3259f04a267f5f9ab17f69c38ce6eae6"}
Jul 20 18:18:15.409624 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:15.409519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc6bn" event={"ID":"f834878a-ddb3-4474-8e63-7ba9b1228509","Type":"ContainerStarted","Data":"0f0a7173a2535e3075da929a399f6973c24f98ed5a2944a809066829a59f75d4"}
Jul 20 18:18:15.409624 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:15.409554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:18:15.428813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:15.428769    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f9bb778f-6dvnp" podStartSLOduration=1.62693947 podStartE2EDuration="5.428754992s" totalImagesPullingTime="3.801815522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:15.428500432 +0000 UTC m=+292.664768847" watchObservedRunningTime="2026-07-20 18:18:15.428754992 +0000 UTC m=+292.665023409"
Jul 20 18:18:15.450596 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:15.450556    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gc6bn" podStartSLOduration=252.405739701 podStartE2EDuration="4m16.450543238s" totalImagesPullingTime="4.044803537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:15.449394018 +0000 UTC m=+292.685662433" watchObservedRunningTime="2026-07-20 18:18:15.450543238 +0000 UTC m=+292.686811654"
Jul 20 18:18:16.269412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.269373    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" podUID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" containerName="registry" containerID="cri-o://a36a24a92551e74c7fbd2eb10c3f98073d6a70d543d74ef8b4d4b232c1de3c90" gracePeriod=30
Jul 20 18:18:16.416084 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.416056    2560 generic.go:356] "Generic (PLEG): container finished" podID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" containerID="a36a24a92551e74c7fbd2eb10c3f98073d6a70d543d74ef8b4d4b232c1de3c90" exitCode=0
Jul 20 18:18:16.416460 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.416137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" event={"ID":"c06c66d9-73d9-4b7e-b287-fa711dfd0432","Type":"ContainerDied","Data":"a36a24a92551e74c7fbd2eb10c3f98073d6a70d543d74ef8b4d4b232c1de3c90"}
Jul 20 18:18:16.520641 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.520591    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:18:16.562547 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-trusted-ca\") pod \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") "
Jul 20 18:18:16.562642 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562561    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7wws\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-kube-api-access-x7wws\") pod \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") "
Jul 20 18:18:16.562642 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562599    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-installation-pull-secrets\") pod \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") "
Jul 20 18:18:16.562642 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562631    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-certificates\") pod \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") "
Jul 20 18:18:16.562755 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-bound-sa-token\") pod \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") "
Jul 20 18:18:16.562755 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562674    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") pod \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") "
Jul 20 18:18:16.562755 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562710    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-image-registry-private-configuration\") pod \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") "
Jul 20 18:18:16.562755 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c06c66d9-73d9-4b7e-b287-fa711dfd0432-ca-trust-extracted\") pod \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\" (UID: \"c06c66d9-73d9-4b7e-b287-fa711dfd0432\") "
Jul 20 18:18:16.562940 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.562905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c06c66d9-73d9-4b7e-b287-fa711dfd0432" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:18:16.563381 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.563348    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c06c66d9-73d9-4b7e-b287-fa711dfd0432" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:18:16.564960 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.564903    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-kube-api-access-x7wws" (OuterVolumeSpecName: "kube-api-access-x7wws") pod "c06c66d9-73d9-4b7e-b287-fa711dfd0432" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432"). InnerVolumeSpecName "kube-api-access-x7wws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:18:16.565061 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.565008    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c06c66d9-73d9-4b7e-b287-fa711dfd0432" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:18:16.565195 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.565155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c06c66d9-73d9-4b7e-b287-fa711dfd0432" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:18:16.565306 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.565240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c06c66d9-73d9-4b7e-b287-fa711dfd0432" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:18:16.565306 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.565270    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c06c66d9-73d9-4b7e-b287-fa711dfd0432" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:18:16.571261 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.571241    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06c66d9-73d9-4b7e-b287-fa711dfd0432-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c06c66d9-73d9-4b7e-b287-fa711dfd0432" (UID: "c06c66d9-73d9-4b7e-b287-fa711dfd0432"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:18:16.663956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.663934    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7wws\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-kube-api-access-x7wws\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:16.663956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.663956    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-installation-pull-secrets\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:16.664072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.663965    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-certificates\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:16.664072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.663974    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-bound-sa-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:16.664072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.663982    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c06c66d9-73d9-4b7e-b287-fa711dfd0432-registry-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:16.664072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.663991    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c06c66d9-73d9-4b7e-b287-fa711dfd0432-image-registry-private-configuration\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:16.664072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.663999    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c06c66d9-73d9-4b7e-b287-fa711dfd0432-ca-trust-extracted\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:16.664072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:16.664010    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c06c66d9-73d9-4b7e-b287-fa711dfd0432-trusted-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:17.342752 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:17.342721    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4"
Jul 20 18:18:17.348996 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:17.348975    2560 scope.go:117] "RemoveContainer" containerID="fbf3c19bd5794da4f9483174ea6620427f258c4983823017c16630c7ab085d74"
Jul 20 18:18:17.349161 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:18:17.349137    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-78f97b4954-cgrv4_open-cluster-management-agent-addon(441aeaaa-ef15-4215-ab63-b13fb8925400)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" podUID="441aeaaa-ef15-4215-ab63-b13fb8925400"
Jul 20 18:18:17.422222 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:17.422195    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd"
Jul 20 18:18:17.422664 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:17.422192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77464fbc9-bsnwd" event={"ID":"c06c66d9-73d9-4b7e-b287-fa711dfd0432","Type":"ContainerDied","Data":"5064b402fe22b3b2c296313dbbdcc5226c6df05d20df77a382359a47b7740931"}
Jul 20 18:18:17.422664 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:17.422341    2560 scope.go:117] "RemoveContainer" containerID="a36a24a92551e74c7fbd2eb10c3f98073d6a70d543d74ef8b4d4b232c1de3c90"
Jul 20 18:18:17.445651 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:17.445625    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77464fbc9-bsnwd"]
Jul 20 18:18:17.449210 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:17.449189    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77464fbc9-bsnwd"]
Jul 20 18:18:17.483619 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:18:17.483588    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f5q8s" podUID="90c88a42-35a8-411d-9d5e-f0be7b9dacf4"
Jul 20 18:18:17.488120 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:17.488098    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" path="/var/lib/kubelet/pods/c06c66d9-73d9-4b7e-b287-fa711dfd0432/volumes"
Jul 20 18:18:20.559949 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:20.559910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:20.559949 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:20.559956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:20.561356 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:20.561333    2560 patch_prober.go:28] interesting pod/console-8f9bb778f-6dvnp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body=
Jul 20 18:18:20.561404 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:20.561376    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8f9bb778f-6dvnp" podUID="f9f8c0d4-8a54-4560-8e06-9fd882fe8462" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused"
Jul 20 18:18:25.418589 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:25.418554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gc6bn"
Jul 20 18:18:27.427403 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:27.427368    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f9bb778f-6dvnp"]
Jul 20 18:18:28.482482 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:28.482454    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:18:31.489632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:31.489606    2560 scope.go:117] "RemoveContainer" containerID="fbf3c19bd5794da4f9483174ea6620427f258c4983823017c16630c7ab085d74"
Jul 20 18:18:32.479589 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:32.479556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f97b4954-cgrv4" event={"ID":"441aeaaa-ef15-4215-ab63-b13fb8925400","Type":"ContainerStarted","Data":"b87fb933816d94a97dc9f7ab6f18e878ee1211c3aa6ac1dc23ea0f05b2a14280"}
Jul 20 18:18:33.484540 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:33.484506    2560 generic.go:356] "Generic (PLEG): container finished" podID="c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d" containerID="1c1d530d2a074397b47f93773c1b205a76b47a019d74970418674c5c0478bf45" exitCode=0
Jul 20 18:18:33.486993 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:33.486968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q" event={"ID":"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d","Type":"ContainerDied","Data":"1c1d530d2a074397b47f93773c1b205a76b47a019d74970418674c5c0478bf45"}
Jul 20 18:18:33.487247 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:33.487233    2560 scope.go:117] "RemoveContainer" containerID="1c1d530d2a074397b47f93773c1b205a76b47a019d74970418674c5c0478bf45"
Jul 20 18:18:34.489781 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:34.489749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-x9t5q" event={"ID":"c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d","Type":"ContainerStarted","Data":"9d537e14ae1a3506ae5846f8958e8a4c3e6b75ac9477c90489c8e46f3c61d0ec"}
Jul 20 18:18:52.447416 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.447374    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8f9bb778f-6dvnp" podUID="f9f8c0d4-8a54-4560-8e06-9fd882fe8462" containerName="console" containerID="cri-o://be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678" gracePeriod=15
Jul 20 18:18:52.690289 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.690267    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:52.836619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.836554    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-service-ca\") pod \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") "
Jul 20 18:18:52.836619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.836611    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-oauth-serving-cert\") pod \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") "
Jul 20 18:18:52.836800 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.836780    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-serving-cert\") pod \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") "
Jul 20 18:18:52.836841 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.836823    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmv7r\" (UniqueName: \"kubernetes.io/projected/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-kube-api-access-zmv7r\") pod \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") "
Jul 20 18:18:52.836890 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.836857    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-config\") pod \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") "
Jul 20 18:18:52.836890 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.836879    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-oauth-config\") pod \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\" (UID: \"f9f8c0d4-8a54-4560-8e06-9fd882fe8462\") "
Jul 20 18:18:52.837024 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.836991    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-service-ca" (OuterVolumeSpecName: "service-ca") pod "f9f8c0d4-8a54-4560-8e06-9fd882fe8462" (UID: "f9f8c0d4-8a54-4560-8e06-9fd882fe8462"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:18:52.837024 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.836998    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f9f8c0d4-8a54-4560-8e06-9fd882fe8462" (UID: "f9f8c0d4-8a54-4560-8e06-9fd882fe8462"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:18:52.837147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.837075    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-oauth-serving-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:52.837202 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.837187    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:52.837293 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.837267    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-config" (OuterVolumeSpecName: "console-config") pod "f9f8c0d4-8a54-4560-8e06-9fd882fe8462" (UID: "f9f8c0d4-8a54-4560-8e06-9fd882fe8462"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:18:52.839041 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.839016    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f9f8c0d4-8a54-4560-8e06-9fd882fe8462" (UID: "f9f8c0d4-8a54-4560-8e06-9fd882fe8462"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:18:52.839161 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.839040    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f9f8c0d4-8a54-4560-8e06-9fd882fe8462" (UID: "f9f8c0d4-8a54-4560-8e06-9fd882fe8462"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:18:52.839161 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.839134    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-kube-api-access-zmv7r" (OuterVolumeSpecName: "kube-api-access-zmv7r") pod "f9f8c0d4-8a54-4560-8e06-9fd882fe8462" (UID: "f9f8c0d4-8a54-4560-8e06-9fd882fe8462"). InnerVolumeSpecName "kube-api-access-zmv7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:18:52.937603 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.937580    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-serving-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:52.937603 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.937599    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmv7r\" (UniqueName: \"kubernetes.io/projected/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-kube-api-access-zmv7r\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:52.937725 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.937609    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-config\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:52.937725 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:52.937617    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9f8c0d4-8a54-4560-8e06-9fd882fe8462-console-oauth-config\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:18:53.557420 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.557380    2560 generic.go:356] "Generic (PLEG): container finished" podID="f9f8c0d4-8a54-4560-8e06-9fd882fe8462" containerID="be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678" exitCode=0
Jul 20 18:18:53.557887 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.557467    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f9bb778f-6dvnp"
Jul 20 18:18:53.557887 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.557484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f9bb778f-6dvnp" event={"ID":"f9f8c0d4-8a54-4560-8e06-9fd882fe8462","Type":"ContainerDied","Data":"be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678"}
Jul 20 18:18:53.557887 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.557551    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f9bb778f-6dvnp" event={"ID":"f9f8c0d4-8a54-4560-8e06-9fd882fe8462","Type":"ContainerDied","Data":"bef2b7c1936e68616535ae6b5c15970e25816225f35aa3df55d7ac347b976788"}
Jul 20 18:18:53.557887 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.557582    2560 scope.go:117] "RemoveContainer" containerID="be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678"
Jul 20 18:18:53.565553 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.565534    2560 scope.go:117] "RemoveContainer" containerID="be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678"
Jul 20 18:18:53.565830 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:18:53.565808    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678\": container with ID starting with be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678 not found: ID does not exist" containerID="be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678"
Jul 20 18:18:53.565899 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.565842    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678"} err="failed to get container status \"be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678\": rpc error: code = NotFound desc = could not find container \"be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678\": container with ID starting with be586d1f5f76a915f5e02e6b893477652cc6b0cd61c38aa3eb63bbd32d12c678 not found: ID does not exist"
Jul 20 18:18:53.588161 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.588138    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f9bb778f-6dvnp"]
Jul 20 18:18:53.596712 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:53.596686    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f9bb778f-6dvnp"]
Jul 20 18:18:55.487351 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:18:55.487312    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9f8c0d4-8a54-4560-8e06-9fd882fe8462" path="/var/lib/kubelet/pods/f9f8c0d4-8a54-4560-8e06-9fd882fe8462/volumes"
Jul 20 18:19:36.891556 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.891525    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75ff68459b-x4bxc"]
Jul 20 18:19:36.891956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.891780    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" containerName="registry"
Jul 20 18:19:36.891956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.891791    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" containerName="registry"
Jul 20 18:19:36.891956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.891813    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9f8c0d4-8a54-4560-8e06-9fd882fe8462" containerName="console"
Jul 20 18:19:36.891956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.891820    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9f8c0d4-8a54-4560-8e06-9fd882fe8462" containerName="console"
Jul 20 18:19:36.891956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.891864    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c06c66d9-73d9-4b7e-b287-fa711dfd0432" containerName="registry"
Jul 20 18:19:36.891956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.891874    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9f8c0d4-8a54-4560-8e06-9fd882fe8462" containerName="console"
Jul 20 18:19:36.894763 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.894743    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:36.899264 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.899244    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 18:19:36.899404 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.899386    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 18:19:36.900122 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.900101    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 18:19:36.900247 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.900134    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 18:19:36.900247 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.900195    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 18:19:36.900419 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.900402    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 18:19:36.900512 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.900452    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 18:19:36.902334 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.902310    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-99mxx\""
Jul 20 18:19:36.906919 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.906900    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 18:19:36.910428 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.910406    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75ff68459b-x4bxc"]
Jul 20 18:19:36.947147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.947122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-serving-cert\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:36.947262 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.947164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-oauth-config\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:36.947262 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.947189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-trusted-ca-bundle\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:36.947262 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.947239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-service-ca\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:36.947408 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.947273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-oauth-serving-cert\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:36.947408 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.947293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9vvk\" (UniqueName: \"kubernetes.io/projected/f97f27cb-217d-4369-89dd-96ad85ec99e5-kube-api-access-x9vvk\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:36.947408 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:36.947340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-config\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.048395 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.048365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-serving-cert\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.048572 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.048402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-oauth-config\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.048572 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.048426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-trusted-ca-bundle\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.048572 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.048472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-service-ca\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.048572 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.048509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-oauth-serving-cert\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.048572 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.048532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9vvk\" (UniqueName: \"kubernetes.io/projected/f97f27cb-217d-4369-89dd-96ad85ec99e5-kube-api-access-x9vvk\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.048825 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.048574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-config\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.049941 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.049305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-config\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.049941 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.049680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-trusted-ca-bundle\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.049941 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.049848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-oauth-serving-cert\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.049941 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.049900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-service-ca\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.051763 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.051740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-serving-cert\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.051978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.051960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-oauth-config\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.058700 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.058674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9vvk\" (UniqueName: \"kubernetes.io/projected/f97f27cb-217d-4369-89dd-96ad85ec99e5-kube-api-access-x9vvk\") pod \"console-75ff68459b-x4bxc\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") " pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.149652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.149581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:19:37.152095 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.152072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90c88a42-35a8-411d-9d5e-f0be7b9dacf4-metrics-certs\") pod \"network-metrics-daemon-f5q8s\" (UID: \"90c88a42-35a8-411d-9d5e-f0be7b9dacf4\") " pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:19:37.185237 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.185209    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7qbr\""
Jul 20 18:19:37.193029 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.192995    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5q8s"
Jul 20 18:19:37.204699 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.204675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:37.335780 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.335748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5q8s"]
Jul 20 18:19:37.338604 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:19:37.338579    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c88a42_35a8_411d_9d5e_f0be7b9dacf4.slice/crio-036d27ebd83b7978496666e0972805296dd1255fae99f6253f4e161985746370 WatchSource:0}: Error finding container 036d27ebd83b7978496666e0972805296dd1255fae99f6253f4e161985746370: Status 404 returned error can't find the container with id 036d27ebd83b7978496666e0972805296dd1255fae99f6253f4e161985746370
Jul 20 18:19:37.340696 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.340680    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:19:37.358939 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.358916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75ff68459b-x4bxc"]
Jul 20 18:19:37.360987 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:19:37.360966    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf97f27cb_217d_4369_89dd_96ad85ec99e5.slice/crio-58baa82ec1567ce3e7cc53932fa0757b1194b9dbb375aa482ec2994be2bbd74b WatchSource:0}: Error finding container 58baa82ec1567ce3e7cc53932fa0757b1194b9dbb375aa482ec2994be2bbd74b: Status 404 returned error can't find the container with id 58baa82ec1567ce3e7cc53932fa0757b1194b9dbb375aa482ec2994be2bbd74b
Jul 20 18:19:37.709694 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.709608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ff68459b-x4bxc" event={"ID":"f97f27cb-217d-4369-89dd-96ad85ec99e5","Type":"ContainerStarted","Data":"05cd91af833812eae498fe11766ab3339c8165c5d2f05f97d7e31e8419ea1997"}
Jul 20 18:19:37.709694 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.709661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ff68459b-x4bxc" event={"ID":"f97f27cb-217d-4369-89dd-96ad85ec99e5","Type":"ContainerStarted","Data":"58baa82ec1567ce3e7cc53932fa0757b1194b9dbb375aa482ec2994be2bbd74b"}
Jul 20 18:19:37.710860 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.710827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5q8s" event={"ID":"90c88a42-35a8-411d-9d5e-f0be7b9dacf4","Type":"ContainerStarted","Data":"036d27ebd83b7978496666e0972805296dd1255fae99f6253f4e161985746370"}
Jul 20 18:19:37.726946 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:37.726902    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75ff68459b-x4bxc" podStartSLOduration=1.726887226 podStartE2EDuration="1.726887226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:19:37.726346223 +0000 UTC m=+374.962614639" watchObservedRunningTime="2026-07-20 18:19:37.726887226 +0000 UTC m=+374.963155641"
Jul 20 18:19:38.716569 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:38.716534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5q8s" event={"ID":"90c88a42-35a8-411d-9d5e-f0be7b9dacf4","Type":"ContainerStarted","Data":"60fc9543f3aacb5322211938fce3c870215862007733f6492f39e088c01bf603"}
Jul 20 18:19:38.716904 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:38.716608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5q8s" event={"ID":"90c88a42-35a8-411d-9d5e-f0be7b9dacf4","Type":"ContainerStarted","Data":"f8944c9bba45c33b45bb7e8c0eb324fcb66cc38eb156ccdb1c969864b29c5129"}
Jul 20 18:19:38.732532 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:38.732476    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f5q8s" podStartSLOduration=373.584892612 podStartE2EDuration="6m14.732432431s" totalImagesPullingTime="1.147539819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:19:38.731782136 +0000 UTC m=+375.968050552" watchObservedRunningTime="2026-07-20 18:19:38.732432431 +0000 UTC m=+375.968700848"
Jul 20 18:19:47.205288 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:47.205251    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:47.205288 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:47.205301    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:47.210196 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:47.210178    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:19:47.754098 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:19:47.754072    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:20:53.924691 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:20:53.924614    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75ff68459b-x4bxc"]
Jul 20 18:21:18.947031 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:18.946987    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75ff68459b-x4bxc" podUID="f97f27cb-217d-4369-89dd-96ad85ec99e5" containerName="console" containerID="cri-o://05cd91af833812eae498fe11766ab3339c8165c5d2f05f97d7e31e8419ea1997" gracePeriod=15
Jul 20 18:21:19.084416 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.084375    2560 generic.go:356] "Generic (PLEG): container finished" podID="f97f27cb-217d-4369-89dd-96ad85ec99e5" containerID="05cd91af833812eae498fe11766ab3339c8165c5d2f05f97d7e31e8419ea1997" exitCode=0
Jul 20 18:21:19.084546 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.084431    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ff68459b-x4bxc" event={"ID":"f97f27cb-217d-4369-89dd-96ad85ec99e5","Type":"ContainerDied","Data":"05cd91af833812eae498fe11766ab3339c8165c5d2f05f97d7e31e8419ea1997"}
Jul 20 18:21:19.197952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.197899    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:21:19.253653 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.253624    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-oauth-config\") pod \"f97f27cb-217d-4369-89dd-96ad85ec99e5\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") "
Jul 20 18:21:19.253808 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.253672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-trusted-ca-bundle\") pod \"f97f27cb-217d-4369-89dd-96ad85ec99e5\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") "
Jul 20 18:21:19.253808 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.253704    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9vvk\" (UniqueName: \"kubernetes.io/projected/f97f27cb-217d-4369-89dd-96ad85ec99e5-kube-api-access-x9vvk\") pod \"f97f27cb-217d-4369-89dd-96ad85ec99e5\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") "
Jul 20 18:21:19.253808 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.253736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-service-ca\") pod \"f97f27cb-217d-4369-89dd-96ad85ec99e5\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") "
Jul 20 18:21:19.253808 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.253786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-config\") pod \"f97f27cb-217d-4369-89dd-96ad85ec99e5\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") "
Jul 20 18:21:19.254010 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.253813    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-serving-cert\") pod \"f97f27cb-217d-4369-89dd-96ad85ec99e5\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") "
Jul 20 18:21:19.254010 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.253850    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-oauth-serving-cert\") pod \"f97f27cb-217d-4369-89dd-96ad85ec99e5\" (UID: \"f97f27cb-217d-4369-89dd-96ad85ec99e5\") "
Jul 20 18:21:19.254121 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.254068    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f97f27cb-217d-4369-89dd-96ad85ec99e5" (UID: "f97f27cb-217d-4369-89dd-96ad85ec99e5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:21:19.254175 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.254132    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-config" (OuterVolumeSpecName: "console-config") pod "f97f27cb-217d-4369-89dd-96ad85ec99e5" (UID: "f97f27cb-217d-4369-89dd-96ad85ec99e5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:21:19.254175 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.254150    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-service-ca" (OuterVolumeSpecName: "service-ca") pod "f97f27cb-217d-4369-89dd-96ad85ec99e5" (UID: "f97f27cb-217d-4369-89dd-96ad85ec99e5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:21:19.254394 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.254371    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f97f27cb-217d-4369-89dd-96ad85ec99e5" (UID: "f97f27cb-217d-4369-89dd-96ad85ec99e5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:21:19.255916 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.255892    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f97f27cb-217d-4369-89dd-96ad85ec99e5" (UID: "f97f27cb-217d-4369-89dd-96ad85ec99e5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:21:19.255985 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.255935    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f97f27cb-217d-4369-89dd-96ad85ec99e5" (UID: "f97f27cb-217d-4369-89dd-96ad85ec99e5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:21:19.255985 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.255969    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f97f27cb-217d-4369-89dd-96ad85ec99e5-kube-api-access-x9vvk" (OuterVolumeSpecName: "kube-api-access-x9vvk") pod "f97f27cb-217d-4369-89dd-96ad85ec99e5" (UID: "f97f27cb-217d-4369-89dd-96ad85ec99e5"). InnerVolumeSpecName "kube-api-access-x9vvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:21:19.355141 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.355121    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:21:19.355141 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.355140    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-config\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:21:19.355285 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.355149    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-serving-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:21:19.355285 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.355158    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-oauth-serving-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:21:19.355285 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.355167    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f97f27cb-217d-4369-89dd-96ad85ec99e5-console-oauth-config\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:21:19.355285 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.355175    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f97f27cb-217d-4369-89dd-96ad85ec99e5-trusted-ca-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:21:19.355285 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:19.355184    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9vvk\" (UniqueName: \"kubernetes.io/projected/f97f27cb-217d-4369-89dd-96ad85ec99e5-kube-api-access-x9vvk\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:21:20.089383 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:20.089350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75ff68459b-x4bxc" event={"ID":"f97f27cb-217d-4369-89dd-96ad85ec99e5","Type":"ContainerDied","Data":"58baa82ec1567ce3e7cc53932fa0757b1194b9dbb375aa482ec2994be2bbd74b"}
Jul 20 18:21:20.089892 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:20.089390    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75ff68459b-x4bxc"
Jul 20 18:21:20.089892 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:20.089410    2560 scope.go:117] "RemoveContainer" containerID="05cd91af833812eae498fe11766ab3339c8165c5d2f05f97d7e31e8419ea1997"
Jul 20 18:21:20.107137 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:20.107113    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75ff68459b-x4bxc"]
Jul 20 18:21:20.110541 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:20.110518    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75ff68459b-x4bxc"]
Jul 20 18:21:21.487114 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:21.487079    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f97f27cb-217d-4369-89dd-96ad85ec99e5" path="/var/lib/kubelet/pods/f97f27cb-217d-4369-89dd-96ad85ec99e5/volumes"
Jul 20 18:21:53.074684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.074648    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"]
Jul 20 18:21:53.075196 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.075025    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f97f27cb-217d-4369-89dd-96ad85ec99e5" containerName="console"
Jul 20 18:21:53.075196 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.075041    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f97f27cb-217d-4369-89dd-96ad85ec99e5" containerName="console"
Jul 20 18:21:53.075196 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.075129    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f97f27cb-217d-4369-89dd-96ad85ec99e5" containerName="console"
Jul 20 18:21:53.078321 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.078302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.080629 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.080603    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 18:21:53.080739 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.080604    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 18:21:53.080739 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.080712    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bgf44\""
Jul 20 18:21:53.090003 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.089982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"]
Jul 20 18:21:53.194350 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.194325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.194469 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.194357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbsp7\" (UniqueName: \"kubernetes.io/projected/31e41200-03d5-42b5-89ca-0b5f99c4c75b-kube-api-access-xbsp7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.194469 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.194405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.295247 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.295222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbsp7\" (UniqueName: \"kubernetes.io/projected/31e41200-03d5-42b5-89ca-0b5f99c4c75b-kube-api-access-xbsp7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.295397 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.295274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.295397 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.295311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.295641 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.295624    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.295713 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.295687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.304114 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.304092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbsp7\" (UniqueName: \"kubernetes.io/projected/31e41200-03d5-42b5-89ca-0b5f99c4c75b-kube-api-access-xbsp7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.386969 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.386949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:21:53.512967 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:53.512936    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"]
Jul 20 18:21:53.515782 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:21:53.515754    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e41200_03d5_42b5_89ca_0b5f99c4c75b.slice/crio-24c842c410a777ec84d993c858b7dd012d6e811e426d59144e2f5836a8a05c40 WatchSource:0}: Error finding container 24c842c410a777ec84d993c858b7dd012d6e811e426d59144e2f5836a8a05c40: Status 404 returned error can't find the container with id 24c842c410a777ec84d993c858b7dd012d6e811e426d59144e2f5836a8a05c40
Jul 20 18:21:54.216235 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:21:54.216200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6" event={"ID":"31e41200-03d5-42b5-89ca-0b5f99c4c75b","Type":"ContainerStarted","Data":"24c842c410a777ec84d993c858b7dd012d6e811e426d59144e2f5836a8a05c40"}
Jul 20 18:22:02.254727 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:02.254651    2560 generic.go:356] "Generic (PLEG): container finished" podID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerID="908e121534c2ac907956d71aa216dff41cdcaed3e4eb1c504ed39695bb83ecd1" exitCode=0
Jul 20 18:22:02.255104 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:02.254726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6" event={"ID":"31e41200-03d5-42b5-89ca-0b5f99c4c75b","Type":"ContainerDied","Data":"908e121534c2ac907956d71aa216dff41cdcaed3e4eb1c504ed39695bb83ecd1"}
Jul 20 18:22:05.266844 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:05.266806    2560 generic.go:356] "Generic (PLEG): container finished" podID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerID="f56dc7d21076d7b8846916a1ef5ad2cbe8f56de155572c3b0cdbc9aaf26e6775" exitCode=0
Jul 20 18:22:05.267195 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:05.266868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6" event={"ID":"31e41200-03d5-42b5-89ca-0b5f99c4c75b","Type":"ContainerDied","Data":"f56dc7d21076d7b8846916a1ef5ad2cbe8f56de155572c3b0cdbc9aaf26e6775"}
Jul 20 18:22:14.305895 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:14.305862    2560 generic.go:356] "Generic (PLEG): container finished" podID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerID="ce636942af6c4bab3ce81f113dc682d0e31fdb391a042569f644eb779ed82770" exitCode=0
Jul 20 18:22:14.306222 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:14.305927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6" event={"ID":"31e41200-03d5-42b5-89ca-0b5f99c4c75b","Type":"ContainerDied","Data":"ce636942af6c4bab3ce81f113dc682d0e31fdb391a042569f644eb779ed82770"}
Jul 20 18:22:15.435945 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.435921    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:22:15.568353 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.568281    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-util\") pod \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") "
Jul 20 18:22:15.568353 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.568317    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-bundle\") pod \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") "
Jul 20 18:22:15.568553 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.568388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbsp7\" (UniqueName: \"kubernetes.io/projected/31e41200-03d5-42b5-89ca-0b5f99c4c75b-kube-api-access-xbsp7\") pod \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\" (UID: \"31e41200-03d5-42b5-89ca-0b5f99c4c75b\") "
Jul 20 18:22:15.568988 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.568958    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-bundle" (OuterVolumeSpecName: "bundle") pod "31e41200-03d5-42b5-89ca-0b5f99c4c75b" (UID: "31e41200-03d5-42b5-89ca-0b5f99c4c75b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:22:15.570538 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.570516    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e41200-03d5-42b5-89ca-0b5f99c4c75b-kube-api-access-xbsp7" (OuterVolumeSpecName: "kube-api-access-xbsp7") pod "31e41200-03d5-42b5-89ca-0b5f99c4c75b" (UID: "31e41200-03d5-42b5-89ca-0b5f99c4c75b"). InnerVolumeSpecName "kube-api-access-xbsp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:22:15.572124 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.572103    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-util" (OuterVolumeSpecName: "util") pod "31e41200-03d5-42b5-89ca-0b5f99c4c75b" (UID: "31e41200-03d5-42b5-89ca-0b5f99c4c75b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:22:15.669378 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.669341    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbsp7\" (UniqueName: \"kubernetes.io/projected/31e41200-03d5-42b5-89ca-0b5f99c4c75b-kube-api-access-xbsp7\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:15.669378 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.669371    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:15.669378 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:15.669382    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e41200-03d5-42b5-89ca-0b5f99c4c75b-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:16.314487 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:16.314451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6" event={"ID":"31e41200-03d5-42b5-89ca-0b5f99c4c75b","Type":"ContainerDied","Data":"24c842c410a777ec84d993c858b7dd012d6e811e426d59144e2f5836a8a05c40"}
Jul 20 18:22:16.314651 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:16.314494    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408pqx6"
Jul 20 18:22:16.314651 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:16.314504    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24c842c410a777ec84d993c858b7dd012d6e811e426d59144e2f5836a8a05c40"
Jul 20 18:22:21.226301 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.226273    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"]
Jul 20 18:22:21.226705 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.226546    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerName="pull"
Jul 20 18:22:21.226705 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.226558    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerName="pull"
Jul 20 18:22:21.226705 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.226569    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerName="util"
Jul 20 18:22:21.226705 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.226575    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerName="util"
Jul 20 18:22:21.226705 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.226582    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerName="extract"
Jul 20 18:22:21.226705 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.226588    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerName="extract"
Jul 20 18:22:21.226705 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.226637    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e41200-03d5-42b5-89ca-0b5f99c4c75b" containerName="extract"
Jul 20 18:22:21.229943 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.229923    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"
Jul 20 18:22:21.232221 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.232200    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vp7np\""
Jul 20 18:22:21.232318 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.232200    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 18:22:21.232365 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.232340    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 18:22:21.245853 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.245829    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"]
Jul 20 18:22:21.314872 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.314835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc07b354-12cc-4ba1-8728-77b4645d48f5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g22hl\" (UID: \"dc07b354-12cc-4ba1-8728-77b4645d48f5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"
Jul 20 18:22:21.315011 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.314889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfqw6\" (UniqueName: \"kubernetes.io/projected/dc07b354-12cc-4ba1-8728-77b4645d48f5-kube-api-access-tfqw6\") pod \"cert-manager-operator-controller-manager-55c444bf86-g22hl\" (UID: \"dc07b354-12cc-4ba1-8728-77b4645d48f5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"
Jul 20 18:22:21.415330 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.415292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc07b354-12cc-4ba1-8728-77b4645d48f5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g22hl\" (UID: \"dc07b354-12cc-4ba1-8728-77b4645d48f5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"
Jul 20 18:22:21.415490 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.415350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfqw6\" (UniqueName: \"kubernetes.io/projected/dc07b354-12cc-4ba1-8728-77b4645d48f5-kube-api-access-tfqw6\") pod \"cert-manager-operator-controller-manager-55c444bf86-g22hl\" (UID: \"dc07b354-12cc-4ba1-8728-77b4645d48f5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"
Jul 20 18:22:21.415764 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.415745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc07b354-12cc-4ba1-8728-77b4645d48f5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g22hl\" (UID: \"dc07b354-12cc-4ba1-8728-77b4645d48f5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"
Jul 20 18:22:21.427837 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.427816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfqw6\" (UniqueName: \"kubernetes.io/projected/dc07b354-12cc-4ba1-8728-77b4645d48f5-kube-api-access-tfqw6\") pod \"cert-manager-operator-controller-manager-55c444bf86-g22hl\" (UID: \"dc07b354-12cc-4ba1-8728-77b4645d48f5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"
Jul 20 18:22:21.542653 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.542593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"
Jul 20 18:22:21.681219 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:21.681195    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl"]
Jul 20 18:22:21.683997 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:22:21.683967    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc07b354_12cc_4ba1_8728_77b4645d48f5.slice/crio-4b62fdd79d1201cdad9ddcfe05f04cfc8d617f98c6b2a07982f3b2ee57f6350a WatchSource:0}: Error finding container 4b62fdd79d1201cdad9ddcfe05f04cfc8d617f98c6b2a07982f3b2ee57f6350a: Status 404 returned error can't find the container with id 4b62fdd79d1201cdad9ddcfe05f04cfc8d617f98c6b2a07982f3b2ee57f6350a
Jul 20 18:22:22.337046 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:22.337006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl" event={"ID":"dc07b354-12cc-4ba1-8728-77b4645d48f5","Type":"ContainerStarted","Data":"4b62fdd79d1201cdad9ddcfe05f04cfc8d617f98c6b2a07982f3b2ee57f6350a"}
Jul 20 18:22:24.345932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.345901    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9tk6j"]
Jul 20 18:22:24.350269 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.350245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl" event={"ID":"dc07b354-12cc-4ba1-8728-77b4645d48f5","Type":"ContainerStarted","Data":"deac49442f72c3db1dfc9a840169ab66e42a5eba858835c25061dff9b8e9b467"}
Jul 20 18:22:24.350377 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.350333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:24.352795 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.352779    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 18:22:24.353639 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.353625    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8skgh\""
Jul 20 18:22:24.353692 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.353665    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 18:22:24.370003 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.369978    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9tk6j"]
Jul 20 18:22:24.377483 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.377411    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g22hl" podStartSLOduration=1.6736120730000001 podStartE2EDuration="3.377395476s" totalImagesPullingTime="1.703783403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:22:24.37720741 +0000 UTC m=+541.613475826" watchObservedRunningTime="2026-07-20 18:22:24.377395476 +0000 UTC m=+541.613663890"
Jul 20 18:22:24.441045 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.441022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf5nk\" (UniqueName: \"kubernetes.io/projected/08e50feb-1952-4b0e-b93c-fbd6d56f5738-kube-api-access-rf5nk\") pod \"cert-manager-webhook-6486ffd997-9tk6j\" (UID: \"08e50feb-1952-4b0e-b93c-fbd6d56f5738\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:24.441167 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.441063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08e50feb-1952-4b0e-b93c-fbd6d56f5738-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9tk6j\" (UID: \"08e50feb-1952-4b0e-b93c-fbd6d56f5738\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:24.542115 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.542088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf5nk\" (UniqueName: \"kubernetes.io/projected/08e50feb-1952-4b0e-b93c-fbd6d56f5738-kube-api-access-rf5nk\") pod \"cert-manager-webhook-6486ffd997-9tk6j\" (UID: \"08e50feb-1952-4b0e-b93c-fbd6d56f5738\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:24.542241 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.542129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08e50feb-1952-4b0e-b93c-fbd6d56f5738-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9tk6j\" (UID: \"08e50feb-1952-4b0e-b93c-fbd6d56f5738\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:24.556325 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.556294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08e50feb-1952-4b0e-b93c-fbd6d56f5738-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9tk6j\" (UID: \"08e50feb-1952-4b0e-b93c-fbd6d56f5738\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:24.556420 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.556351    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf5nk\" (UniqueName: \"kubernetes.io/projected/08e50feb-1952-4b0e-b93c-fbd6d56f5738-kube-api-access-rf5nk\") pod \"cert-manager-webhook-6486ffd997-9tk6j\" (UID: \"08e50feb-1952-4b0e-b93c-fbd6d56f5738\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:24.658688 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.658665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:24.805537 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:24.805515    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9tk6j"]
Jul 20 18:22:24.807859 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:22:24.807826    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08e50feb_1952_4b0e_b93c_fbd6d56f5738.slice/crio-270dafe51549e4aa5efbf5523e1e7328c151a1cff4e498ef9fa7c1ac9af54faa WatchSource:0}: Error finding container 270dafe51549e4aa5efbf5523e1e7328c151a1cff4e498ef9fa7c1ac9af54faa: Status 404 returned error can't find the container with id 270dafe51549e4aa5efbf5523e1e7328c151a1cff4e498ef9fa7c1ac9af54faa
Jul 20 18:22:25.353273 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.353240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j" event={"ID":"08e50feb-1952-4b0e-b93c-fbd6d56f5738","Type":"ContainerStarted","Data":"270dafe51549e4aa5efbf5523e1e7328c151a1cff4e498ef9fa7c1ac9af54faa"}
Jul 20 18:22:25.491748 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.491719    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"]
Jul 20 18:22:25.494450 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.494419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.497802 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.497779    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 18:22:25.497906 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.497866    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bgf44\""
Jul 20 18:22:25.498676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.498662    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 18:22:25.506334 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.506312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"]
Jul 20 18:22:25.651675 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.651641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.651675 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.651673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.651885 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.651728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2w5v\" (UniqueName: \"kubernetes.io/projected/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-kube-api-access-z2w5v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.752666 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.752631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.752666 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.752667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.752903 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.752718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2w5v\" (UniqueName: \"kubernetes.io/projected/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-kube-api-access-z2w5v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.753089 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.753064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.753160 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.753100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.761939 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.761912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2w5v\" (UniqueName: \"kubernetes.io/projected/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-kube-api-access-z2w5v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.804154 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.804119    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:25.949153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:25.949080    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"]
Jul 20 18:22:25.952251 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:22:25.952218    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ffd98b7_f19e_4355_9e2e_deddfce23ef2.slice/crio-4b7842b5f1b1dd5bb63a7aff8e1d28af4eac945f10e8c71e84c03785a890820f WatchSource:0}: Error finding container 4b7842b5f1b1dd5bb63a7aff8e1d28af4eac945f10e8c71e84c03785a890820f: Status 404 returned error can't find the container with id 4b7842b5f1b1dd5bb63a7aff8e1d28af4eac945f10e8c71e84c03785a890820f
Jul 20 18:22:26.359861 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:26.359754    2560 generic.go:356] "Generic (PLEG): container finished" podID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerID="49a1858cfb1a3860e891be6e070d4af508c5aced44a3375458cf532be723232b" exitCode=0
Jul 20 18:22:26.359861 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:26.359842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl" event={"ID":"2ffd98b7-f19e-4355-9e2e-deddfce23ef2","Type":"ContainerDied","Data":"49a1858cfb1a3860e891be6e070d4af508c5aced44a3375458cf532be723232b"}
Jul 20 18:22:26.360346 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:26.359899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl" event={"ID":"2ffd98b7-f19e-4355-9e2e-deddfce23ef2","Type":"ContainerStarted","Data":"4b7842b5f1b1dd5bb63a7aff8e1d28af4eac945f10e8c71e84c03785a890820f"}
Jul 20 18:22:28.375507 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:28.375471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j" event={"ID":"08e50feb-1952-4b0e-b93c-fbd6d56f5738","Type":"ContainerStarted","Data":"411c36cdfc5147cdf2c28b2d212cfbb49f69b7f803faadc6eef313f430c0e279"}
Jul 20 18:22:28.375980 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:28.375634    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:28.391514 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:28.391465    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j" podStartSLOduration=1.560234444 podStartE2EDuration="4.391429123s" totalImagesPullingTime="2.831194679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:22:28.389719393 +0000 UTC m=+545.625987809" watchObservedRunningTime="2026-07-20 18:22:28.391429123 +0000 UTC m=+545.627697537"
Jul 20 18:22:29.381366 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:29.381336    2560 generic.go:356] "Generic (PLEG): container finished" podID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerID="3e5c92568a5f0b4c6dfada0c7e293c8f3bae9bea5c03e3345ee482d18826b509" exitCode=0
Jul 20 18:22:29.381788 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:29.381424    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl" event={"ID":"2ffd98b7-f19e-4355-9e2e-deddfce23ef2","Type":"ContainerDied","Data":"3e5c92568a5f0b4c6dfada0c7e293c8f3bae9bea5c03e3345ee482d18826b509"}
Jul 20 18:22:30.387754 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:30.387724    2560 generic.go:356] "Generic (PLEG): container finished" podID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerID="a71f5a4e17dd5152180c08df4897fbe4ac1b316a0b4c5c71049fc1891e8d6912" exitCode=0
Jul 20 18:22:30.388113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:30.387792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl" event={"ID":"2ffd98b7-f19e-4355-9e2e-deddfce23ef2","Type":"ContainerDied","Data":"a71f5a4e17dd5152180c08df4897fbe4ac1b316a0b4c5c71049fc1891e8d6912"}
Jul 20 18:22:31.512744 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.512719    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:31.594709 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.594672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2w5v\" (UniqueName: \"kubernetes.io/projected/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-kube-api-access-z2w5v\") pod \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") "
Jul 20 18:22:31.594867 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.594732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-bundle\") pod \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") "
Jul 20 18:22:31.594867 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.594763    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-util\") pod \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\" (UID: \"2ffd98b7-f19e-4355-9e2e-deddfce23ef2\") "
Jul 20 18:22:31.595125 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.595093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-bundle" (OuterVolumeSpecName: "bundle") pod "2ffd98b7-f19e-4355-9e2e-deddfce23ef2" (UID: "2ffd98b7-f19e-4355-9e2e-deddfce23ef2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:22:31.596804 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.596783    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-kube-api-access-z2w5v" (OuterVolumeSpecName: "kube-api-access-z2w5v") pod "2ffd98b7-f19e-4355-9e2e-deddfce23ef2" (UID: "2ffd98b7-f19e-4355-9e2e-deddfce23ef2"). InnerVolumeSpecName "kube-api-access-z2w5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:22:31.599247 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.599216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-util" (OuterVolumeSpecName: "util") pod "2ffd98b7-f19e-4355-9e2e-deddfce23ef2" (UID: "2ffd98b7-f19e-4355-9e2e-deddfce23ef2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:22:31.695510 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.695423    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:31.695510 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.695474    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2w5v\" (UniqueName: \"kubernetes.io/projected/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-kube-api-access-z2w5v\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:31.695510 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:31.695490    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ffd98b7-f19e-4355-9e2e-deddfce23ef2-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:32.397765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:32.397726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl" event={"ID":"2ffd98b7-f19e-4355-9e2e-deddfce23ef2","Type":"ContainerDied","Data":"4b7842b5f1b1dd5bb63a7aff8e1d28af4eac945f10e8c71e84c03785a890820f"}
Jul 20 18:22:32.397765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:32.397763    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv5gtl"
Jul 20 18:22:32.397765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:32.397774    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b7842b5f1b1dd5bb63a7aff8e1d28af4eac945f10e8c71e84c03785a890820f"
Jul 20 18:22:34.383730 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:34.383695    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9tk6j"
Jul 20 18:22:35.104790 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.104755    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n6mfj"]
Jul 20 18:22:35.105060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.105048    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerName="extract"
Jul 20 18:22:35.105107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.105064    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerName="extract"
Jul 20 18:22:35.105107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.105081    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerName="util"
Jul 20 18:22:35.105107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.105088    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerName="util"
Jul 20 18:22:35.105107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.105094    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerName="pull"
Jul 20 18:22:35.105107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.105100    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerName="pull"
Jul 20 18:22:35.105296 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.105154    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ffd98b7-f19e-4355-9e2e-deddfce23ef2" containerName="extract"
Jul 20 18:22:35.106996 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.106981    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-n6mfj"
Jul 20 18:22:35.109519 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.109499    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xnfzz\""
Jul 20 18:22:35.118156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.118131    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n6mfj"]
Jul 20 18:22:35.118392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.118373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48829b40-2a2b-4989-aeab-25cc2dc912e3-bound-sa-token\") pod \"cert-manager-55b4d954d5-n6mfj\" (UID: \"48829b40-2a2b-4989-aeab-25cc2dc912e3\") " pod="cert-manager/cert-manager-55b4d954d5-n6mfj"
Jul 20 18:22:35.118457 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.118429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zclzv\" (UniqueName: \"kubernetes.io/projected/48829b40-2a2b-4989-aeab-25cc2dc912e3-kube-api-access-zclzv\") pod \"cert-manager-55b4d954d5-n6mfj\" (UID: \"48829b40-2a2b-4989-aeab-25cc2dc912e3\") " pod="cert-manager/cert-manager-55b4d954d5-n6mfj"
Jul 20 18:22:35.219143 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.219105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zclzv\" (UniqueName: \"kubernetes.io/projected/48829b40-2a2b-4989-aeab-25cc2dc912e3-kube-api-access-zclzv\") pod \"cert-manager-55b4d954d5-n6mfj\" (UID: \"48829b40-2a2b-4989-aeab-25cc2dc912e3\") " pod="cert-manager/cert-manager-55b4d954d5-n6mfj"
Jul 20 18:22:35.219326 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.219179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48829b40-2a2b-4989-aeab-25cc2dc912e3-bound-sa-token\") pod \"cert-manager-55b4d954d5-n6mfj\" (UID: \"48829b40-2a2b-4989-aeab-25cc2dc912e3\") " pod="cert-manager/cert-manager-55b4d954d5-n6mfj"
Jul 20 18:22:35.227772 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.227740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48829b40-2a2b-4989-aeab-25cc2dc912e3-bound-sa-token\") pod \"cert-manager-55b4d954d5-n6mfj\" (UID: \"48829b40-2a2b-4989-aeab-25cc2dc912e3\") " pod="cert-manager/cert-manager-55b4d954d5-n6mfj"
Jul 20 18:22:35.227887 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.227826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zclzv\" (UniqueName: \"kubernetes.io/projected/48829b40-2a2b-4989-aeab-25cc2dc912e3-kube-api-access-zclzv\") pod \"cert-manager-55b4d954d5-n6mfj\" (UID: \"48829b40-2a2b-4989-aeab-25cc2dc912e3\") " pod="cert-manager/cert-manager-55b4d954d5-n6mfj"
Jul 20 18:22:35.415686 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.415659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-n6mfj"
Jul 20 18:22:35.546605 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:35.546571    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n6mfj"]
Jul 20 18:22:35.549529 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:22:35.549502    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48829b40_2a2b_4989_aeab_25cc2dc912e3.slice/crio-49193a0af4d9e6ef0e21a58bf8246015259749005d3f00ff85a61a65c2883115 WatchSource:0}: Error finding container 49193a0af4d9e6ef0e21a58bf8246015259749005d3f00ff85a61a65c2883115: Status 404 returned error can't find the container with id 49193a0af4d9e6ef0e21a58bf8246015259749005d3f00ff85a61a65c2883115
Jul 20 18:22:36.414434 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:36.414397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-n6mfj" event={"ID":"48829b40-2a2b-4989-aeab-25cc2dc912e3","Type":"ContainerStarted","Data":"18a6d5a37d37d7817e0406f9e19bab8f09fb9b510bad1ecf08dd7d8f46ef354a"}
Jul 20 18:22:36.414434 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:36.414435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-n6mfj" event={"ID":"48829b40-2a2b-4989-aeab-25cc2dc912e3","Type":"ContainerStarted","Data":"49193a0af4d9e6ef0e21a58bf8246015259749005d3f00ff85a61a65c2883115"}
Jul 20 18:22:36.429964 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:36.429922    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-n6mfj" podStartSLOduration=1.429909517 podStartE2EDuration="1.429909517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:22:36.429588019 +0000 UTC m=+553.665856435" watchObservedRunningTime="2026-07-20 18:22:36.429909517 +0000 UTC m=+553.666177931"
Jul 20 18:22:45.611916 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.611883    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"]
Jul 20 18:22:45.620163 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.620140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.622784 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.622761    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 18:22:45.623393 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.623368    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"]
Jul 20 18:22:45.623964 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.623945    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 18:22:45.624064 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.624000    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bgf44\""
Jul 20 18:22:45.695055 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.695020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6xcb\" (UniqueName: \"kubernetes.io/projected/43e1cd19-e359-47eb-89d3-87d5b2537a19-kube-api-access-r6xcb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.695230 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.695083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.695230 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.695111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.795712 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.795679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.795867 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.795723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.795867 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.795759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6xcb\" (UniqueName: \"kubernetes.io/projected/43e1cd19-e359-47eb-89d3-87d5b2537a19-kube-api-access-r6xcb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.796105 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.796084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.796147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.796129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.804540 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.804516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6xcb\" (UniqueName: \"kubernetes.io/projected/43e1cd19-e359-47eb-89d3-87d5b2537a19-kube-api-access-r6xcb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:45.930958 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:45.930929    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:46.065710 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:46.065585    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"]
Jul 20 18:22:46.067966 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:22:46.067932    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e1cd19_e359_47eb_89d3_87d5b2537a19.slice/crio-41e216e5d21e1901b7ffd1dfa28810b026ebfcd13f54442f43a8db0a79b16b4c WatchSource:0}: Error finding container 41e216e5d21e1901b7ffd1dfa28810b026ebfcd13f54442f43a8db0a79b16b4c: Status 404 returned error can't find the container with id 41e216e5d21e1901b7ffd1dfa28810b026ebfcd13f54442f43a8db0a79b16b4c
Jul 20 18:22:46.458722 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:46.458647    2560 generic.go:356] "Generic (PLEG): container finished" podID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerID="1023183febc60df50dc2cdc454f48fe90f71b5e81c38ffa7f1a50719a4523496" exitCode=0
Jul 20 18:22:46.458722 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:46.458711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2" event={"ID":"43e1cd19-e359-47eb-89d3-87d5b2537a19","Type":"ContainerDied","Data":"1023183febc60df50dc2cdc454f48fe90f71b5e81c38ffa7f1a50719a4523496"}
Jul 20 18:22:46.458887 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:46.458754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2" event={"ID":"43e1cd19-e359-47eb-89d3-87d5b2537a19","Type":"ContainerStarted","Data":"41e216e5d21e1901b7ffd1dfa28810b026ebfcd13f54442f43a8db0a79b16b4c"}
Jul 20 18:22:48.468368 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:48.468330    2560 generic.go:356] "Generic (PLEG): container finished" podID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerID="8dfe0951885c3f58512deb5e5150132299556e09e48ee6e93bfc5c015a774c1b" exitCode=0
Jul 20 18:22:48.468810 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:48.468397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2" event={"ID":"43e1cd19-e359-47eb-89d3-87d5b2537a19","Type":"ContainerDied","Data":"8dfe0951885c3f58512deb5e5150132299556e09e48ee6e93bfc5c015a774c1b"}
Jul 20 18:22:49.474247 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:49.474209    2560 generic.go:356] "Generic (PLEG): container finished" podID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerID="96afc40ac0edd39c3c9ef5f7fc54db28fe0c293495727856335c87d948d67233" exitCode=0
Jul 20 18:22:49.474631 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:49.474265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2" event={"ID":"43e1cd19-e359-47eb-89d3-87d5b2537a19","Type":"ContainerDied","Data":"96afc40ac0edd39c3c9ef5f7fc54db28fe0c293495727856335c87d948d67233"}
Jul 20 18:22:50.606333 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.606306    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:50.632474 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.632430    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-bundle\") pod \"43e1cd19-e359-47eb-89d3-87d5b2537a19\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") "
Jul 20 18:22:50.632656 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.632521    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6xcb\" (UniqueName: \"kubernetes.io/projected/43e1cd19-e359-47eb-89d3-87d5b2537a19-kube-api-access-r6xcb\") pod \"43e1cd19-e359-47eb-89d3-87d5b2537a19\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") "
Jul 20 18:22:50.632656 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.632583    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-util\") pod \"43e1cd19-e359-47eb-89d3-87d5b2537a19\" (UID: \"43e1cd19-e359-47eb-89d3-87d5b2537a19\") "
Jul 20 18:22:50.633138 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.633112    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-bundle" (OuterVolumeSpecName: "bundle") pod "43e1cd19-e359-47eb-89d3-87d5b2537a19" (UID: "43e1cd19-e359-47eb-89d3-87d5b2537a19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:22:50.634738 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.634702    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43e1cd19-e359-47eb-89d3-87d5b2537a19-kube-api-access-r6xcb" (OuterVolumeSpecName: "kube-api-access-r6xcb") pod "43e1cd19-e359-47eb-89d3-87d5b2537a19" (UID: "43e1cd19-e359-47eb-89d3-87d5b2537a19"). InnerVolumeSpecName "kube-api-access-r6xcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:22:50.639147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.639113    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-util" (OuterVolumeSpecName: "util") pod "43e1cd19-e359-47eb-89d3-87d5b2537a19" (UID: "43e1cd19-e359-47eb-89d3-87d5b2537a19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:22:50.733300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.733211    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:50.733300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.733244    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6xcb\" (UniqueName: \"kubernetes.io/projected/43e1cd19-e359-47eb-89d3-87d5b2537a19-kube-api-access-r6xcb\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:50.733300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:50.733255    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e1cd19-e359-47eb-89d3-87d5b2537a19-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:22:51.489537 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:51.489511    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2"
Jul 20 18:22:51.492566 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:51.492529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6z9c2" event={"ID":"43e1cd19-e359-47eb-89d3-87d5b2537a19","Type":"ContainerDied","Data":"41e216e5d21e1901b7ffd1dfa28810b026ebfcd13f54442f43a8db0a79b16b4c"}
Jul 20 18:22:51.492698 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:51.492587    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41e216e5d21e1901b7ffd1dfa28810b026ebfcd13f54442f43a8db0a79b16b4c"
Jul 20 18:22:58.467875 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.467827    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"]
Jul 20 18:22:58.468396 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.468202    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerName="util"
Jul 20 18:22:58.468396 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.468214    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerName="util"
Jul 20 18:22:58.468396 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.468222    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerName="pull"
Jul 20 18:22:58.468396 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.468230    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerName="pull"
Jul 20 18:22:58.468396 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.468242    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerName="extract"
Jul 20 18:22:58.468396 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.468248    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerName="extract"
Jul 20 18:22:58.468396 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.468301    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="43e1cd19-e359-47eb-89d3-87d5b2537a19" containerName="extract"
Jul 20 18:22:58.471178 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.471161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.474242 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.474220    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 18:22:58.474502 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.474483    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 18:22:58.474591 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.474566    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gwrk8\""
Jul 20 18:22:58.474688 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.474670    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 18:22:58.474893 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.474878    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 18:22:58.486694 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.486661    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"]
Jul 20 18:22:58.494603 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.494572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f141b0ac-2466-4713-adcb-034bfa224f12-manifests\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.494777 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.494611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdtn\" (UniqueName: \"kubernetes.io/projected/f141b0ac-2466-4713-adcb-034bfa224f12-kube-api-access-qjdtn\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.494777 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.494699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f141b0ac-2466-4713-adcb-034bfa224f12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.494900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.494780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f141b0ac-2466-4713-adcb-034bfa224f12-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.494900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.494831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f141b0ac-2466-4713-adcb-034bfa224f12-tmp\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.595965 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.595929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f141b0ac-2466-4713-adcb-034bfa224f12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.595965 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.595971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f141b0ac-2466-4713-adcb-034bfa224f12-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.596213 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.595990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f141b0ac-2466-4713-adcb-034bfa224f12-tmp\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.596213 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.596034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f141b0ac-2466-4713-adcb-034bfa224f12-manifests\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.596213 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.596053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdtn\" (UniqueName: \"kubernetes.io/projected/f141b0ac-2466-4713-adcb-034bfa224f12-kube-api-access-qjdtn\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.596738 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.596705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f141b0ac-2466-4713-adcb-034bfa224f12-manifests\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.598574 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.598541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f141b0ac-2466-4713-adcb-034bfa224f12-tmp\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.598690 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.598678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f141b0ac-2466-4713-adcb-034bfa224f12-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.598796 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.598774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f141b0ac-2466-4713-adcb-034bfa224f12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.607790 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.607760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdtn\" (UniqueName: \"kubernetes.io/projected/f141b0ac-2466-4713-adcb-034bfa224f12-kube-api-access-qjdtn\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-sqdk5\" (UID: \"f141b0ac-2466-4713-adcb-034bfa224f12\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.782428 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.782329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:22:58.930661 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:58.930632    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"]
Jul 20 18:22:58.932857 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:22:58.932824    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf141b0ac_2466_4713_adcb_034bfa224f12.slice/crio-bad26998de2ac683f6f69313f19c5c2551f394951b27c06435954529515bb2b4 WatchSource:0}: Error finding container bad26998de2ac683f6f69313f19c5c2551f394951b27c06435954529515bb2b4: Status 404 returned error can't find the container with id bad26998de2ac683f6f69313f19c5c2551f394951b27c06435954529515bb2b4
Jul 20 18:22:59.531179 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:22:59.531137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5" event={"ID":"f141b0ac-2466-4713-adcb-034bfa224f12","Type":"ContainerStarted","Data":"bad26998de2ac683f6f69313f19c5c2551f394951b27c06435954529515bb2b4"}
Jul 20 18:23:02.549204 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:02.549133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5" event={"ID":"f141b0ac-2466-4713-adcb-034bfa224f12","Type":"ContainerStarted","Data":"679982061dc736fb5ddc0575f66360fe39a91f06a124bbe4bc49b42d80e75dca"}
Jul 20 18:23:03.554102 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:03.554024    2560 generic.go:356] "Generic (PLEG): container finished" podID="f141b0ac-2466-4713-adcb-034bfa224f12" containerID="679982061dc736fb5ddc0575f66360fe39a91f06a124bbe4bc49b42d80e75dca" exitCode=0
Jul 20 18:23:03.554102 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:03.554069    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5" event={"ID":"f141b0ac-2466-4713-adcb-034bfa224f12","Type":"ContainerDied","Data":"679982061dc736fb5ddc0575f66360fe39a91f06a124bbe4bc49b42d80e75dca"}
Jul 20 18:23:04.561223 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:04.561183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5" event={"ID":"f141b0ac-2466-4713-adcb-034bfa224f12","Type":"ContainerStarted","Data":"939f6bbdf88dacd9e14eda2ecd59c9ca3242c8d10f3e85ab02e294f1f8497bba"}
Jul 20 18:23:04.561636 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:04.561281    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:23:04.636384 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:04.636328    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5" podStartSLOduration=2.029691663 podStartE2EDuration="6.63630564s" totalImagesPullingTime="3.600989714s" totalInitContainerRuntime="1.005624263s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:22:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:04.633338291 +0000 UTC m=+581.869606707" watchObservedRunningTime="2026-07-20 18:23:04.63630564 +0000 UTC m=+581.872574056"
Jul 20 18:23:15.568258 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:15.568230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-sqdk5"
Jul 20 18:23:19.305363 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.305324    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qspx4"]
Jul 20 18:23:19.307918 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.307897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:19.310072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.310050    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 20 18:23:19.310161 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.310107    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xj2kq\""
Jul 20 18:23:19.327153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.327129    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qspx4"]
Jul 20 18:23:19.460191 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.460150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdrx\" (UniqueName: \"kubernetes.io/projected/228222fc-d919-4648-967d-135b37842334-kube-api-access-dxdrx\") pod \"odh-model-controller-7998c67dc4-qspx4\" (UID: \"228222fc-d919-4648-967d-135b37842334\") " pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:19.460361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.460216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/228222fc-d919-4648-967d-135b37842334-cert\") pod \"odh-model-controller-7998c67dc4-qspx4\" (UID: \"228222fc-d919-4648-967d-135b37842334\") " pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:19.560762 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.560659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdrx\" (UniqueName: \"kubernetes.io/projected/228222fc-d919-4648-967d-135b37842334-kube-api-access-dxdrx\") pod \"odh-model-controller-7998c67dc4-qspx4\" (UID: \"228222fc-d919-4648-967d-135b37842334\") " pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:19.560762 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.560724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/228222fc-d919-4648-967d-135b37842334-cert\") pod \"odh-model-controller-7998c67dc4-qspx4\" (UID: \"228222fc-d919-4648-967d-135b37842334\") " pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:19.560998 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:23:19.560852    2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 20 18:23:19.560998 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:23:19.560922    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/228222fc-d919-4648-967d-135b37842334-cert podName:228222fc-d919-4648-967d-135b37842334 nodeName:}" failed. No retries permitted until 2026-07-20 18:23:20.060898809 +0000 UTC m=+597.297167218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/228222fc-d919-4648-967d-135b37842334-cert") pod "odh-model-controller-7998c67dc4-qspx4" (UID: "228222fc-d919-4648-967d-135b37842334") : secret "odh-model-controller-webhook-cert" not found
Jul 20 18:23:19.575622 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.575577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdrx\" (UniqueName: \"kubernetes.io/projected/228222fc-d919-4648-967d-135b37842334-kube-api-access-dxdrx\") pod \"odh-model-controller-7998c67dc4-qspx4\" (UID: \"228222fc-d919-4648-967d-135b37842334\") " pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:19.909971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.909939    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"]
Jul 20 18:23:19.912366 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.912349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:19.915150 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.915114    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 18:23:19.915640 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.915618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bjg7w\""
Jul 20 18:23:19.915758 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.915645    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 18:23:19.924066 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:19.924044    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"]
Jul 20 18:23:20.066096 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.066065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7db8\" (UniqueName: \"kubernetes.io/projected/61212374-cc10-4872-8148-0f5353824115-kube-api-access-d7db8\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.066257 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.066122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/228222fc-d919-4648-967d-135b37842334-cert\") pod \"odh-model-controller-7998c67dc4-qspx4\" (UID: \"228222fc-d919-4648-967d-135b37842334\") " pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:20.066257 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.066209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61212374-cc10-4872-8148-0f5353824115-tls-certs\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.066325 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.066266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61212374-cc10-4872-8148-0f5353824115-tmp\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.068609 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.068583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/228222fc-d919-4648-967d-135b37842334-cert\") pod \"odh-model-controller-7998c67dc4-qspx4\" (UID: \"228222fc-d919-4648-967d-135b37842334\") " pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:20.167419 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.167323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7db8\" (UniqueName: \"kubernetes.io/projected/61212374-cc10-4872-8148-0f5353824115-kube-api-access-d7db8\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.167601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.167421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61212374-cc10-4872-8148-0f5353824115-tls-certs\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.167601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.167477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61212374-cc10-4872-8148-0f5353824115-tmp\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.170722 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.170669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61212374-cc10-4872-8148-0f5353824115-tls-certs\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.171076 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.171054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61212374-cc10-4872-8148-0f5353824115-tmp\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.185327 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.185301    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7mb72"]
Jul 20 18:23:20.186329 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.186298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7db8\" (UniqueName: \"kubernetes.io/projected/61212374-cc10-4872-8148-0f5353824115-kube-api-access-d7db8\") pod \"kube-auth-proxy-7596f649d-4rxdz\" (UID: \"61212374-cc10-4872-8148-0f5353824115\") " pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.187693 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.187676    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:20.190129 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.190112    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 20 18:23:20.202894 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.202872    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7mb72"]
Jul 20 18:23:20.217017 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.216995    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:20.225640 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.225358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"
Jul 20 18:23:20.269706 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.268823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwmrp\" (UniqueName: \"kubernetes.io/projected/795e01de-1725-44d9-bd3a-669dd10cff70-kube-api-access-zwmrp\") pod \"model-serving-api-54d89bd5fc-7mb72\" (UID: \"795e01de-1725-44d9-bd3a-669dd10cff70\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:20.269706 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.268901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/795e01de-1725-44d9-bd3a-669dd10cff70-tls-certs\") pod \"model-serving-api-54d89bd5fc-7mb72\" (UID: \"795e01de-1725-44d9-bd3a-669dd10cff70\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:20.370118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.370076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwmrp\" (UniqueName: \"kubernetes.io/projected/795e01de-1725-44d9-bd3a-669dd10cff70-kube-api-access-zwmrp\") pod \"model-serving-api-54d89bd5fc-7mb72\" (UID: \"795e01de-1725-44d9-bd3a-669dd10cff70\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:20.370634 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.370151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/795e01de-1725-44d9-bd3a-669dd10cff70-tls-certs\") pod \"model-serving-api-54d89bd5fc-7mb72\" (UID: \"795e01de-1725-44d9-bd3a-669dd10cff70\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:20.370634 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:23:20.370340    2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 20 18:23:20.370634 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:23:20.370406    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/795e01de-1725-44d9-bd3a-669dd10cff70-tls-certs podName:795e01de-1725-44d9-bd3a-669dd10cff70 nodeName:}" failed. No retries permitted until 2026-07-20 18:23:20.870384247 +0000 UTC m=+598.106652647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/795e01de-1725-44d9-bd3a-669dd10cff70-tls-certs") pod "model-serving-api-54d89bd5fc-7mb72" (UID: "795e01de-1725-44d9-bd3a-669dd10cff70") : secret "model-serving-api-tls" not found
Jul 20 18:23:20.377794 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.377770    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qspx4"]
Jul 20 18:23:20.380888 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:23:20.380845    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228222fc_d919_4648_967d_135b37842334.slice/crio-a26fc8be21c6595fc737190daed161a3368fe2dd091f2546999f4c2b426d40c8 WatchSource:0}: Error finding container a26fc8be21c6595fc737190daed161a3368fe2dd091f2546999f4c2b426d40c8: Status 404 returned error can't find the container with id a26fc8be21c6595fc737190daed161a3368fe2dd091f2546999f4c2b426d40c8
Jul 20 18:23:20.383106 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.383055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwmrp\" (UniqueName: \"kubernetes.io/projected/795e01de-1725-44d9-bd3a-669dd10cff70-kube-api-access-zwmrp\") pod \"model-serving-api-54d89bd5fc-7mb72\" (UID: \"795e01de-1725-44d9-bd3a-669dd10cff70\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:20.400782 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.400761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7596f649d-4rxdz"]
Jul 20 18:23:20.402364 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:23:20.402337    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61212374_cc10_4872_8148_0f5353824115.slice/crio-8f79ab1b7ffbf5bfe0f6e31faa81bffc55cb08bb22e7012c07fbad55dc506cc7 WatchSource:0}: Error finding container 8f79ab1b7ffbf5bfe0f6e31faa81bffc55cb08bb22e7012c07fbad55dc506cc7: Status 404 returned error can't find the container with id 8f79ab1b7ffbf5bfe0f6e31faa81bffc55cb08bb22e7012c07fbad55dc506cc7
Jul 20 18:23:20.634263 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.634227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qspx4" event={"ID":"228222fc-d919-4648-967d-135b37842334","Type":"ContainerStarted","Data":"a26fc8be21c6595fc737190daed161a3368fe2dd091f2546999f4c2b426d40c8"}
Jul 20 18:23:20.635486 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.635460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz" event={"ID":"61212374-cc10-4872-8148-0f5353824115","Type":"ContainerStarted","Data":"8f79ab1b7ffbf5bfe0f6e31faa81bffc55cb08bb22e7012c07fbad55dc506cc7"}
Jul 20 18:23:20.873689 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.873655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/795e01de-1725-44d9-bd3a-669dd10cff70-tls-certs\") pod \"model-serving-api-54d89bd5fc-7mb72\" (UID: \"795e01de-1725-44d9-bd3a-669dd10cff70\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:20.876418 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.876355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/795e01de-1725-44d9-bd3a-669dd10cff70-tls-certs\") pod \"model-serving-api-54d89bd5fc-7mb72\" (UID: \"795e01de-1725-44d9-bd3a-669dd10cff70\") " pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:20.974804 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.974719    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"]
Jul 20 18:23:20.978572 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.978546    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:20.980779 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.980756    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 18:23:20.980892 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.980811    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 18:23:20.981015 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.980994    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 18:23:20.981091 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.981072    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 18:23:20.981091 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.981087    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c5z5w\""
Jul 20 18:23:20.991005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:20.990986    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"]
Jul 20 18:23:21.074921 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.074889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.075107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.074928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-cacerts\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.075107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.074967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.075107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.074994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2r5s\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-kube-api-access-s2r5s\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.075107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.075039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.075107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.075089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2da9556-b666-4cc9-a20e-d02908071126-local-certs\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.075306 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.075129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-istio-token\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.101559 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.101534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:21.176307 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.176276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.176495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.176330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2da9556-b666-4cc9-a20e-d02908071126-local-certs\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.176495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.176368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-istio-token\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.176495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.176428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.176495 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.176472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-cacerts\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.176715 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.176516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.176715 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.176543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r5s\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-kube-api-access-s2r5s\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.177025 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.177005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.179882 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.179838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2da9556-b666-4cc9-a20e-d02908071126-local-certs\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.179978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.179901    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-cacerts\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.180044 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.179988    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.180191 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.180164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.184260 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.184236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-istio-token\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.185226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.185198    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2r5s\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-kube-api-access-s2r5s\") pod \"istiod-openshift-gateway-7574459656-64jp5\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.248328 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.248299    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7mb72"]
Jul 20 18:23:21.251391 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:23:21.251351    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795e01de_1725_44d9_bd3a_669dd10cff70.slice/crio-9875ebe377fa2655887f5b39af4de69661807efe65cf21976acb955e6285fc41 WatchSource:0}: Error finding container 9875ebe377fa2655887f5b39af4de69661807efe65cf21976acb955e6285fc41: Status 404 returned error can't find the container with id 9875ebe377fa2655887f5b39af4de69661807efe65cf21976acb955e6285fc41
Jul 20 18:23:21.287838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.287810    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:21.481344 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.481275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"]
Jul 20 18:23:21.491641 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:23:21.491609    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2da9556_b666_4cc9_a20e_d02908071126.slice/crio-0f1ea1bd6e7ee3e06939445cd8f196aab43d832632b385d20d6945ff2fb67d11 WatchSource:0}: Error finding container 0f1ea1bd6e7ee3e06939445cd8f196aab43d832632b385d20d6945ff2fb67d11: Status 404 returned error can't find the container with id 0f1ea1bd6e7ee3e06939445cd8f196aab43d832632b385d20d6945ff2fb67d11
Jul 20 18:23:21.648025 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.647986    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5" event={"ID":"a2da9556-b666-4cc9-a20e-d02908071126","Type":"ContainerStarted","Data":"0f1ea1bd6e7ee3e06939445cd8f196aab43d832632b385d20d6945ff2fb67d11"}
Jul 20 18:23:21.650681 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:21.650653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7mb72" event={"ID":"795e01de-1725-44d9-bd3a-669dd10cff70","Type":"ContainerStarted","Data":"9875ebe377fa2655887f5b39af4de69661807efe65cf21976acb955e6285fc41"}
Jul 20 18:23:26.231481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.231458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 18:23:26.242184 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.241787    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:23:26.242184 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.241862    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:23:26.683013 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.682979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5" event={"ID":"a2da9556-b666-4cc9-a20e-d02908071126","Type":"ContainerStarted","Data":"92cf8ca522ea69c9e608674a161414f02ec92f5483815b330d2dcb4cea512424"}
Jul 20 18:23:26.683193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.683056    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:26.684570 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.684543    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7mb72" event={"ID":"795e01de-1725-44d9-bd3a-669dd10cff70","Type":"ContainerStarted","Data":"794b9499f758aad0d954e859e17610d2161732fe154b7b88df4b0d15fc1e51bf"}
Jul 20 18:23:26.684719 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.684612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:23:26.685963 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.685933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qspx4" event={"ID":"228222fc-d919-4648-967d-135b37842334","Type":"ContainerStarted","Data":"acb8188f9734a5949f30cbd66859dc2fa1a796f04ba9a768e6c12d6412222bd7"}
Jul 20 18:23:26.686107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.686009    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:26.687312 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.687293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz" event={"ID":"61212374-cc10-4872-8148-0f5353824115","Type":"ContainerStarted","Data":"56904517785f44fc18f402933fd3728cc2f93ad70a369e48253ab0792dcc4611"}
Jul 20 18:23:26.729553 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.729498    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5" podStartSLOduration=1.982333696 podStartE2EDuration="6.729481217s" totalImagesPullingTime="4.747147521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:26.725582012 +0000 UTC m=+603.961850428" watchObservedRunningTime="2026-07-20 18:23:26.729481217 +0000 UTC m=+603.965749633"
Jul 20 18:23:26.763682 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.763598    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qspx4" podStartSLOduration=1.91759379 podStartE2EDuration="7.763564559s" totalImagesPullingTime="5.845970769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:26.761292486 +0000 UTC m=+603.997560902" watchObservedRunningTime="2026-07-20 18:23:26.763564559 +0000 UTC m=+603.999832975"
Jul 20 18:23:26.819789 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.819715    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7mb72" podStartSLOduration=1.845050238 podStartE2EDuration="6.819696106s" totalImagesPullingTime="4.974645868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:26.818286949 +0000 UTC m=+604.054555363" watchObservedRunningTime="2026-07-20 18:23:26.819696106 +0000 UTC m=+604.055964524"
Jul 20 18:23:26.858953 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:26.858873    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7596f649d-4rxdz" podStartSLOduration=2.034270867 podStartE2EDuration="7.85885359s" totalImagesPullingTime="5.824582723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:26.857735165 +0000 UTC m=+604.094003581" watchObservedRunningTime="2026-07-20 18:23:26.85885359 +0000 UTC m=+604.095122006"
Jul 20 18:23:27.489401 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.489367    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"]
Jul 20 18:23:27.492896 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.492877    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.495236 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.495214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vzrwp\""
Jul 20 18:23:27.506230 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.506199    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"]
Jul 20 18:23:27.645634 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.645797 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.645797 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.645797 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.645797 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.645959 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.645959 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.645959 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.645959 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.645947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvj2z\" (UniqueName: \"kubernetes.io/projected/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-kube-api-access-qvj2z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.694002 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.693975    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:27.747085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvj2z\" (UniqueName: \"kubernetes.io/projected/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-kube-api-access-qvj2z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.747733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.748033 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.747926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.748139 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.748034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.748139 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.748109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.748256 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.748144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.749914 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.749893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.750029 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.749971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.766963 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.766937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.767131 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.767099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvj2z\" (UniqueName: \"kubernetes.io/projected/d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e-kube-api-access-qvj2z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hlfwq\" (UID: \"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.803014 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.802992    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:27.939911 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:27.939886    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"]
Jul 20 18:23:27.941929 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:23:27.941901    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39a6b5f_cebb_47b8_89e7_0e91ae1fdd7e.slice/crio-f091cc4547a8dfa79ee4832f3dfffd78f3acb7b09da9745f787519b29033e403 WatchSource:0}: Error finding container f091cc4547a8dfa79ee4832f3dfffd78f3acb7b09da9745f787519b29033e403: Status 404 returned error can't find the container with id f091cc4547a8dfa79ee4832f3dfffd78f3acb7b09da9745f787519b29033e403
Jul 20 18:23:28.699268 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:28.699227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq" event={"ID":"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e","Type":"ContainerStarted","Data":"f091cc4547a8dfa79ee4832f3dfffd78f3acb7b09da9745f787519b29033e403"}
Jul 20 18:23:30.661372 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.661316    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:23:30.661704 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.661418    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:23:30.661704 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.661479    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:23:30.748986 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.748961    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"]
Jul 20 18:23:30.752422 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.752402    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:30.755789 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.755762    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"]
Jul 20 18:23:30.756072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.756051    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 20 18:23:30.756252 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.756230    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4qqh8\""
Jul 20 18:23:30.759304 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.759287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:30.762246 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.762172    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 20 18:23:30.765547 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.765523    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bccxm\""
Jul 20 18:23:30.767565 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.767545    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"]
Jul 20 18:23:30.773178 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.773154    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"]
Jul 20 18:23:30.874693 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.874657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e337b21-7026-42e8-98f2-f11f60e7a982-cert\") pod \"kserve-controller-manager-d6f4b65b8-5t9vc\" (UID: \"7e337b21-7026-42e8-98f2-f11f60e7a982\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:30.874881 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.874713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fts9p\" (UID: \"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:30.874881 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.874806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97lzm\" (UniqueName: \"kubernetes.io/projected/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-kube-api-access-97lzm\") pod \"llmisvc-controller-manager-777c6bd7d5-fts9p\" (UID: \"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:30.874881 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.874874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26rp\" (UniqueName: \"kubernetes.io/projected/7e337b21-7026-42e8-98f2-f11f60e7a982-kube-api-access-k26rp\") pod \"kserve-controller-manager-d6f4b65b8-5t9vc\" (UID: \"7e337b21-7026-42e8-98f2-f11f60e7a982\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:30.975813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.975734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fts9p\" (UID: \"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:30.975813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.975783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97lzm\" (UniqueName: \"kubernetes.io/projected/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-kube-api-access-97lzm\") pod \"llmisvc-controller-manager-777c6bd7d5-fts9p\" (UID: \"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:30.976024 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.975823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k26rp\" (UniqueName: \"kubernetes.io/projected/7e337b21-7026-42e8-98f2-f11f60e7a982-kube-api-access-k26rp\") pod \"kserve-controller-manager-d6f4b65b8-5t9vc\" (UID: \"7e337b21-7026-42e8-98f2-f11f60e7a982\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:30.976024 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:23:30.975873    2560 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 20 18:23:30.976024 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.975888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e337b21-7026-42e8-98f2-f11f60e7a982-cert\") pod \"kserve-controller-manager-d6f4b65b8-5t9vc\" (UID: \"7e337b21-7026-42e8-98f2-f11f60e7a982\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:30.976024 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:23:30.975933    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-cert podName:1b84c36a-da20-4bd9-9de5-0b0190dd7ebe nodeName:}" failed. No retries permitted until 2026-07-20 18:23:31.475914392 +0000 UTC m=+608.712182785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-cert") pod "llmisvc-controller-manager-777c6bd7d5-fts9p" (UID: "1b84c36a-da20-4bd9-9de5-0b0190dd7ebe") : secret "llmisvc-webhook-server-cert" not found
Jul 20 18:23:30.978432 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:30.978406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e337b21-7026-42e8-98f2-f11f60e7a982-cert\") pod \"kserve-controller-manager-d6f4b65b8-5t9vc\" (UID: \"7e337b21-7026-42e8-98f2-f11f60e7a982\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:31.004202 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.004173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97lzm\" (UniqueName: \"kubernetes.io/projected/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-kube-api-access-97lzm\") pod \"llmisvc-controller-manager-777c6bd7d5-fts9p\" (UID: \"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:31.010258 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.010236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26rp\" (UniqueName: \"kubernetes.io/projected/7e337b21-7026-42e8-98f2-f11f60e7a982-kube-api-access-k26rp\") pod \"kserve-controller-manager-d6f4b65b8-5t9vc\" (UID: \"7e337b21-7026-42e8-98f2-f11f60e7a982\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:31.065500 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.065477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:31.209359 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.209336    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"]
Jul 20 18:23:31.211659 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:23:31.211632    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e337b21_7026_42e8_98f2_f11f60e7a982.slice/crio-7030775fdff4277fc78417e74b93b8ac02dee480871b7606d150a86cf7b01383 WatchSource:0}: Error finding container 7030775fdff4277fc78417e74b93b8ac02dee480871b7606d150a86cf7b01383: Status 404 returned error can't find the container with id 7030775fdff4277fc78417e74b93b8ac02dee480871b7606d150a86cf7b01383
Jul 20 18:23:31.480468 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.480420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fts9p\" (UID: \"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:31.483241 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.483219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84c36a-da20-4bd9-9de5-0b0190dd7ebe-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fts9p\" (UID: \"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:31.674505 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.674477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:31.716917 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.716881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc" event={"ID":"7e337b21-7026-42e8-98f2-f11f60e7a982","Type":"ContainerStarted","Data":"7030775fdff4277fc78417e74b93b8ac02dee480871b7606d150a86cf7b01383"}
Jul 20 18:23:31.719062 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.719032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq" event={"ID":"d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e","Type":"ContainerStarted","Data":"1cd5317fe5c466613947dfd442aab5ad0606e61bbee15dfe98039b72801ed03d"}
Jul 20 18:23:31.756963 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.756900    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq" podStartSLOduration=2.039774735 podStartE2EDuration="4.756876885s" totalImagesPullingTime="2.71710215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:31.755152984 +0000 UTC m=+608.991421397" watchObservedRunningTime="2026-07-20 18:23:31.756876885 +0000 UTC m=+608.993145304"
Jul 20 18:23:31.803332 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.803298    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:31.808290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.808264    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:31.833425 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:31.831079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"]
Jul 20 18:23:32.728742 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:32.728706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p" event={"ID":"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe","Type":"ContainerStarted","Data":"8d01bd4d3721d78f79493455586df211c36f9f50995a7eea3a906b1ea499286a"}
Jul 20 18:23:32.729278 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:32.728768    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:32.729809 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:32.729786    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hlfwq"
Jul 20 18:23:33.496269 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:33.496232    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"]
Jul 20 18:23:33.496541 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:33.496504    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5" podUID="a2da9556-b666-4cc9-a20e-d02908071126" containerName="discovery" containerID="cri-o://92cf8ca522ea69c9e608674a161414f02ec92f5483815b330d2dcb4cea512424" gracePeriod=30
Jul 20 18:23:33.692400 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:33.692364    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-64jp5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:8080/ready\": dial tcp 10.132.0.32:8080: connect: connection refused" start-of-body=
Jul 20 18:23:33.692586 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:33.692431    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5" podUID="a2da9556-b666-4cc9-a20e-d02908071126" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.32:8080/ready\": dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 20 18:23:33.737281 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:33.737247    2560 generic.go:356] "Generic (PLEG): container finished" podID="a2da9556-b666-4cc9-a20e-d02908071126" containerID="92cf8ca522ea69c9e608674a161414f02ec92f5483815b330d2dcb4cea512424" exitCode=0
Jul 20 18:23:33.737756 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:33.737333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5" event={"ID":"a2da9556-b666-4cc9-a20e-d02908071126","Type":"ContainerDied","Data":"92cf8ca522ea69c9e608674a161414f02ec92f5483815b330d2dcb4cea512424"}
Jul 20 18:23:33.935131 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:33.935104    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:34.008466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.007525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2r5s\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-kube-api-access-s2r5s\") pod \"a2da9556-b666-4cc9-a20e-d02908071126\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") "
Jul 20 18:23:34.008466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.007589    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-ca-configmap\") pod \"a2da9556-b666-4cc9-a20e-d02908071126\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") "
Jul 20 18:23:34.008466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.007635    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-kubeconfig\") pod \"a2da9556-b666-4cc9-a20e-d02908071126\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") "
Jul 20 18:23:34.008466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.007690    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2da9556-b666-4cc9-a20e-d02908071126-local-certs\") pod \"a2da9556-b666-4cc9-a20e-d02908071126\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") "
Jul 20 18:23:34.008466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.007721    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-cacerts\") pod \"a2da9556-b666-4cc9-a20e-d02908071126\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") "
Jul 20 18:23:34.008466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.007752    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-istio-token\") pod \"a2da9556-b666-4cc9-a20e-d02908071126\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") "
Jul 20 18:23:34.008466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.007796    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-dns-cert\") pod \"a2da9556-b666-4cc9-a20e-d02908071126\" (UID: \"a2da9556-b666-4cc9-a20e-d02908071126\") "
Jul 20 18:23:34.008466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.008048    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a2da9556-b666-4cc9-a20e-d02908071126" (UID: "a2da9556-b666-4cc9-a20e-d02908071126"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:23:34.011160 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.011134    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a2da9556-b666-4cc9-a20e-d02908071126" (UID: "a2da9556-b666-4cc9-a20e-d02908071126"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:23:34.011491 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.011471    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-kube-api-access-s2r5s" (OuterVolumeSpecName: "kube-api-access-s2r5s") pod "a2da9556-b666-4cc9-a20e-d02908071126" (UID: "a2da9556-b666-4cc9-a20e-d02908071126"). InnerVolumeSpecName "kube-api-access-s2r5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:23:34.011964 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.011933    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-cacerts" (OuterVolumeSpecName: "cacerts") pod "a2da9556-b666-4cc9-a20e-d02908071126" (UID: "a2da9556-b666-4cc9-a20e-d02908071126"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:23:34.012147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.012055    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a2da9556-b666-4cc9-a20e-d02908071126" (UID: "a2da9556-b666-4cc9-a20e-d02908071126"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:23:34.012357 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.012336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2da9556-b666-4cc9-a20e-d02908071126-local-certs" (OuterVolumeSpecName: "local-certs") pod "a2da9556-b666-4cc9-a20e-d02908071126" (UID: "a2da9556-b666-4cc9-a20e-d02908071126"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:23:34.012427 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.012337    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2da9556-b666-4cc9-a20e-d02908071126" (UID: "a2da9556-b666-4cc9-a20e-d02908071126"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:23:34.108740 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.108663    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2da9556-b666-4cc9-a20e-d02908071126-local-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:23:34.108740 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.108694    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-cacerts\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:23:34.108740 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.108707    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:23:34.108740 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.108721    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-dns-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:23:34.108740 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.108736    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2r5s\" (UniqueName: \"kubernetes.io/projected/a2da9556-b666-4cc9-a20e-d02908071126-kube-api-access-s2r5s\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:23:34.109019 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.108750    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a2da9556-b666-4cc9-a20e-d02908071126-istio-csr-ca-configmap\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:23:34.109019 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.108763    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2da9556-b666-4cc9-a20e-d02908071126-istio-kubeconfig\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:23:34.743521 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.743495    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"
Jul 20 18:23:34.743876 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.743546    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-64jp5" event={"ID":"a2da9556-b666-4cc9-a20e-d02908071126","Type":"ContainerDied","Data":"0f1ea1bd6e7ee3e06939445cd8f196aab43d832632b385d20d6945ff2fb67d11"}
Jul 20 18:23:34.743876 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.743603    2560 scope.go:117] "RemoveContainer" containerID="92cf8ca522ea69c9e608674a161414f02ec92f5483815b330d2dcb4cea512424"
Jul 20 18:23:34.766784 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.766762    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"]
Jul 20 18:23:34.771026 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:34.771002    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-64jp5"]
Jul 20 18:23:35.491793 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:35.491756    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2da9556-b666-4cc9-a20e-d02908071126" path="/var/lib/kubelet/pods/a2da9556-b666-4cc9-a20e-d02908071126/volumes"
Jul 20 18:23:35.751171 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:35.751103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc" event={"ID":"7e337b21-7026-42e8-98f2-f11f60e7a982","Type":"ContainerStarted","Data":"ed74c8d13dbf9ff9693820d4f30d0ba7b8d6987fac23004a67d9f7bbe8315538"}
Jul 20 18:23:35.751549 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:35.751189    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:23:35.752571 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:35.752550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p" event={"ID":"1b84c36a-da20-4bd9-9de5-0b0190dd7ebe","Type":"ContainerStarted","Data":"5a81f0b43151c0a2fae6d8b122d844afef5af64491dd3d7112705470d39c6835"}
Jul 20 18:23:35.752683 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:35.752669    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:23:35.768596 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:35.768561    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc" podStartSLOduration=2.278520521 podStartE2EDuration="5.768547076s" totalImagesPullingTime="3.490026555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:35.766826637 +0000 UTC m=+613.003095053" watchObservedRunningTime="2026-07-20 18:23:35.768547076 +0000 UTC m=+613.004815493"
Jul 20 18:23:35.782856 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:35.782817    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p" podStartSLOduration=2.056842461 podStartE2EDuration="5.782806218s" totalImagesPullingTime="3.725963757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:35.781216457 +0000 UTC m=+613.017484872" watchObservedRunningTime="2026-07-20 18:23:35.782806218 +0000 UTC m=+613.019074649"
Jul 20 18:23:37.694585 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:37.694554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qspx4"
Jul 20 18:23:37.697507 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:23:37.697489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7mb72"
Jul 20 18:24:06.761787 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:06.761712    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fts9p"
Jul 20 18:24:06.764765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:06.764745    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5t9vc"
Jul 20 18:24:19.645639 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.645608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j548"]
Jul 20 18:24:19.646009 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.645933    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2da9556-b666-4cc9-a20e-d02908071126" containerName="discovery"
Jul 20 18:24:19.646009 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.645943    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2da9556-b666-4cc9-a20e-d02908071126" containerName="discovery"
Jul 20 18:24:19.646009 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.646001    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2da9556-b666-4cc9-a20e-d02908071126" containerName="discovery"
Jul 20 18:24:19.647876 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.647858    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4j548"
Jul 20 18:24:19.650316 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.650293    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 18:24:19.650470 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.650299    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-7wp9c\""
Jul 20 18:24:19.650567 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.650551    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 18:24:19.657731 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.657709    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j548"]
Jul 20 18:24:19.762953 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.762918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjzr6\" (UniqueName: \"kubernetes.io/projected/96288d19-72ed-480a-9956-e2a8db3906ef-kube-api-access-fjzr6\") pod \"kuadrant-operator-catalog-4j548\" (UID: \"96288d19-72ed-480a-9956-e2a8db3906ef\") " pod="kuadrant-system/kuadrant-operator-catalog-4j548"
Jul 20 18:24:19.863938 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.863907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjzr6\" (UniqueName: \"kubernetes.io/projected/96288d19-72ed-480a-9956-e2a8db3906ef-kube-api-access-fjzr6\") pod \"kuadrant-operator-catalog-4j548\" (UID: \"96288d19-72ed-480a-9956-e2a8db3906ef\") " pod="kuadrant-system/kuadrant-operator-catalog-4j548"
Jul 20 18:24:19.872380 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.872352    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjzr6\" (UniqueName: \"kubernetes.io/projected/96288d19-72ed-480a-9956-e2a8db3906ef-kube-api-access-fjzr6\") pod \"kuadrant-operator-catalog-4j548\" (UID: \"96288d19-72ed-480a-9956-e2a8db3906ef\") " pod="kuadrant-system/kuadrant-operator-catalog-4j548"
Jul 20 18:24:19.959778 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:19.959694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4j548"
Jul 20 18:24:20.003404 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.003366    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j548"]
Jul 20 18:24:20.090962 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.090935    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j548"]
Jul 20 18:24:20.093282 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:24:20.093257    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96288d19_72ed_480a_9956_e2a8db3906ef.slice/crio-cd5e9cfaa30d2f1621121b85c69c24ccbba0e2d9818c0c811f8dfca710bd3527 WatchSource:0}: Error finding container cd5e9cfaa30d2f1621121b85c69c24ccbba0e2d9818c0c811f8dfca710bd3527: Status 404 returned error can't find the container with id cd5e9cfaa30d2f1621121b85c69c24ccbba0e2d9818c0c811f8dfca710bd3527
Jul 20 18:24:20.213679 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.213612    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m7sb4"]
Jul 20 18:24:20.216523 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.216508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:20.224923 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.224898    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m7sb4"]
Jul 20 18:24:20.369039 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.369008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9kgr\" (UniqueName: \"kubernetes.io/projected/98eaba12-6239-43d2-a800-f881b9ca5f92-kube-api-access-n9kgr\") pod \"kuadrant-operator-catalog-m7sb4\" (UID: \"98eaba12-6239-43d2-a800-f881b9ca5f92\") " pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:20.469776 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.469706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9kgr\" (UniqueName: \"kubernetes.io/projected/98eaba12-6239-43d2-a800-f881b9ca5f92-kube-api-access-n9kgr\") pod \"kuadrant-operator-catalog-m7sb4\" (UID: \"98eaba12-6239-43d2-a800-f881b9ca5f92\") " pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:20.478409 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.478380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9kgr\" (UniqueName: \"kubernetes.io/projected/98eaba12-6239-43d2-a800-f881b9ca5f92-kube-api-access-n9kgr\") pod \"kuadrant-operator-catalog-m7sb4\" (UID: \"98eaba12-6239-43d2-a800-f881b9ca5f92\") " pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:20.526614 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.526592    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:20.671981 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.671947    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m7sb4"]
Jul 20 18:24:20.748267 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:24:20.748199    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98eaba12_6239_43d2_a800_f881b9ca5f92.slice/crio-35662fe93840ec3407f7f19d7d678dbaeeb7dbb470a6a48db0cd442be77cd326 WatchSource:0}: Error finding container 35662fe93840ec3407f7f19d7d678dbaeeb7dbb470a6a48db0cd442be77cd326: Status 404 returned error can't find the container with id 35662fe93840ec3407f7f19d7d678dbaeeb7dbb470a6a48db0cd442be77cd326
Jul 20 18:24:20.967108 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.967073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4" event={"ID":"98eaba12-6239-43d2-a800-f881b9ca5f92","Type":"ContainerStarted","Data":"35662fe93840ec3407f7f19d7d678dbaeeb7dbb470a6a48db0cd442be77cd326"}
Jul 20 18:24:20.968388 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:20.968353    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4j548" event={"ID":"96288d19-72ed-480a-9956-e2a8db3906ef","Type":"ContainerStarted","Data":"cd5e9cfaa30d2f1621121b85c69c24ccbba0e2d9818c0c811f8dfca710bd3527"}
Jul 20 18:24:22.980556 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:22.980508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4" event={"ID":"98eaba12-6239-43d2-a800-f881b9ca5f92","Type":"ContainerStarted","Data":"4f267000116ea439fb9d7d868b0319c951a26d153fb6f0327f08465f64330f28"}
Jul 20 18:24:22.982076 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:22.982050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4j548" event={"ID":"96288d19-72ed-480a-9956-e2a8db3906ef","Type":"ContainerStarted","Data":"e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b"}
Jul 20 18:24:22.982204 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:22.982146    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4j548" podUID="96288d19-72ed-480a-9956-e2a8db3906ef" containerName="registry-server" containerID="cri-o://e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b" gracePeriod=2
Jul 20 18:24:22.997559 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:22.997513    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4" podStartSLOduration=1.381535102 podStartE2EDuration="2.997494764s" totalImagesPullingTime="1.615959662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:24:22.994526638 +0000 UTC m=+660.230795056" watchObservedRunningTime="2026-07-20 18:24:22.997494764 +0000 UTC m=+660.233763180"
Jul 20 18:24:23.010548 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.010505    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4j548" podStartSLOduration=1.758650934 podStartE2EDuration="4.010491997s" totalImagesPullingTime="2.251841063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:24:23.00866369 +0000 UTC m=+660.244932105" watchObservedRunningTime="2026-07-20 18:24:23.010491997 +0000 UTC m=+660.246760412"
Jul 20 18:24:23.223343 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.223321    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4j548"
Jul 20 18:24:23.393417 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.393389    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjzr6\" (UniqueName: \"kubernetes.io/projected/96288d19-72ed-480a-9956-e2a8db3906ef-kube-api-access-fjzr6\") pod \"96288d19-72ed-480a-9956-e2a8db3906ef\" (UID: \"96288d19-72ed-480a-9956-e2a8db3906ef\") "
Jul 20 18:24:23.395493 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.395470    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96288d19-72ed-480a-9956-e2a8db3906ef-kube-api-access-fjzr6" (OuterVolumeSpecName: "kube-api-access-fjzr6") pod "96288d19-72ed-480a-9956-e2a8db3906ef" (UID: "96288d19-72ed-480a-9956-e2a8db3906ef"). InnerVolumeSpecName "kube-api-access-fjzr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:24:23.494737 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.494715    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjzr6\" (UniqueName: \"kubernetes.io/projected/96288d19-72ed-480a-9956-e2a8db3906ef-kube-api-access-fjzr6\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:23.988104 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.988069    2560 generic.go:356] "Generic (PLEG): container finished" podID="96288d19-72ed-480a-9956-e2a8db3906ef" containerID="e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b" exitCode=0
Jul 20 18:24:23.988610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.988114    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4j548"
Jul 20 18:24:23.988610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.988153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4j548" event={"ID":"96288d19-72ed-480a-9956-e2a8db3906ef","Type":"ContainerDied","Data":"e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b"}
Jul 20 18:24:23.988610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.988211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4j548" event={"ID":"96288d19-72ed-480a-9956-e2a8db3906ef","Type":"ContainerDied","Data":"cd5e9cfaa30d2f1621121b85c69c24ccbba0e2d9818c0c811f8dfca710bd3527"}
Jul 20 18:24:23.988610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.988236    2560 scope.go:117] "RemoveContainer" containerID="e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b"
Jul 20 18:24:23.997563 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.997546    2560 scope.go:117] "RemoveContainer" containerID="e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b"
Jul 20 18:24:23.997818 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:24:23.997795    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b\": container with ID starting with e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b not found: ID does not exist" containerID="e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b"
Jul 20 18:24:23.997897 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:23.997826    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b"} err="failed to get container status \"e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b\": rpc error: code = NotFound desc = could not find container \"e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b\": container with ID starting with e65d64502bb19bfc06cbf6b8506aacb9754f7b2b7b00a53f6920aa3ed7d86e7b not found: ID does not exist"
Jul 20 18:24:24.005219 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:24.005197    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j548"]
Jul 20 18:24:24.009015 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:24.008995    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j548"]
Jul 20 18:24:25.488357 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:25.488320    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96288d19-72ed-480a-9956-e2a8db3906ef" path="/var/lib/kubelet/pods/96288d19-72ed-480a-9956-e2a8db3906ef/volumes"
Jul 20 18:24:30.527000 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:30.526969    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:30.527395 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:30.527034    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:30.549533 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:30.549503    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:31.044134 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:31.044109    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-m7sb4"
Jul 20 18:24:35.055123 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.055086    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"]
Jul 20 18:24:35.055511 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.055460    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96288d19-72ed-480a-9956-e2a8db3906ef" containerName="registry-server"
Jul 20 18:24:35.055511 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.055473    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="96288d19-72ed-480a-9956-e2a8db3906ef" containerName="registry-server"
Jul 20 18:24:35.055588 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.055539    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="96288d19-72ed-480a-9956-e2a8db3906ef" containerName="registry-server"
Jul 20 18:24:35.060207 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.060185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.063487 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.063469    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xx5n8\""
Jul 20 18:24:35.071193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.071170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"]
Jul 20 18:24:35.183134 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.183110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.183298 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.183141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q58ll\" (UniqueName: \"kubernetes.io/projected/c4e89309-80e9-4a64-a717-0d3d35ac9a02-kube-api-access-q58ll\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.183298 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.183183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.284329 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.284234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.284496 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.284366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q58ll\" (UniqueName: \"kubernetes.io/projected/c4e89309-80e9-4a64-a717-0d3d35ac9a02-kube-api-access-q58ll\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.284496 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.284465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.284610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.284552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.284771 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.284756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.293821 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.293801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q58ll\" (UniqueName: \"kubernetes.io/projected/c4e89309-80e9-4a64-a717-0d3d35ac9a02-kube-api-access-q58ll\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.369526 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.369507    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:35.502343 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.502322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"]
Jul 20 18:24:35.504093 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:24:35.504068    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e89309_80e9_4a64_a717_0d3d35ac9a02.slice/crio-5d02d2c54ddc70ea69d3afab218b1c3eff4dd4719089f9faa6231b23bde1c3df WatchSource:0}: Error finding container 5d02d2c54ddc70ea69d3afab218b1c3eff4dd4719089f9faa6231b23bde1c3df: Status 404 returned error can't find the container with id 5d02d2c54ddc70ea69d3afab218b1c3eff4dd4719089f9faa6231b23bde1c3df
Jul 20 18:24:35.850414 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.850353    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"]
Jul 20 18:24:35.853676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.853661    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:35.863267 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.863245    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"]
Jul 20 18:24:35.992051 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.992023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:35.992195 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.992085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:35.992195 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:35.992117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v46lp\" (UniqueName: \"kubernetes.io/projected/1ccd811a-1a2c-419f-a79a-071c4a652a1b-kube-api-access-v46lp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:36.046429 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.046394    2560 generic.go:356] "Generic (PLEG): container finished" podID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerID="843c506c44dab1088e42e709baadcf9e91ced4e1a1025a28a80d8e7cb4d5a4ba" exitCode=0
Jul 20 18:24:36.046583 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.046479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr" event={"ID":"c4e89309-80e9-4a64-a717-0d3d35ac9a02","Type":"ContainerDied","Data":"843c506c44dab1088e42e709baadcf9e91ced4e1a1025a28a80d8e7cb4d5a4ba"}
Jul 20 18:24:36.046583 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.046529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr" event={"ID":"c4e89309-80e9-4a64-a717-0d3d35ac9a02","Type":"ContainerStarted","Data":"5d02d2c54ddc70ea69d3afab218b1c3eff4dd4719089f9faa6231b23bde1c3df"}
Jul 20 18:24:36.092733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.092706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:36.093031 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.092741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v46lp\" (UniqueName: \"kubernetes.io/projected/1ccd811a-1a2c-419f-a79a-071c4a652a1b-kube-api-access-v46lp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:36.093031 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.092793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:36.093118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.093030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:36.093118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.093095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:36.101041 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.100978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v46lp\" (UniqueName: \"kubernetes.io/projected/1ccd811a-1a2c-419f-a79a-071c4a652a1b-kube-api-access-v46lp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:36.163211 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.163191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:36.292573 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.292543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"]
Jul 20 18:24:36.296080 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:24:36.296058    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ccd811a_1a2c_419f_a79a_071c4a652a1b.slice/crio-91791b43d4173f55c367591653e5f84a01caa92078bf80b44f2f99bfa2f37961 WatchSource:0}: Error finding container 91791b43d4173f55c367591653e5f84a01caa92078bf80b44f2f99bfa2f37961: Status 404 returned error can't find the container with id 91791b43d4173f55c367591653e5f84a01caa92078bf80b44f2f99bfa2f37961
Jul 20 18:24:36.445952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.445924    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"]
Jul 20 18:24:36.449482 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.449465    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.457527 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.457505    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"]
Jul 20 18:24:36.596776 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.596743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.596915 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.596807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j2ml\" (UniqueName: \"kubernetes.io/projected/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-kube-api-access-9j2ml\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.596915 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.596843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.697520 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.697489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.697715 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.697546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j2ml\" (UniqueName: \"kubernetes.io/projected/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-kube-api-access-9j2ml\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.697715 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.697573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.697879 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.697859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.697925 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.697885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.706372 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.706346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j2ml\" (UniqueName: \"kubernetes.io/projected/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-kube-api-access-9j2ml\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.764850 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.764829    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:36.854771 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.854741    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"]
Jul 20 18:24:36.859450 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.859419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:36.872400 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.872371    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"]
Jul 20 18:24:36.902304 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.902278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"]
Jul 20 18:24:36.904209 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:24:36.904187    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1c7e68_cfce_4015_90a1_cd2f31556d2c.slice/crio-8f0a35f311016a7ced49d8ff0b80ef7ccbd441064347b94c40fb9d9cc8073c5b WatchSource:0}: Error finding container 8f0a35f311016a7ced49d8ff0b80ef7ccbd441064347b94c40fb9d9cc8073c5b: Status 404 returned error can't find the container with id 8f0a35f311016a7ced49d8ff0b80ef7ccbd441064347b94c40fb9d9cc8073c5b
Jul 20 18:24:36.999490 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.999459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:36.999601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.999531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nst58\" (UniqueName: \"kubernetes.io/projected/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-kube-api-access-nst58\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:36.999601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:36.999550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:37.052646 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.052620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt" event={"ID":"fb1c7e68-cfce-4015-90a1-cd2f31556d2c","Type":"ContainerStarted","Data":"8f0a35f311016a7ced49d8ff0b80ef7ccbd441064347b94c40fb9d9cc8073c5b"}
Jul 20 18:24:37.054309 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.054220    2560 generic.go:356] "Generic (PLEG): container finished" podID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerID="66762014541be72e5dd8bbe338b8d469db3fb13208f8511d5e1d2680a0adc6f2" exitCode=0
Jul 20 18:24:37.054309 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.054267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x" event={"ID":"1ccd811a-1a2c-419f-a79a-071c4a652a1b","Type":"ContainerDied","Data":"66762014541be72e5dd8bbe338b8d469db3fb13208f8511d5e1d2680a0adc6f2"}
Jul 20 18:24:37.054486 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.054336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x" event={"ID":"1ccd811a-1a2c-419f-a79a-071c4a652a1b","Type":"ContainerStarted","Data":"91791b43d4173f55c367591653e5f84a01caa92078bf80b44f2f99bfa2f37961"}
Jul 20 18:24:37.100522 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.100501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nst58\" (UniqueName: \"kubernetes.io/projected/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-kube-api-access-nst58\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:37.100812 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.100531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:37.100812 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.100584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:37.100999 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.100979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:37.100999 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.100990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:37.108779 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.108754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nst58\" (UniqueName: \"kubernetes.io/projected/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-kube-api-access-nst58\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:37.179275 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.179256    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:37.312869 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:37.312845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"]
Jul 20 18:24:37.314875 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:24:37.314850    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9e87e6_945d_41e7_b047_bf2eb27f00a6.slice/crio-2032e871df3f89193884aea79b8b8d0ea24fb1f2bb0d352894ffce63d36a2e22 WatchSource:0}: Error finding container 2032e871df3f89193884aea79b8b8d0ea24fb1f2bb0d352894ffce63d36a2e22: Status 404 returned error can't find the container with id 2032e871df3f89193884aea79b8b8d0ea24fb1f2bb0d352894ffce63d36a2e22
Jul 20 18:24:38.060544 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.060511    2560 generic.go:356] "Generic (PLEG): container finished" podID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerID="e9361c46aadf6e14b921e641b0d74bbcf60b9b1c2441c4f91b4948339629002c" exitCode=0
Jul 20 18:24:38.060726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.060599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt" event={"ID":"fb1c7e68-cfce-4015-90a1-cd2f31556d2c","Type":"ContainerDied","Data":"e9361c46aadf6e14b921e641b0d74bbcf60b9b1c2441c4f91b4948339629002c"}
Jul 20 18:24:38.061085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.061067    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:24:38.062533 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.062511    2560 generic.go:356] "Generic (PLEG): container finished" podID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerID="2f536dda8bb316793f89bb90fd17ed86141f794b079e8cb2e2e4e8843661ebe0" exitCode=0
Jul 20 18:24:38.062636 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.062559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x" event={"ID":"1ccd811a-1a2c-419f-a79a-071c4a652a1b","Type":"ContainerDied","Data":"2f536dda8bb316793f89bb90fd17ed86141f794b079e8cb2e2e4e8843661ebe0"}
Jul 20 18:24:38.064336 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.064315    2560 generic.go:356] "Generic (PLEG): container finished" podID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerID="1ede009eab6f37e41dc4cea9103cf111c48fc3a971666183fce0f7179a9e7c24" exitCode=0
Jul 20 18:24:38.064489 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.064470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd" event={"ID":"aa9e87e6-945d-41e7-b047-bf2eb27f00a6","Type":"ContainerDied","Data":"1ede009eab6f37e41dc4cea9103cf111c48fc3a971666183fce0f7179a9e7c24"}
Jul 20 18:24:38.064573 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.064516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd" event={"ID":"aa9e87e6-945d-41e7-b047-bf2eb27f00a6","Type":"ContainerStarted","Data":"2032e871df3f89193884aea79b8b8d0ea24fb1f2bb0d352894ffce63d36a2e22"}
Jul 20 18:24:38.066455 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.066417    2560 generic.go:356] "Generic (PLEG): container finished" podID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerID="56b9e9c48f0773014cea7863d58ece0210e8d2af83dc170930b2b5dfc66bdf09" exitCode=0
Jul 20 18:24:38.066540 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:38.066464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr" event={"ID":"c4e89309-80e9-4a64-a717-0d3d35ac9a02","Type":"ContainerDied","Data":"56b9e9c48f0773014cea7863d58ece0210e8d2af83dc170930b2b5dfc66bdf09"}
Jul 20 18:24:39.074854 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:39.074797    2560 generic.go:356] "Generic (PLEG): container finished" podID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerID="f99f69e89eb3bc960f43476ee7bc6b12b335f5b188b9a3b762610854195d1b7a" exitCode=0
Jul 20 18:24:39.075198 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:39.074870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr" event={"ID":"c4e89309-80e9-4a64-a717-0d3d35ac9a02","Type":"ContainerDied","Data":"f99f69e89eb3bc960f43476ee7bc6b12b335f5b188b9a3b762610854195d1b7a"}
Jul 20 18:24:39.076951 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:39.076926    2560 generic.go:356] "Generic (PLEG): container finished" podID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerID="79bfac580553beb674d86a73ec7259d93d3ab51bdb99e05399aaaaffcc203de3" exitCode=0
Jul 20 18:24:39.077035 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:39.077003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x" event={"ID":"1ccd811a-1a2c-419f-a79a-071c4a652a1b","Type":"ContainerDied","Data":"79bfac580553beb674d86a73ec7259d93d3ab51bdb99e05399aaaaffcc203de3"}
Jul 20 18:24:39.078558 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:39.078538    2560 generic.go:356] "Generic (PLEG): container finished" podID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerID="e6a08c5ae3205f22b10e32ba58d182276850c425f4d709b4168180bdb60dda35" exitCode=0
Jul 20 18:24:39.078639 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:39.078617    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd" event={"ID":"aa9e87e6-945d-41e7-b047-bf2eb27f00a6","Type":"ContainerDied","Data":"e6a08c5ae3205f22b10e32ba58d182276850c425f4d709b4168180bdb60dda35"}
Jul 20 18:24:40.085559 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.085516    2560 generic.go:356] "Generic (PLEG): container finished" podID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerID="36b8b73881345c29072c13d0ecbad688e6149117ebce339e90fe936907996df0" exitCode=0
Jul 20 18:24:40.085968 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.085598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt" event={"ID":"fb1c7e68-cfce-4015-90a1-cd2f31556d2c","Type":"ContainerDied","Data":"36b8b73881345c29072c13d0ecbad688e6149117ebce339e90fe936907996df0"}
Jul 20 18:24:40.087846 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.087824    2560 generic.go:356] "Generic (PLEG): container finished" podID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerID="894be3c12981bf6a83ac5e84b984e5c5145c50edc20e556a572bebc1655c2a9b" exitCode=0
Jul 20 18:24:40.087931 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.087913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd" event={"ID":"aa9e87e6-945d-41e7-b047-bf2eb27f00a6","Type":"ContainerDied","Data":"894be3c12981bf6a83ac5e84b984e5c5145c50edc20e556a572bebc1655c2a9b"}
Jul 20 18:24:40.225490 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.225462    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:40.227748 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.227101    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-bundle\") pod \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") "
Jul 20 18:24:40.227748 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.227154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-util\") pod \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") "
Jul 20 18:24:40.227748 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.227253    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q58ll\" (UniqueName: \"kubernetes.io/projected/c4e89309-80e9-4a64-a717-0d3d35ac9a02-kube-api-access-q58ll\") pod \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\" (UID: \"c4e89309-80e9-4a64-a717-0d3d35ac9a02\") "
Jul 20 18:24:40.228209 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.228182    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-bundle" (OuterVolumeSpecName: "bundle") pod "c4e89309-80e9-4a64-a717-0d3d35ac9a02" (UID: "c4e89309-80e9-4a64-a717-0d3d35ac9a02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:24:40.230593 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.230566    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e89309-80e9-4a64-a717-0d3d35ac9a02-kube-api-access-q58ll" (OuterVolumeSpecName: "kube-api-access-q58ll") pod "c4e89309-80e9-4a64-a717-0d3d35ac9a02" (UID: "c4e89309-80e9-4a64-a717-0d3d35ac9a02"). InnerVolumeSpecName "kube-api-access-q58ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:24:40.234627 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.234603    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-util" (OuterVolumeSpecName: "util") pod "c4e89309-80e9-4a64-a717-0d3d35ac9a02" (UID: "c4e89309-80e9-4a64-a717-0d3d35ac9a02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:24:40.245070 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.245050    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:40.327954 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.327924    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v46lp\" (UniqueName: \"kubernetes.io/projected/1ccd811a-1a2c-419f-a79a-071c4a652a1b-kube-api-access-v46lp\") pod \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") "
Jul 20 18:24:40.328107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.327962    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-bundle\") pod \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") "
Jul 20 18:24:40.328107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.328010    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-util\") pod \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\" (UID: \"1ccd811a-1a2c-419f-a79a-071c4a652a1b\") "
Jul 20 18:24:40.328279 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.328222    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:40.328279 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.328243    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4e89309-80e9-4a64-a717-0d3d35ac9a02-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:40.328279 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.328258    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q58ll\" (UniqueName: \"kubernetes.io/projected/c4e89309-80e9-4a64-a717-0d3d35ac9a02-kube-api-access-q58ll\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:40.328585 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.328555    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-bundle" (OuterVolumeSpecName: "bundle") pod "1ccd811a-1a2c-419f-a79a-071c4a652a1b" (UID: "1ccd811a-1a2c-419f-a79a-071c4a652a1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:24:40.330005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.329979    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ccd811a-1a2c-419f-a79a-071c4a652a1b-kube-api-access-v46lp" (OuterVolumeSpecName: "kube-api-access-v46lp") pod "1ccd811a-1a2c-419f-a79a-071c4a652a1b" (UID: "1ccd811a-1a2c-419f-a79a-071c4a652a1b"). InnerVolumeSpecName "kube-api-access-v46lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:24:40.333323 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.333297    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-util" (OuterVolumeSpecName: "util") pod "1ccd811a-1a2c-419f-a79a-071c4a652a1b" (UID: "1ccd811a-1a2c-419f-a79a-071c4a652a1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:24:40.428698 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.428674    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:40.428698 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.428699    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v46lp\" (UniqueName: \"kubernetes.io/projected/1ccd811a-1a2c-419f-a79a-071c4a652a1b-kube-api-access-v46lp\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:40.428856 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:40.428709    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ccd811a-1a2c-419f-a79a-071c4a652a1b-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:41.094721 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.094683    2560 generic.go:356] "Generic (PLEG): container finished" podID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerID="30fea1315fc8b23d5960c8aed1eae72f6173a74d5945f2a6452b3914aca9a0b5" exitCode=0
Jul 20 18:24:41.095150 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.094765    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt" event={"ID":"fb1c7e68-cfce-4015-90a1-cd2f31556d2c","Type":"ContainerDied","Data":"30fea1315fc8b23d5960c8aed1eae72f6173a74d5945f2a6452b3914aca9a0b5"}
Jul 20 18:24:41.096626 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.096607    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x"
Jul 20 18:24:41.096733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.096639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x" event={"ID":"1ccd811a-1a2c-419f-a79a-071c4a652a1b","Type":"ContainerDied","Data":"91791b43d4173f55c367591653e5f84a01caa92078bf80b44f2f99bfa2f37961"}
Jul 20 18:24:41.096733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.096683    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91791b43d4173f55c367591653e5f84a01caa92078bf80b44f2f99bfa2f37961"
Jul 20 18:24:41.098403 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.098380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr" event={"ID":"c4e89309-80e9-4a64-a717-0d3d35ac9a02","Type":"ContainerDied","Data":"5d02d2c54ddc70ea69d3afab218b1c3eff4dd4719089f9faa6231b23bde1c3df"}
Jul 20 18:24:41.098528 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.098414    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d02d2c54ddc70ea69d3afab218b1c3eff4dd4719089f9faa6231b23bde1c3df"
Jul 20 18:24:41.098528 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.098424    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr"
Jul 20 18:24:41.231933 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.231908    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:41.234811 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.234790    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-util\") pod \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") "
Jul 20 18:24:41.234903 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.234818    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nst58\" (UniqueName: \"kubernetes.io/projected/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-kube-api-access-nst58\") pod \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") "
Jul 20 18:24:41.234903 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.234850    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-bundle\") pod \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\" (UID: \"aa9e87e6-945d-41e7-b047-bf2eb27f00a6\") "
Jul 20 18:24:41.235306 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.235279    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-bundle" (OuterVolumeSpecName: "bundle") pod "aa9e87e6-945d-41e7-b047-bf2eb27f00a6" (UID: "aa9e87e6-945d-41e7-b047-bf2eb27f00a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:24:41.236971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.236938    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-kube-api-access-nst58" (OuterVolumeSpecName: "kube-api-access-nst58") pod "aa9e87e6-945d-41e7-b047-bf2eb27f00a6" (UID: "aa9e87e6-945d-41e7-b047-bf2eb27f00a6"). InnerVolumeSpecName "kube-api-access-nst58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:24:41.239933 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.239914    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-util" (OuterVolumeSpecName: "util") pod "aa9e87e6-945d-41e7-b047-bf2eb27f00a6" (UID: "aa9e87e6-945d-41e7-b047-bf2eb27f00a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:24:41.335681 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.335649    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:41.335681 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.335675    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:41.335681 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:41.335684    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nst58\" (UniqueName: \"kubernetes.io/projected/aa9e87e6-945d-41e7-b047-bf2eb27f00a6-kube-api-access-nst58\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:42.105312 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.105286    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd"
Jul 20 18:24:42.105791 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.105317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd" event={"ID":"aa9e87e6-945d-41e7-b047-bf2eb27f00a6","Type":"ContainerDied","Data":"2032e871df3f89193884aea79b8b8d0ea24fb1f2bb0d352894ffce63d36a2e22"}
Jul 20 18:24:42.105791 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.105359    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2032e871df3f89193884aea79b8b8d0ea24fb1f2bb0d352894ffce63d36a2e22"
Jul 20 18:24:42.232987 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.232964    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:42.243400 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.243375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-bundle\") pod \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") "
Jul 20 18:24:42.243538 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.243451    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-util\") pod \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") "
Jul 20 18:24:42.243538 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.243487    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j2ml\" (UniqueName: \"kubernetes.io/projected/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-kube-api-access-9j2ml\") pod \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\" (UID: \"fb1c7e68-cfce-4015-90a1-cd2f31556d2c\") "
Jul 20 18:24:42.243937 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.243918    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-bundle" (OuterVolumeSpecName: "bundle") pod "fb1c7e68-cfce-4015-90a1-cd2f31556d2c" (UID: "fb1c7e68-cfce-4015-90a1-cd2f31556d2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:24:42.245516 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.245494    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-kube-api-access-9j2ml" (OuterVolumeSpecName: "kube-api-access-9j2ml") pod "fb1c7e68-cfce-4015-90a1-cd2f31556d2c" (UID: "fb1c7e68-cfce-4015-90a1-cd2f31556d2c"). InnerVolumeSpecName "kube-api-access-9j2ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:24:42.249126 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.249091    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-util" (OuterVolumeSpecName: "util") pod "fb1c7e68-cfce-4015-90a1-cd2f31556d2c" (UID: "fb1c7e68-cfce-4015-90a1-cd2f31556d2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:24:42.344536 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.344501    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-bundle\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:42.344536 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.344529    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-util\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:42.344536 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:42.344539    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j2ml\" (UniqueName: \"kubernetes.io/projected/fb1c7e68-cfce-4015-90a1-cd2f31556d2c-kube-api-access-9j2ml\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:24:43.112294 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:43.112264    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt"
Jul 20 18:24:43.112708 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:43.112264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt" event={"ID":"fb1c7e68-cfce-4015-90a1-cd2f31556d2c","Type":"ContainerDied","Data":"8f0a35f311016a7ced49d8ff0b80ef7ccbd441064347b94c40fb9d9cc8073c5b"}
Jul 20 18:24:43.112708 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:43.112418    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f0a35f311016a7ced49d8ff0b80ef7ccbd441064347b94c40fb9d9cc8073c5b"
Jul 20 18:24:51.214458 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214403    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"]
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214742    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerName="extract"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214754    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerName="extract"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214762    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerName="util"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214768    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerName="util"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214774    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerName="util"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214780    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerName="util"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214787    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerName="util"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214793    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerName="util"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214799    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerName="pull"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214804    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerName="pull"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214813    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerName="util"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214818    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerName="util"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214826    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerName="pull"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214832    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerName="pull"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214839    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerName="pull"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214844    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerName="pull"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214856    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerName="pull"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214860    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerName="pull"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214865    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerName="extract"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214871    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerName="extract"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214878    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerName="extract"
Jul 20 18:24:51.214868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214882    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerName="extract"
Jul 20 18:24:51.215590 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214888    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerName="extract"
Jul 20 18:24:51.215590 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214897    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerName="extract"
Jul 20 18:24:51.215590 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214954    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb1c7e68-cfce-4015-90a1-cd2f31556d2c" containerName="extract"
Jul 20 18:24:51.215590 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214962    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9e87e6-945d-41e7-b047-bf2eb27f00a6" containerName="extract"
Jul 20 18:24:51.215590 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214970    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ccd811a-1a2c-419f-a79a-071c4a652a1b" containerName="extract"
Jul 20 18:24:51.215590 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.214978    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e89309-80e9-4a64-a717-0d3d35ac9a02" containerName="extract"
Jul 20 18:24:51.221373 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.221352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"
Jul 20 18:24:51.228434 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.228412    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-66srk\""
Jul 20 18:24:51.228619 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.228604    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 20 18:24:51.238672 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.238651    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"]
Jul 20 18:24:51.313799 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.313768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59dsb\" (UniqueName: \"kubernetes.io/projected/9663cf35-98a7-45af-bcb8-6bfa13e0bea1-kube-api-access-59dsb\") pod \"dns-operator-controller-manager-864dd78c4c-rvvm2\" (UID: \"9663cf35-98a7-45af-bcb8-6bfa13e0bea1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"
Jul 20 18:24:51.414986 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.414952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59dsb\" (UniqueName: \"kubernetes.io/projected/9663cf35-98a7-45af-bcb8-6bfa13e0bea1-kube-api-access-59dsb\") pod \"dns-operator-controller-manager-864dd78c4c-rvvm2\" (UID: \"9663cf35-98a7-45af-bcb8-6bfa13e0bea1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"
Jul 20 18:24:51.433702 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.433674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59dsb\" (UniqueName: \"kubernetes.io/projected/9663cf35-98a7-45af-bcb8-6bfa13e0bea1-kube-api-access-59dsb\") pod \"dns-operator-controller-manager-864dd78c4c-rvvm2\" (UID: \"9663cf35-98a7-45af-bcb8-6bfa13e0bea1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"
Jul 20 18:24:51.531015 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.530934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"
Jul 20 18:24:51.663663 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:51.663631    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"]
Jul 20 18:24:51.666919 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:24:51.666891    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9663cf35_98a7_45af_bcb8_6bfa13e0bea1.slice/crio-043b76ce4b7d21742878e4443292d23ee925604a74fdb8d61ee2f789ac672661 WatchSource:0}: Error finding container 043b76ce4b7d21742878e4443292d23ee925604a74fdb8d61ee2f789ac672661: Status 404 returned error can't find the container with id 043b76ce4b7d21742878e4443292d23ee925604a74fdb8d61ee2f789ac672661
Jul 20 18:24:52.157307 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:52.157275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2" event={"ID":"9663cf35-98a7-45af-bcb8-6bfa13e0bea1","Type":"ContainerStarted","Data":"043b76ce4b7d21742878e4443292d23ee925604a74fdb8d61ee2f789ac672661"}
Jul 20 18:24:54.169750 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:54.169714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2" event={"ID":"9663cf35-98a7-45af-bcb8-6bfa13e0bea1","Type":"ContainerStarted","Data":"269127b3da58d0f8c60fc34ce24ac4b8878840a713cd735c8421891b5bbfae89"}
Jul 20 18:24:54.170134 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:54.169794    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"
Jul 20 18:24:54.230045 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:54.224961    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2" podStartSLOduration=1.324229293 podStartE2EDuration="3.224941737s" totalImagesPullingTime="1.900712444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:24:54.221750964 +0000 UTC m=+691.458019378" watchObservedRunningTime="2026-07-20 18:24:54.224941737 +0000 UTC m=+691.461210152"
Jul 20 18:24:55.219042 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.219013    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"]
Jul 20 18:24:55.222693 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.222672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:24:55.225100 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.225080    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8ds2h\""
Jul 20 18:24:55.238661 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.238637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"]
Jul 20 18:24:55.247687 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.247661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7czqc\" (UniqueName: \"kubernetes.io/projected/66d57b76-67d1-42fd-9bca-2ffc7e13be9c-kube-api-access-7czqc\") pod \"limitador-operator-controller-manager-859d7b78bd-5nkhp\" (UID: \"66d57b76-67d1-42fd-9bca-2ffc7e13be9c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:24:55.349112 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.349087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7czqc\" (UniqueName: \"kubernetes.io/projected/66d57b76-67d1-42fd-9bca-2ffc7e13be9c-kube-api-access-7czqc\") pod \"limitador-operator-controller-manager-859d7b78bd-5nkhp\" (UID: \"66d57b76-67d1-42fd-9bca-2ffc7e13be9c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:24:55.359244 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.359207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7czqc\" (UniqueName: \"kubernetes.io/projected/66d57b76-67d1-42fd-9bca-2ffc7e13be9c-kube-api-access-7czqc\") pod \"limitador-operator-controller-manager-859d7b78bd-5nkhp\" (UID: \"66d57b76-67d1-42fd-9bca-2ffc7e13be9c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:24:55.532369 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.532274    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:24:55.695390 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:55.695360    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"]
Jul 20 18:24:55.699112 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:24:55.699075    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d57b76_67d1_42fd_9bca_2ffc7e13be9c.slice/crio-72f8d57b252cd3c8f18b4859307ec977915238e1d5c3c4007c344f8638dbb3a0 WatchSource:0}: Error finding container 72f8d57b252cd3c8f18b4859307ec977915238e1d5c3c4007c344f8638dbb3a0: Status 404 returned error can't find the container with id 72f8d57b252cd3c8f18b4859307ec977915238e1d5c3c4007c344f8638dbb3a0
Jul 20 18:24:56.181491 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:56.181459    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp" event={"ID":"66d57b76-67d1-42fd-9bca-2ffc7e13be9c","Type":"ContainerStarted","Data":"72f8d57b252cd3c8f18b4859307ec977915238e1d5c3c4007c344f8638dbb3a0"}
Jul 20 18:24:58.194990 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:58.194956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp" event={"ID":"66d57b76-67d1-42fd-9bca-2ffc7e13be9c","Type":"ContainerStarted","Data":"d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50"}
Jul 20 18:24:58.195454 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:58.195021    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:24:58.216816 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:58.216773    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp" podStartSLOduration=1.459550896 podStartE2EDuration="3.216759415s" totalImagesPullingTime="1.757208519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:24:58.214276666 +0000 UTC m=+695.450545083" watchObservedRunningTime="2026-07-20 18:24:58.216759415 +0000 UTC m=+695.453027829"
Jul 20 18:24:59.614790 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:59.614745    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"]
Jul 20 18:24:59.618237 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:59.618221    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"
Jul 20 18:24:59.628084 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:59.628064    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zwdbn\""
Jul 20 18:24:59.646242 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:59.646215    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"]
Jul 20 18:24:59.688507 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:59.688477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcsvv\" (UniqueName: \"kubernetes.io/projected/a6591cfa-408f-43a2-a9b9-abd1266e4066-kube-api-access-hcsvv\") pod \"authorino-operator-75cc8d5cb7-vxhcr\" (UID: \"a6591cfa-408f-43a2-a9b9-abd1266e4066\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"
Jul 20 18:24:59.789436 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:59.789400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcsvv\" (UniqueName: \"kubernetes.io/projected/a6591cfa-408f-43a2-a9b9-abd1266e4066-kube-api-access-hcsvv\") pod \"authorino-operator-75cc8d5cb7-vxhcr\" (UID: \"a6591cfa-408f-43a2-a9b9-abd1266e4066\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"
Jul 20 18:24:59.801622 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:59.801585    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcsvv\" (UniqueName: \"kubernetes.io/projected/a6591cfa-408f-43a2-a9b9-abd1266e4066-kube-api-access-hcsvv\") pod \"authorino-operator-75cc8d5cb7-vxhcr\" (UID: \"a6591cfa-408f-43a2-a9b9-abd1266e4066\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"
Jul 20 18:24:59.928339 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:24:59.928309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"
Jul 20 18:25:00.070565 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:00.070533    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"]
Jul 20 18:25:00.071559 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:25:00.071528    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6591cfa_408f_43a2_a9b9_abd1266e4066.slice/crio-598244e76bcc0430cb2b9c97399c1c89aa1f80f0ae380e4d43a4b15130d92955 WatchSource:0}: Error finding container 598244e76bcc0430cb2b9c97399c1c89aa1f80f0ae380e4d43a4b15130d92955: Status 404 returned error can't find the container with id 598244e76bcc0430cb2b9c97399c1c89aa1f80f0ae380e4d43a4b15130d92955
Jul 20 18:25:00.207312 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:00.207223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr" event={"ID":"a6591cfa-408f-43a2-a9b9-abd1266e4066","Type":"ContainerStarted","Data":"598244e76bcc0430cb2b9c97399c1c89aa1f80f0ae380e4d43a4b15130d92955"}
Jul 20 18:25:03.226948 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:03.226910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr" event={"ID":"a6591cfa-408f-43a2-a9b9-abd1266e4066","Type":"ContainerStarted","Data":"760fac2fda28fa9f09b15a180dedd0c7c7001dc24fc084ccc7bafc922dc4a5a9"}
Jul 20 18:25:03.227357 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:03.227082    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"
Jul 20 18:25:04.532879 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.532820    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr" podStartSLOduration=3.232738867 podStartE2EDuration="5.532804032s" totalImagesPullingTime="2.300065165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:03.274374843 +0000 UTC m=+700.510643259" watchObservedRunningTime="2026-07-20 18:25:04.532804032 +0000 UTC m=+701.769072447"
Jul 20 18:25:04.535294 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.535270    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"]
Jul 20 18:25:04.538843 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.538827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:04.542714 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.542692    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z2ttw\""
Jul 20 18:25:04.555169 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.555148    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"]
Jul 20 18:25:04.635915 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.635886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4759a3ff-a1e4-4a92-85d3-44218e631d1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\" (UID: \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:04.636065 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.635948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tcm\" (UniqueName: \"kubernetes.io/projected/4759a3ff-a1e4-4a92-85d3-44218e631d1f-kube-api-access-p5tcm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\" (UID: \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:04.736870 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.736838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4759a3ff-a1e4-4a92-85d3-44218e631d1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\" (UID: \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:04.737034 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.736904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tcm\" (UniqueName: \"kubernetes.io/projected/4759a3ff-a1e4-4a92-85d3-44218e631d1f-kube-api-access-p5tcm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\" (UID: \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:04.737241 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.737220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4759a3ff-a1e4-4a92-85d3-44218e631d1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\" (UID: \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:04.746716 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.746694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tcm\" (UniqueName: \"kubernetes.io/projected/4759a3ff-a1e4-4a92-85d3-44218e631d1f-kube-api-access-p5tcm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\" (UID: \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:04.848436 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.848378    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:04.991208 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:04.991186    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"]
Jul 20 18:25:04.993559 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:25:04.993532    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4759a3ff_a1e4_4a92_85d3_44218e631d1f.slice/crio-a956aa22da1702171601030c84e043ad38c85eeba26929eea96ab7778e66f10c WatchSource:0}: Error finding container a956aa22da1702171601030c84e043ad38c85eeba26929eea96ab7778e66f10c: Status 404 returned error can't find the container with id a956aa22da1702171601030c84e043ad38c85eeba26929eea96ab7778e66f10c
Jul 20 18:25:05.177387 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:05.177358    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvvm2"
Jul 20 18:25:05.240414 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:05.240370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd" event={"ID":"4759a3ff-a1e4-4a92-85d3-44218e631d1f","Type":"ContainerStarted","Data":"a956aa22da1702171601030c84e043ad38c85eeba26929eea96ab7778e66f10c"}
Jul 20 18:25:06.200859 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.200826    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4685dd7c-cnj62"]
Jul 20 18:25:06.204329 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.204312    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.206746 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.206716    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 18:25:06.206906 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.206794    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 18:25:06.207729 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.207685    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-99mxx\""
Jul 20 18:25:06.207729 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.207699    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 18:25:06.207729 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.207709    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 18:25:06.207729 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.207717    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 18:25:06.208053 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.207760    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 18:25:06.208053 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.207685    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 18:25:06.216147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.216129    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 18:25:06.221189 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.221170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4685dd7c-cnj62"]
Jul 20 18:25:06.248815 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.248794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c636d29f-5221-4eee-998c-5615a93ec386-console-oauth-config\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.248907 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.248823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-trusted-ca-bundle\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.248907 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.248857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-console-config\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.248990 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.248934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c636d29f-5221-4eee-998c-5615a93ec386-console-serving-cert\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.248990 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.248968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-service-ca\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.249053 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.248990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv5kl\" (UniqueName: \"kubernetes.io/projected/c636d29f-5221-4eee-998c-5615a93ec386-kube-api-access-vv5kl\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.249098 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.249076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-oauth-serving-cert\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.350112 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.350079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-console-config\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.350269 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.350149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c636d29f-5221-4eee-998c-5615a93ec386-console-serving-cert\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.350269 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.350178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-service-ca\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.350269 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.350198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5kl\" (UniqueName: \"kubernetes.io/projected/c636d29f-5221-4eee-998c-5615a93ec386-kube-api-access-vv5kl\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.350269 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.350248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-oauth-serving-cert\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.350516 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.350284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c636d29f-5221-4eee-998c-5615a93ec386-console-oauth-config\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.350516 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.350310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-trusted-ca-bundle\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.350935 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.350885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-console-config\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.351197 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.351171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-trusted-ca-bundle\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.351303 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.351232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-service-ca\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.351546 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.351526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c636d29f-5221-4eee-998c-5615a93ec386-oauth-serving-cert\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.353520 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.353497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c636d29f-5221-4eee-998c-5615a93ec386-console-oauth-config\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.353622 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.353536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c636d29f-5221-4eee-998c-5615a93ec386-console-serving-cert\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.359383 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.359361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv5kl\" (UniqueName: \"kubernetes.io/projected/c636d29f-5221-4eee-998c-5615a93ec386-kube-api-access-vv5kl\") pod \"console-6f4685dd7c-cnj62\" (UID: \"c636d29f-5221-4eee-998c-5615a93ec386\") " pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.514873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.514810    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:06.652762 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:06.652725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4685dd7c-cnj62"]
Jul 20 18:25:06.658918 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:25:06.658891    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc636d29f_5221_4eee_998c_5615a93ec386.slice/crio-29853225146d3dd2b05c7011fafebb0b426901331a1fa9d02fae04dc9e29e99b WatchSource:0}: Error finding container 29853225146d3dd2b05c7011fafebb0b426901331a1fa9d02fae04dc9e29e99b: Status 404 returned error can't find the container with id 29853225146d3dd2b05c7011fafebb0b426901331a1fa9d02fae04dc9e29e99b
Jul 20 18:25:07.253779 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:07.253739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4685dd7c-cnj62" event={"ID":"c636d29f-5221-4eee-998c-5615a93ec386","Type":"ContainerStarted","Data":"2b647c96cf16a2fc2023c06c6c72f07451dc065db4b1b694c302b66353263426"}
Jul 20 18:25:07.254278 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:07.253800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4685dd7c-cnj62" event={"ID":"c636d29f-5221-4eee-998c-5615a93ec386","Type":"ContainerStarted","Data":"29853225146d3dd2b05c7011fafebb0b426901331a1fa9d02fae04dc9e29e99b"}
Jul 20 18:25:07.274416 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:07.274370    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4685dd7c-cnj62" podStartSLOduration=1.274354371 podStartE2EDuration="1.274354371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:07.272974847 +0000 UTC m=+704.509243267" watchObservedRunningTime="2026-07-20 18:25:07.274354371 +0000 UTC m=+704.510622786"
Jul 20 18:25:09.202992 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:09.202960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:25:12.286812 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:12.286771    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd" event={"ID":"4759a3ff-a1e4-4a92-85d3-44218e631d1f","Type":"ContainerStarted","Data":"35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921"}
Jul 20 18:25:12.287203 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:12.286918    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:12.312855 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:12.312797    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd" podStartSLOduration=1.472073233 podStartE2EDuration="8.312783325s" totalImagesPullingTime="6.840710092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:12.308798468 +0000 UTC m=+709.545066885" watchObservedRunningTime="2026-07-20 18:25:12.312783325 +0000 UTC m=+709.549051739"
Jul 20 18:25:14.235429 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:14.235396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vxhcr"
Jul 20 18:25:16.515157 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:16.515076    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:16.515157 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:16.515130    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:16.520056 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:16.520034    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:17.315904 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:17.315877    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4685dd7c-cnj62"
Jul 20 18:25:23.294071 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:23.294042    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:25.415719 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.415685    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"]
Jul 20 18:25:25.416129 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.415867    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd" podUID="4759a3ff-a1e4-4a92-85d3-44218e631d1f" containerName="manager" containerID="cri-o://35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921" gracePeriod=2
Jul 20 18:25:25.425659 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.425636    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"]
Jul 20 18:25:25.431333 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:25:25.431287    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4759a3ff-a1e4-4a92-85d3-44218e631d1f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\": pods \"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:25.442546 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.442519    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"]
Jul 20 18:25:25.442726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.442703    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp" podUID="66d57b76-67d1-42fd-9bca-2ffc7e13be9c" containerName="manager" containerID="cri-o://d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50" gracePeriod=2
Jul 20 18:25:25.452688 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:25:25.452653    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6pmdd\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="4759a3ff-a1e4-4a92-85d3-44218e631d1f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:25.454046 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.454021    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"]
Jul 20 18:25:25.496926 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.496895    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"]
Jul 20 18:25:25.497407 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.497389    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d57b76-67d1-42fd-9bca-2ffc7e13be9c" containerName="manager"
Jul 20 18:25:25.497481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.497409    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d57b76-67d1-42fd-9bca-2ffc7e13be9c" containerName="manager"
Jul 20 18:25:25.497481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.497427    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4759a3ff-a1e4-4a92-85d3-44218e631d1f" containerName="manager"
Jul 20 18:25:25.497481 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.497432    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4759a3ff-a1e4-4a92-85d3-44218e631d1f" containerName="manager"
Jul 20 18:25:25.497579 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.497516    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4759a3ff-a1e4-4a92-85d3-44218e631d1f" containerName="manager"
Jul 20 18:25:25.497579 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.497528    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="66d57b76-67d1-42fd-9bca-2ffc7e13be9c" containerName="manager"
Jul 20 18:25:25.500861 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.500745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"
Jul 20 18:25:25.526221 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.526192    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"]
Jul 20 18:25:25.530762 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.530741    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:25.531640 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.531620    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"]
Jul 20 18:25:25.535069 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.535053    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:25.548517 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.548494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"]
Jul 20 18:25:25.559274 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.558914    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"]
Jul 20 18:25:25.609487 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.609429    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"]
Jul 20 18:25:25.613229 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.613192    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5fk57\" (UID: \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:25.613229 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.613223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6l5t\" (UniqueName: \"kubernetes.io/projected/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-kube-api-access-r6l5t\") pod \"kuadrant-operator-controller-manager-86878c769f-5fk57\" (UID: \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:25.613457 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.613275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfgxw\" (UniqueName: \"kubernetes.io/projected/56705543-bea6-4ab2-a006-d173eee510bd-kube-api-access-sfgxw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4gl2\" (UID: \"56705543-bea6-4ab2-a006-d173eee510bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:25.613457 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.613293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56705543-bea6-4ab2-a006-d173eee510bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4gl2\" (UID: \"56705543-bea6-4ab2-a006-d173eee510bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:25.613839 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.613749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2vb6\" (UniqueName: \"kubernetes.io/projected/ccfdf1ae-4ef8-498f-bbb4-839590336b95-kube-api-access-l2vb6\") pod \"limitador-operator-controller-manager-859d7b78bd-gqwxp\" (UID: \"ccfdf1ae-4ef8-498f-bbb4-839590336b95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"
Jul 20 18:25:25.713837 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.713816    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:25:25.714211 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.714183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vb6\" (UniqueName: \"kubernetes.io/projected/ccfdf1ae-4ef8-498f-bbb4-839590336b95-kube-api-access-l2vb6\") pod \"limitador-operator-controller-manager-859d7b78bd-gqwxp\" (UID: \"ccfdf1ae-4ef8-498f-bbb4-839590336b95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"
Jul 20 18:25:25.714300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.714263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5fk57\" (UID: \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:25.714300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.714287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6l5t\" (UniqueName: \"kubernetes.io/projected/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-kube-api-access-r6l5t\") pod \"kuadrant-operator-controller-manager-86878c769f-5fk57\" (UID: \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:25.714406 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.714309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfgxw\" (UniqueName: \"kubernetes.io/projected/56705543-bea6-4ab2-a006-d173eee510bd-kube-api-access-sfgxw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4gl2\" (UID: \"56705543-bea6-4ab2-a006-d173eee510bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:25.714406 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.714333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56705543-bea6-4ab2-a006-d173eee510bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4gl2\" (UID: \"56705543-bea6-4ab2-a006-d173eee510bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:25.714725 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.714699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5fk57\" (UID: \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:25.714824 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.714792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56705543-bea6-4ab2-a006-d173eee510bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4gl2\" (UID: \"56705543-bea6-4ab2-a006-d173eee510bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:25.716753 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.716738    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:25.735422 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.735394    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6l5t\" (UniqueName: \"kubernetes.io/projected/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-kube-api-access-r6l5t\") pod \"kuadrant-operator-controller-manager-86878c769f-5fk57\" (UID: \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:25.735422 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.735421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2vb6\" (UniqueName: \"kubernetes.io/projected/ccfdf1ae-4ef8-498f-bbb4-839590336b95-kube-api-access-l2vb6\") pod \"limitador-operator-controller-manager-859d7b78bd-gqwxp\" (UID: \"ccfdf1ae-4ef8-498f-bbb4-839590336b95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"
Jul 20 18:25:25.735651 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.735467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfgxw\" (UniqueName: \"kubernetes.io/projected/56705543-bea6-4ab2-a006-d173eee510bd-kube-api-access-sfgxw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4gl2\" (UID: \"56705543-bea6-4ab2-a006-d173eee510bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:25.815317 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.815287    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5tcm\" (UniqueName: \"kubernetes.io/projected/4759a3ff-a1e4-4a92-85d3-44218e631d1f-kube-api-access-p5tcm\") pod \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\" (UID: \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\") "
Jul 20 18:25:25.815513 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.815478    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4759a3ff-a1e4-4a92-85d3-44218e631d1f-extensions-socket-volume\") pod \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\" (UID: \"4759a3ff-a1e4-4a92-85d3-44218e631d1f\") "
Jul 20 18:25:25.815596 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.815524    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7czqc\" (UniqueName: \"kubernetes.io/projected/66d57b76-67d1-42fd-9bca-2ffc7e13be9c-kube-api-access-7czqc\") pod \"66d57b76-67d1-42fd-9bca-2ffc7e13be9c\" (UID: \"66d57b76-67d1-42fd-9bca-2ffc7e13be9c\") "
Jul 20 18:25:25.815866 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.815836    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4759a3ff-a1e4-4a92-85d3-44218e631d1f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4759a3ff-a1e4-4a92-85d3-44218e631d1f" (UID: "4759a3ff-a1e4-4a92-85d3-44218e631d1f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:25:25.817279 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.817260    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4759a3ff-a1e4-4a92-85d3-44218e631d1f-kube-api-access-p5tcm" (OuterVolumeSpecName: "kube-api-access-p5tcm") pod "4759a3ff-a1e4-4a92-85d3-44218e631d1f" (UID: "4759a3ff-a1e4-4a92-85d3-44218e631d1f"). InnerVolumeSpecName "kube-api-access-p5tcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:25:25.817403 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.817383    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d57b76-67d1-42fd-9bca-2ffc7e13be9c-kube-api-access-7czqc" (OuterVolumeSpecName: "kube-api-access-7czqc") pod "66d57b76-67d1-42fd-9bca-2ffc7e13be9c" (UID: "66d57b76-67d1-42fd-9bca-2ffc7e13be9c"). InnerVolumeSpecName "kube-api-access-7czqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:25:25.847987 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.847959    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"
Jul 20 18:25:25.860101 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.860059    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:25.869055 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.869035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:25.918005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.916950    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4759a3ff-a1e4-4a92-85d3-44218e631d1f-extensions-socket-volume\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:25:25.918005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.916987    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7czqc\" (UniqueName: \"kubernetes.io/projected/66d57b76-67d1-42fd-9bca-2ffc7e13be9c-kube-api-access-7czqc\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:25:25.918005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:25.917004    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5tcm\" (UniqueName: \"kubernetes.io/projected/4759a3ff-a1e4-4a92-85d3-44218e631d1f-kube-api-access-p5tcm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:25:26.019290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.019248    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"]
Jul 20 18:25:26.022123 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:25:26.022094    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfdf1ae_4ef8_498f_bbb4_839590336b95.slice/crio-3c09340327b897abdc5b5312c5b675eb733797f7107c2a4b79d67357e3df6aae WatchSource:0}: Error finding container 3c09340327b897abdc5b5312c5b675eb733797f7107c2a4b79d67357e3df6aae: Status 404 returned error can't find the container with id 3c09340327b897abdc5b5312c5b675eb733797f7107c2a4b79d67357e3df6aae
Jul 20 18:25:26.256232 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.256205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"]
Jul 20 18:25:26.257596 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:25:26.257573    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f7d267a_60c8_4f1f_bcbd_f16862bdf6da.slice/crio-5fef9e703d2a540c445d34db4565494483f5f80e3516fc091d4a6a9a938bfeca WatchSource:0}: Error finding container 5fef9e703d2a540c445d34db4565494483f5f80e3516fc091d4a6a9a938bfeca: Status 404 returned error can't find the container with id 5fef9e703d2a540c445d34db4565494483f5f80e3516fc091d4a6a9a938bfeca
Jul 20 18:25:26.263382 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.263353    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"]
Jul 20 18:25:26.263989 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:25:26.263964    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56705543_bea6_4ab2_a006_d173eee510bd.slice/crio-296171c8661c5dd27fdd8f667f15b271772cb0267f2b79736068bfa8929603b3 WatchSource:0}: Error finding container 296171c8661c5dd27fdd8f667f15b271772cb0267f2b79736068bfa8929603b3: Status 404 returned error can't find the container with id 296171c8661c5dd27fdd8f667f15b271772cb0267f2b79736068bfa8929603b3
Jul 20 18:25:26.366568 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.366534    2560 generic.go:356] "Generic (PLEG): container finished" podID="4759a3ff-a1e4-4a92-85d3-44218e631d1f" containerID="35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921" exitCode=0
Jul 20 18:25:26.366776 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.366592    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6pmdd"
Jul 20 18:25:26.366776 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.366621    2560 scope.go:117] "RemoveContainer" containerID="35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921"
Jul 20 18:25:26.368394 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.368366    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2" event={"ID":"56705543-bea6-4ab2-a006-d173eee510bd","Type":"ContainerStarted","Data":"7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab"}
Jul 20 18:25:26.368522 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.368422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2" event={"ID":"56705543-bea6-4ab2-a006-d173eee510bd","Type":"ContainerStarted","Data":"296171c8661c5dd27fdd8f667f15b271772cb0267f2b79736068bfa8929603b3"}
Jul 20 18:25:26.368591 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.368536    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:26.370355 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.370312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp" event={"ID":"ccfdf1ae-4ef8-498f-bbb4-839590336b95","Type":"ContainerStarted","Data":"0df654ff13f77e5c1383a1f99ff5191b6f485462d96d872cf8bc973181dbe898"}
Jul 20 18:25:26.370510 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.370358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp" event={"ID":"ccfdf1ae-4ef8-498f-bbb4-839590336b95","Type":"ContainerStarted","Data":"3c09340327b897abdc5b5312c5b675eb733797f7107c2a4b79d67357e3df6aae"}
Jul 20 18:25:26.370510 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.370389    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"
Jul 20 18:25:26.372138 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.372111    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57" event={"ID":"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da","Type":"ContainerStarted","Data":"ec7269450befb5fe91f5079dacaed27b1abcafc53c5c051f841e4e52ee1b1d7b"}
Jul 20 18:25:26.372259 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.372171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57" event={"ID":"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da","Type":"ContainerStarted","Data":"5fef9e703d2a540c445d34db4565494483f5f80e3516fc091d4a6a9a938bfeca"}
Jul 20 18:25:26.372259 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.372214    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:26.373358 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.373335    2560 generic.go:356] "Generic (PLEG): container finished" podID="66d57b76-67d1-42fd-9bca-2ffc7e13be9c" containerID="d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50" exitCode=0
Jul 20 18:25:26.373501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.373366    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5nkhp"
Jul 20 18:25:26.377899 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.377881    2560 scope.go:117] "RemoveContainer" containerID="35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921"
Jul 20 18:25:26.378180 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:25:26.378154    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921\": container with ID starting with 35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921 not found: ID does not exist" containerID="35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921"
Jul 20 18:25:26.378248 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.378182    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921"} err="failed to get container status \"35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921\": rpc error: code = NotFound desc = could not find container \"35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921\": container with ID starting with 35f4d5f88288e6b8fe2441512e982f2ecbf064aba7d781c80ec199b395340921 not found: ID does not exist"
Jul 20 18:25:26.378248 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.378208    2560 scope.go:117] "RemoveContainer" containerID="d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50"
Jul 20 18:25:26.387236 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.387220    2560 scope.go:117] "RemoveContainer" containerID="d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50"
Jul 20 18:25:26.387492 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:25:26.387473    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50\": container with ID starting with d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50 not found: ID does not exist" containerID="d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50"
Jul 20 18:25:26.387549 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.387501    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50"} err="failed to get container status \"d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50\": rpc error: code = NotFound desc = could not find container \"d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50\": container with ID starting with d5e5dc81be5718992d52714581bbfdf1813e99e02892b6cdac345c3ed337fc50 not found: ID does not exist"
Jul 20 18:25:26.394489 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.394419    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2" podStartSLOduration=1.394406584 podStartE2EDuration="1.394406584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:26.39187581 +0000 UTC m=+723.628144253" watchObservedRunningTime="2026-07-20 18:25:26.394406584 +0000 UTC m=+723.630675079"
Jul 20 18:25:26.425119 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.425072    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57" podStartSLOduration=1.425056554 podStartE2EDuration="1.425056554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:26.419685619 +0000 UTC m=+723.655954034" watchObservedRunningTime="2026-07-20 18:25:26.425056554 +0000 UTC m=+723.661324968"
Jul 20 18:25:26.441151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:26.441093    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp" podStartSLOduration=1.441071495 podStartE2EDuration="1.441071495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:26.43893443 +0000 UTC m=+723.675202845" watchObservedRunningTime="2026-07-20 18:25:26.441071495 +0000 UTC m=+723.677339912"
Jul 20 18:25:27.488385 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:27.488354    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4759a3ff-a1e4-4a92-85d3-44218e631d1f" path="/var/lib/kubelet/pods/4759a3ff-a1e4-4a92-85d3-44218e631d1f/volumes"
Jul 20 18:25:27.488820 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:27.488697    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66d57b76-67d1-42fd-9bca-2ffc7e13be9c" path="/var/lib/kubelet/pods/66d57b76-67d1-42fd-9bca-2ffc7e13be9c/volumes"
Jul 20 18:25:37.383655 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.383621    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:37.384118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.383703    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:25:37.384118 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.384092    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gqwxp"
Jul 20 18:25:37.530580 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.530548    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"]
Jul 20 18:25:37.530776 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.530737    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2" podUID="56705543-bea6-4ab2-a006-d173eee510bd" containerName="manager" containerID="cri-o://7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab" gracePeriod=10
Jul 20 18:25:37.786117 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.786094    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:37.919610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.919529    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfgxw\" (UniqueName: \"kubernetes.io/projected/56705543-bea6-4ab2-a006-d173eee510bd-kube-api-access-sfgxw\") pod \"56705543-bea6-4ab2-a006-d173eee510bd\" (UID: \"56705543-bea6-4ab2-a006-d173eee510bd\") "
Jul 20 18:25:37.919610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.919600    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56705543-bea6-4ab2-a006-d173eee510bd-extensions-socket-volume\") pod \"56705543-bea6-4ab2-a006-d173eee510bd\" (UID: \"56705543-bea6-4ab2-a006-d173eee510bd\") "
Jul 20 18:25:37.920006 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.919985    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56705543-bea6-4ab2-a006-d173eee510bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "56705543-bea6-4ab2-a006-d173eee510bd" (UID: "56705543-bea6-4ab2-a006-d173eee510bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:25:37.921662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:37.921640    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56705543-bea6-4ab2-a006-d173eee510bd-kube-api-access-sfgxw" (OuterVolumeSpecName: "kube-api-access-sfgxw") pod "56705543-bea6-4ab2-a006-d173eee510bd" (UID: "56705543-bea6-4ab2-a006-d173eee510bd"). InnerVolumeSpecName "kube-api-access-sfgxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:25:38.020839 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.020815    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfgxw\" (UniqueName: \"kubernetes.io/projected/56705543-bea6-4ab2-a006-d173eee510bd-kube-api-access-sfgxw\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:25:38.020839 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.020838    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56705543-bea6-4ab2-a006-d173eee510bd-extensions-socket-volume\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:25:38.443298 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.443261    2560 generic.go:356] "Generic (PLEG): container finished" podID="56705543-bea6-4ab2-a006-d173eee510bd" containerID="7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab" exitCode=0
Jul 20 18:25:38.443784 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.443304    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"
Jul 20 18:25:38.443784 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.443344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2" event={"ID":"56705543-bea6-4ab2-a006-d173eee510bd","Type":"ContainerDied","Data":"7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab"}
Jul 20 18:25:38.443784 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.443394    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2" event={"ID":"56705543-bea6-4ab2-a006-d173eee510bd","Type":"ContainerDied","Data":"296171c8661c5dd27fdd8f667f15b271772cb0267f2b79736068bfa8929603b3"}
Jul 20 18:25:38.443784 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.443428    2560 scope.go:117] "RemoveContainer" containerID="7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab"
Jul 20 18:25:38.452999 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.452975    2560 scope.go:117] "RemoveContainer" containerID="7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab"
Jul 20 18:25:38.453356 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:25:38.453331    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab\": container with ID starting with 7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab not found: ID does not exist" containerID="7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab"
Jul 20 18:25:38.453460 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.453365    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab"} err="failed to get container status \"7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab\": rpc error: code = NotFound desc = could not find container \"7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab\": container with ID starting with 7843e25e338a26fe55edac9739d166d98b8d97c6ee75b20e4ebaaaaf087221ab not found: ID does not exist"
Jul 20 18:25:38.471596 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.471576    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"]
Jul 20 18:25:38.476226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:38.476206    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4gl2"]
Jul 20 18:25:39.487686 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:39.487655    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56705543-bea6-4ab2-a006-d173eee510bd" path="/var/lib/kubelet/pods/56705543-bea6-4ab2-a006-d173eee510bd/volumes"
Jul 20 18:25:56.581926 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.581898    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:25:56.582377 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.582297    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56705543-bea6-4ab2-a006-d173eee510bd" containerName="manager"
Jul 20 18:25:56.582377 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.582309    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56705543-bea6-4ab2-a006-d173eee510bd" containerName="manager"
Jul 20 18:25:56.582377 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.582372    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="56705543-bea6-4ab2-a006-d173eee510bd" containerName="manager"
Jul 20 18:25:56.584408 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.584391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:25:56.587593 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.587567    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xx5n8\""
Jul 20 18:25:56.587818 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.587803    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 18:25:56.613670 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.613648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:25:56.675339 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.675299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4cj4\" (UniqueName: \"kubernetes.io/projected/e3f8bc8b-4d7e-4bb1-b818-6357f516d18d-kube-api-access-x4cj4\") pod \"limitador-limitador-54d6d988d5-7jrd9\" (UID: \"e3f8bc8b-4d7e-4bb1-b818-6357f516d18d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:25:56.675494 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.675400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3f8bc8b-4d7e-4bb1-b818-6357f516d18d-config-file\") pod \"limitador-limitador-54d6d988d5-7jrd9\" (UID: \"e3f8bc8b-4d7e-4bb1-b818-6357f516d18d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:25:56.677470 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.677436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:25:56.776824 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.776788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4cj4\" (UniqueName: \"kubernetes.io/projected/e3f8bc8b-4d7e-4bb1-b818-6357f516d18d-kube-api-access-x4cj4\") pod \"limitador-limitador-54d6d988d5-7jrd9\" (UID: \"e3f8bc8b-4d7e-4bb1-b818-6357f516d18d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:25:56.776986 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.776834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3f8bc8b-4d7e-4bb1-b818-6357f516d18d-config-file\") pod \"limitador-limitador-54d6d988d5-7jrd9\" (UID: \"e3f8bc8b-4d7e-4bb1-b818-6357f516d18d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:25:56.777414 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.777396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3f8bc8b-4d7e-4bb1-b818-6357f516d18d-config-file\") pod \"limitador-limitador-54d6d988d5-7jrd9\" (UID: \"e3f8bc8b-4d7e-4bb1-b818-6357f516d18d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:25:56.787270 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.787248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4cj4\" (UniqueName: \"kubernetes.io/projected/e3f8bc8b-4d7e-4bb1-b818-6357f516d18d-kube-api-access-x4cj4\") pod \"limitador-limitador-54d6d988d5-7jrd9\" (UID: \"e3f8bc8b-4d7e-4bb1-b818-6357f516d18d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:25:56.895466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:56.895416    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:25:57.031702 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.031671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:25:57.033719 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:25:57.033690    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f8bc8b_4d7e_4bb1_b818_6357f516d18d.slice/crio-370c94173982b7323a0ed25c4c62a1e3820a58041b71608fa58b55961afeb8eb WatchSource:0}: Error finding container 370c94173982b7323a0ed25c4c62a1e3820a58041b71608fa58b55961afeb8eb: Status 404 returned error can't find the container with id 370c94173982b7323a0ed25c4c62a1e3820a58041b71608fa58b55961afeb8eb
Jul 20 18:25:57.074632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.074602    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mf5gs"]
Jul 20 18:25:57.078079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.078063    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mf5gs"
Jul 20 18:25:57.081453 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.081425    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-92m5b\""
Jul 20 18:25:57.087765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.087743    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mf5gs"]
Jul 20 18:25:57.179854 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.179782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4zl\" (UniqueName: \"kubernetes.io/projected/3df9836c-9a60-4d35-bbc9-6d514a2c3a3b-kube-api-access-dj4zl\") pod \"authorino-58cd955675-mf5gs\" (UID: \"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b\") " pod="kuadrant-system/authorino-58cd955675-mf5gs"
Jul 20 18:25:57.280879 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.280848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4zl\" (UniqueName: \"kubernetes.io/projected/3df9836c-9a60-4d35-bbc9-6d514a2c3a3b-kube-api-access-dj4zl\") pod \"authorino-58cd955675-mf5gs\" (UID: \"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b\") " pod="kuadrant-system/authorino-58cd955675-mf5gs"
Jul 20 18:25:57.295151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.295119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4zl\" (UniqueName: \"kubernetes.io/projected/3df9836c-9a60-4d35-bbc9-6d514a2c3a3b-kube-api-access-dj4zl\") pod \"authorino-58cd955675-mf5gs\" (UID: \"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b\") " pod="kuadrant-system/authorino-58cd955675-mf5gs"
Jul 20 18:25:57.388341 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.388313    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mf5gs"
Jul 20 18:25:57.563398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.563289    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mf5gs"]
Jul 20 18:25:57.563398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:57.563353    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9" event={"ID":"e3f8bc8b-4d7e-4bb1-b818-6357f516d18d","Type":"ContainerStarted","Data":"370c94173982b7323a0ed25c4c62a1e3820a58041b71608fa58b55961afeb8eb"}
Jul 20 18:25:57.566425 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:25:57.566391    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3df9836c_9a60_4d35_bbc9_6d514a2c3a3b.slice/crio-22257f52519be9118edc485879ad33ab7803f62726c21ff769e9b6daa5e61bf2 WatchSource:0}: Error finding container 22257f52519be9118edc485879ad33ab7803f62726c21ff769e9b6daa5e61bf2: Status 404 returned error can't find the container with id 22257f52519be9118edc485879ad33ab7803f62726c21ff769e9b6daa5e61bf2
Jul 20 18:25:58.571064 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:25:58.571020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mf5gs" event={"ID":"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b","Type":"ContainerStarted","Data":"22257f52519be9118edc485879ad33ab7803f62726c21ff769e9b6daa5e61bf2"}
Jul 20 18:26:00.586853 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:00.586813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9" event={"ID":"e3f8bc8b-4d7e-4bb1-b818-6357f516d18d","Type":"ContainerStarted","Data":"ad0f96f634c84fe90c97a498b79e504102ec4b6a6e7526c8ac72e604a2e1b886"}
Jul 20 18:26:00.587298 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:00.586974    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:26:00.610016 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:00.609927    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9" podStartSLOduration=1.256881047 podStartE2EDuration="4.609908191s" totalImagesPullingTime="3.353027144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:26:00.60627554 +0000 UTC m=+757.842543959" watchObservedRunningTime="2026-07-20 18:26:00.609908191 +0000 UTC m=+757.846176609"
Jul 20 18:26:01.599875 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:01.599788    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mf5gs" event={"ID":"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b","Type":"ContainerStarted","Data":"8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce"}
Jul 20 18:26:01.617597 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:01.617546    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mf5gs" podStartSLOduration=0.907283726 podStartE2EDuration="4.617532902s" totalImagesPullingTime="3.710249176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:26:01.616903392 +0000 UTC m=+758.853171807" watchObservedRunningTime="2026-07-20 18:26:01.617532902 +0000 UTC m=+758.853801324"
Jul 20 18:26:01.904380 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:01.904345    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mf5gs"]
Jul 20 18:26:03.609838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:03.609802    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mf5gs" podUID="3df9836c-9a60-4d35-bbc9-6d514a2c3a3b" containerName="authorino" containerID="cri-o://8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce" gracePeriod=30
Jul 20 18:26:03.869356 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:03.869332    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mf5gs"
Jul 20 18:26:03.939955 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:03.939932    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj4zl\" (UniqueName: \"kubernetes.io/projected/3df9836c-9a60-4d35-bbc9-6d514a2c3a3b-kube-api-access-dj4zl\") pod \"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b\" (UID: \"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b\") "
Jul 20 18:26:03.941778 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:03.941751    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3df9836c-9a60-4d35-bbc9-6d514a2c3a3b-kube-api-access-dj4zl" (OuterVolumeSpecName: "kube-api-access-dj4zl") pod "3df9836c-9a60-4d35-bbc9-6d514a2c3a3b" (UID: "3df9836c-9a60-4d35-bbc9-6d514a2c3a3b"). InnerVolumeSpecName "kube-api-access-dj4zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:26:04.041049 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.041022    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj4zl\" (UniqueName: \"kubernetes.io/projected/3df9836c-9a60-4d35-bbc9-6d514a2c3a3b-kube-api-access-dj4zl\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:26:04.616662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.616632    2560 generic.go:356] "Generic (PLEG): container finished" podID="3df9836c-9a60-4d35-bbc9-6d514a2c3a3b" containerID="8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce" exitCode=0
Jul 20 18:26:04.617085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.616670    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mf5gs"
Jul 20 18:26:04.617085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.616694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mf5gs" event={"ID":"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b","Type":"ContainerDied","Data":"8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce"}
Jul 20 18:26:04.617085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.616721    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mf5gs" event={"ID":"3df9836c-9a60-4d35-bbc9-6d514a2c3a3b","Type":"ContainerDied","Data":"22257f52519be9118edc485879ad33ab7803f62726c21ff769e9b6daa5e61bf2"}
Jul 20 18:26:04.617085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.616737    2560 scope.go:117] "RemoveContainer" containerID="8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce"
Jul 20 18:26:04.625915 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.625897    2560 scope.go:117] "RemoveContainer" containerID="8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce"
Jul 20 18:26:04.626176 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:26:04.626156    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce\": container with ID starting with 8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce not found: ID does not exist" containerID="8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce"
Jul 20 18:26:04.626250 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.626187    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce"} err="failed to get container status \"8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce\": rpc error: code = NotFound desc = could not find container \"8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce\": container with ID starting with 8ac52b51d06878b4c07efae95998d130ae5668a86db14adc22ca1f33f7647cce not found: ID does not exist"
Jul 20 18:26:04.639909 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.639889    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mf5gs"]
Jul 20 18:26:04.643409 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:04.643391    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mf5gs"]
Jul 20 18:26:05.488554 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:05.488522    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3df9836c-9a60-4d35-bbc9-6d514a2c3a3b" path="/var/lib/kubelet/pods/3df9836c-9a60-4d35-bbc9-6d514a2c3a3b/volumes"
Jul 20 18:26:11.601250 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:11.601210    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"
Jul 20 18:26:30.971686 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:30.971647    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-559c54c5bd-7xfsn"]
Jul 20 18:26:30.972104 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:30.972031    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3df9836c-9a60-4d35-bbc9-6d514a2c3a3b" containerName="authorino"
Jul 20 18:26:30.972104 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:30.972041    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3df9836c-9a60-4d35-bbc9-6d514a2c3a3b" containerName="authorino"
Jul 20 18:26:30.972185 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:30.972110    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3df9836c-9a60-4d35-bbc9-6d514a2c3a3b" containerName="authorino"
Jul 20 18:26:30.976692 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:30.976668    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559c54c5bd-7xfsn"
Jul 20 18:26:30.979226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:30.979206    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-92m5b\""
Jul 20 18:26:30.987723 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:30.987692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-559c54c5bd-7xfsn"]
Jul 20 18:26:31.065954 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.065921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2czq8\" (UniqueName: \"kubernetes.io/projected/99a76e3f-3632-4930-8ba2-c52f9f0469ba-kube-api-access-2czq8\") pod \"authorino-559c54c5bd-7xfsn\" (UID: \"99a76e3f-3632-4930-8ba2-c52f9f0469ba\") " pod="kuadrant-system/authorino-559c54c5bd-7xfsn"
Jul 20 18:26:31.167226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.167185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2czq8\" (UniqueName: \"kubernetes.io/projected/99a76e3f-3632-4930-8ba2-c52f9f0469ba-kube-api-access-2czq8\") pod \"authorino-559c54c5bd-7xfsn\" (UID: \"99a76e3f-3632-4930-8ba2-c52f9f0469ba\") " pod="kuadrant-system/authorino-559c54c5bd-7xfsn"
Jul 20 18:26:31.191864 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.191831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2czq8\" (UniqueName: \"kubernetes.io/projected/99a76e3f-3632-4930-8ba2-c52f9f0469ba-kube-api-access-2czq8\") pod \"authorino-559c54c5bd-7xfsn\" (UID: \"99a76e3f-3632-4930-8ba2-c52f9f0469ba\") " pod="kuadrant-system/authorino-559c54c5bd-7xfsn"
Jul 20 18:26:31.264314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.264215    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-559c54c5bd-7xfsn"]
Jul 20 18:26:31.264565 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.264549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559c54c5bd-7xfsn"
Jul 20 18:26:31.315011 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.314972    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7759448f7b-p6h2r"]
Jul 20 18:26:31.319748 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.319722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:26:31.330952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.330427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 18:26:31.335352 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.335315    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7759448f7b-p6h2r"]
Jul 20 18:26:31.434046 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.434013    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-559c54c5bd-7xfsn"]
Jul 20 18:26:31.435423 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:26:31.435398    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99a76e3f_3632_4930_8ba2_c52f9f0469ba.slice/crio-b5e2f40442fbd4be4d5a79c150cc4d0b04050f2ab9abf13fd3e2de8249a25ee2 WatchSource:0}: Error finding container b5e2f40442fbd4be4d5a79c150cc4d0b04050f2ab9abf13fd3e2de8249a25ee2: Status 404 returned error can't find the container with id b5e2f40442fbd4be4d5a79c150cc4d0b04050f2ab9abf13fd3e2de8249a25ee2
Jul 20 18:26:31.470613 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.470579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5nb6\" (UniqueName: \"kubernetes.io/projected/5930ad7b-1b05-417c-b429-69d97073d088-kube-api-access-d5nb6\") pod \"authorino-7759448f7b-p6h2r\" (UID: \"5930ad7b-1b05-417c-b429-69d97073d088\") " pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:26:31.470613 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.470623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5930ad7b-1b05-417c-b429-69d97073d088-tls-cert\") pod \"authorino-7759448f7b-p6h2r\" (UID: \"5930ad7b-1b05-417c-b429-69d97073d088\") " pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:26:31.571137 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.571036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5nb6\" (UniqueName: \"kubernetes.io/projected/5930ad7b-1b05-417c-b429-69d97073d088-kube-api-access-d5nb6\") pod \"authorino-7759448f7b-p6h2r\" (UID: \"5930ad7b-1b05-417c-b429-69d97073d088\") " pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:26:31.571320 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.571081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5930ad7b-1b05-417c-b429-69d97073d088-tls-cert\") pod \"authorino-7759448f7b-p6h2r\" (UID: \"5930ad7b-1b05-417c-b429-69d97073d088\") " pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:26:31.573652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.573629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5930ad7b-1b05-417c-b429-69d97073d088-tls-cert\") pod \"authorino-7759448f7b-p6h2r\" (UID: \"5930ad7b-1b05-417c-b429-69d97073d088\") " pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:26:31.581161 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.581128    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5nb6\" (UniqueName: \"kubernetes.io/projected/5930ad7b-1b05-417c-b429-69d97073d088-kube-api-access-d5nb6\") pod \"authorino-7759448f7b-p6h2r\" (UID: \"5930ad7b-1b05-417c-b429-69d97073d088\") " pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:26:31.631866 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.631830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:26:31.769879 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.769848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559c54c5bd-7xfsn" event={"ID":"99a76e3f-3632-4930-8ba2-c52f9f0469ba","Type":"ContainerStarted","Data":"b5e2f40442fbd4be4d5a79c150cc4d0b04050f2ab9abf13fd3e2de8249a25ee2"}
Jul 20 18:26:31.791352 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:31.791316    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7759448f7b-p6h2r"]
Jul 20 18:26:31.791720 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:26:31.791699    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5930ad7b_1b05_417c_b429_69d97073d088.slice/crio-7d76f7aa89f7d22a060cc4cd7cea592ae852ee9fb808fbbef7f38e31415e7f40 WatchSource:0}: Error finding container 7d76f7aa89f7d22a060cc4cd7cea592ae852ee9fb808fbbef7f38e31415e7f40: Status 404 returned error can't find the container with id 7d76f7aa89f7d22a060cc4cd7cea592ae852ee9fb808fbbef7f38e31415e7f40
Jul 20 18:26:32.776932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:32.776894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7759448f7b-p6h2r" event={"ID":"5930ad7b-1b05-417c-b429-69d97073d088","Type":"ContainerStarted","Data":"c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4"}
Jul 20 18:26:32.777361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:32.776943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7759448f7b-p6h2r" event={"ID":"5930ad7b-1b05-417c-b429-69d97073d088","Type":"ContainerStarted","Data":"7d76f7aa89f7d22a060cc4cd7cea592ae852ee9fb808fbbef7f38e31415e7f40"}
Jul 20 18:26:32.778607 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:32.778575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559c54c5bd-7xfsn" event={"ID":"99a76e3f-3632-4930-8ba2-c52f9f0469ba","Type":"ContainerStarted","Data":"0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a"}
Jul 20 18:26:32.778761 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:32.778640    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-559c54c5bd-7xfsn" podUID="99a76e3f-3632-4930-8ba2-c52f9f0469ba" containerName="authorino" containerID="cri-o://0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a" gracePeriod=30
Jul 20 18:26:32.798694 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:32.798635    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7759448f7b-p6h2r" podStartSLOduration=1.424688036 podStartE2EDuration="1.798612245s" totalImagesPullingTime="373.924209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:26:32.7980383 +0000 UTC m=+790.034306716" watchObservedRunningTime="2026-07-20 18:26:32.798612245 +0000 UTC m=+790.034880661"
Jul 20 18:26:32.817824 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:32.817763    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-559c54c5bd-7xfsn" podStartSLOduration=2.220516845 podStartE2EDuration="2.817744482s" totalImagesPullingTime="597.227637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:26:32.817372907 +0000 UTC m=+790.053641323" watchObservedRunningTime="2026-07-20 18:26:32.817744482 +0000 UTC m=+790.054012901"
Jul 20 18:26:33.065547 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.065516    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559c54c5bd-7xfsn"
Jul 20 18:26:33.185586 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.185548    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2czq8\" (UniqueName: \"kubernetes.io/projected/99a76e3f-3632-4930-8ba2-c52f9f0469ba-kube-api-access-2czq8\") pod \"99a76e3f-3632-4930-8ba2-c52f9f0469ba\" (UID: \"99a76e3f-3632-4930-8ba2-c52f9f0469ba\") "
Jul 20 18:26:33.187652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.187626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a76e3f-3632-4930-8ba2-c52f9f0469ba-kube-api-access-2czq8" (OuterVolumeSpecName: "kube-api-access-2czq8") pod "99a76e3f-3632-4930-8ba2-c52f9f0469ba" (UID: "99a76e3f-3632-4930-8ba2-c52f9f0469ba"). InnerVolumeSpecName "kube-api-access-2czq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:26:33.286520 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.286417    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2czq8\" (UniqueName: \"kubernetes.io/projected/99a76e3f-3632-4930-8ba2-c52f9f0469ba-kube-api-access-2czq8\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:26:33.786077 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.786035    2560 generic.go:356] "Generic (PLEG): container finished" podID="99a76e3f-3632-4930-8ba2-c52f9f0469ba" containerID="0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a" exitCode=0
Jul 20 18:26:33.786684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.786099    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559c54c5bd-7xfsn"
Jul 20 18:26:33.786684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.786123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559c54c5bd-7xfsn" event={"ID":"99a76e3f-3632-4930-8ba2-c52f9f0469ba","Type":"ContainerDied","Data":"0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a"}
Jul 20 18:26:33.786684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.786167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559c54c5bd-7xfsn" event={"ID":"99a76e3f-3632-4930-8ba2-c52f9f0469ba","Type":"ContainerDied","Data":"b5e2f40442fbd4be4d5a79c150cc4d0b04050f2ab9abf13fd3e2de8249a25ee2"}
Jul 20 18:26:33.786684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.786184    2560 scope.go:117] "RemoveContainer" containerID="0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a"
Jul 20 18:26:33.795267 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.795246    2560 scope.go:117] "RemoveContainer" containerID="0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a"
Jul 20 18:26:33.795592 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:26:33.795570    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a\": container with ID starting with 0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a not found: ID does not exist" containerID="0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a"
Jul 20 18:26:33.795669 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.795602    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a"} err="failed to get container status \"0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a\": rpc error: code = NotFound desc = could not find container \"0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a\": container with ID starting with 0f15f888dedff59d8321d2a34d741b21e074864318c2cee4c54642ea8a859a4a not found: ID does not exist"
Jul 20 18:26:33.811524 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.811486    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-559c54c5bd-7xfsn"]
Jul 20 18:26:33.817420 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:33.817393    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-559c54c5bd-7xfsn"]
Jul 20 18:26:35.489588 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:26:35.489546    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a76e3f-3632-4930-8ba2-c52f9f0469ba" path="/var/lib/kubelet/pods/99a76e3f-3632-4930-8ba2-c52f9f0469ba/volumes"
Jul 20 18:27:13.892328 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:27:13.892281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:27:54.469778 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:27:54.469738    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:28:05.722283 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:28:05.722238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:28:18.504857 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:28:18.504768    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:28:31.713551 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:28:31.713512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:28:55.501874 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:28:55.501837    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:29:11.401692 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.401654    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"]
Jul 20 18:29:11.402300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.402246    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a76e3f-3632-4930-8ba2-c52f9f0469ba" containerName="authorino"
Jul 20 18:29:11.402300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.402266    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a76e3f-3632-4930-8ba2-c52f9f0469ba" containerName="authorino"
Jul 20 18:29:11.402417 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.402383    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a76e3f-3632-4930-8ba2-c52f9f0469ba" containerName="authorino"
Jul 20 18:29:11.404562 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.404541    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.408518 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.408493    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 18:29:11.409309 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.409293    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-79fz4\""
Jul 20 18:29:11.409436 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.409419    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 18:29:11.409502 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.409473    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 18:29:11.425646 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.425610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"]
Jul 20 18:29:11.480712 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.480671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.480712 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.480715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c58cc81-0508-4f83-a860-68fbf96b063c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.480940 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.480748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.480940 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.480828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.480940 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.480891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74spr\" (UniqueName: \"kubernetes.io/projected/9c58cc81-0508-4f83-a860-68fbf96b063c-kube-api-access-74spr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.480940 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.480909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.582336 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.582581 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c58cc81-0508-4f83-a860-68fbf96b063c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.582581 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.582581 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.582774 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74spr\" (UniqueName: \"kubernetes.io/projected/9c58cc81-0508-4f83-a860-68fbf96b063c-kube-api-access-74spr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.582774 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.582884 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.582995 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.583078 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.582991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.584907 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.584879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c58cc81-0508-4f83-a860-68fbf96b063c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.585030 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.585012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c58cc81-0508-4f83-a860-68fbf96b063c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.594766 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.594743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74spr\" (UniqueName: \"kubernetes.io/projected/9c58cc81-0508-4f83-a860-68fbf96b063c-kube-api-access-74spr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2q8st\" (UID: \"9c58cc81-0508-4f83-a860-68fbf96b063c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.714711 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.714620    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:11.866452 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:11.866408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"]
Jul 20 18:29:11.868041 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:29:11.868011    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c58cc81_0508_4f83_a860_68fbf96b063c.slice/crio-c5817a4f68c7a48eaba4bd83dbd8a88dbe07b574fd57b1b44b4bc3b4d802696e WatchSource:0}: Error finding container c5817a4f68c7a48eaba4bd83dbd8a88dbe07b574fd57b1b44b4bc3b4d802696e: Status 404 returned error can't find the container with id c5817a4f68c7a48eaba4bd83dbd8a88dbe07b574fd57b1b44b4bc3b4d802696e
Jul 20 18:29:12.671840 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:12.671783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st" event={"ID":"9c58cc81-0508-4f83-a860-68fbf96b063c","Type":"ContainerStarted","Data":"c5817a4f68c7a48eaba4bd83dbd8a88dbe07b574fd57b1b44b4bc3b4d802696e"}
Jul 20 18:29:13.679122 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:13.679085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st" event={"ID":"9c58cc81-0508-4f83-a860-68fbf96b063c","Type":"ContainerStarted","Data":"246ea3037621dc64ea93813954c29792831a7c66e5e0372d3ac483d8e8ddf387"}
Jul 20 18:29:13.700762 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:13.700703    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st" podStartSLOduration=1.6522358339999998 podStartE2EDuration="2.70068544s" totalImagesPullingTime="1.048449606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:29:13.69975637 +0000 UTC m=+950.936024787" watchObservedRunningTime="2026-07-20 18:29:13.70068544 +0000 UTC m=+950.936953854"
Jul 20 18:29:14.103308 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:14.103219    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:29:21.715670 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:21.715625    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:21.715670 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:21.715670    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:21.729534 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:21.729504    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:29:21.741345 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:29:21.741317    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2q8st"
Jul 20 18:30:22.560782 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.560743    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f9bdd66f-9zm7t"]
Jul 20 18:30:22.564404 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.564381    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9bdd66f-9zm7t"
Jul 20 18:30:22.571858 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.571619    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9bdd66f-9zm7t"]
Jul 20 18:30:22.613097 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.613059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85g69\" (UniqueName: \"kubernetes.io/projected/f48f1345-ccad-4a61-aaab-7980ec379448-kube-api-access-85g69\") pod \"authorino-6f9bdd66f-9zm7t\" (UID: \"f48f1345-ccad-4a61-aaab-7980ec379448\") " pod="kuadrant-system/authorino-6f9bdd66f-9zm7t"
Jul 20 18:30:22.613303 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.613143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f48f1345-ccad-4a61-aaab-7980ec379448-tls-cert\") pod \"authorino-6f9bdd66f-9zm7t\" (UID: \"f48f1345-ccad-4a61-aaab-7980ec379448\") " pod="kuadrant-system/authorino-6f9bdd66f-9zm7t"
Jul 20 18:30:22.713813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.713777    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f48f1345-ccad-4a61-aaab-7980ec379448-tls-cert\") pod \"authorino-6f9bdd66f-9zm7t\" (UID: \"f48f1345-ccad-4a61-aaab-7980ec379448\") " pod="kuadrant-system/authorino-6f9bdd66f-9zm7t"
Jul 20 18:30:22.714021 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.713832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85g69\" (UniqueName: \"kubernetes.io/projected/f48f1345-ccad-4a61-aaab-7980ec379448-kube-api-access-85g69\") pod \"authorino-6f9bdd66f-9zm7t\" (UID: \"f48f1345-ccad-4a61-aaab-7980ec379448\") " pod="kuadrant-system/authorino-6f9bdd66f-9zm7t"
Jul 20 18:30:22.716383 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.716351    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f48f1345-ccad-4a61-aaab-7980ec379448-tls-cert\") pod \"authorino-6f9bdd66f-9zm7t\" (UID: \"f48f1345-ccad-4a61-aaab-7980ec379448\") " pod="kuadrant-system/authorino-6f9bdd66f-9zm7t"
Jul 20 18:30:22.722249 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.722224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85g69\" (UniqueName: \"kubernetes.io/projected/f48f1345-ccad-4a61-aaab-7980ec379448-kube-api-access-85g69\") pod \"authorino-6f9bdd66f-9zm7t\" (UID: \"f48f1345-ccad-4a61-aaab-7980ec379448\") " pod="kuadrant-system/authorino-6f9bdd66f-9zm7t"
Jul 20 18:30:22.875503 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:22.875473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9bdd66f-9zm7t"
Jul 20 18:30:23.022166 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:23.022132    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9bdd66f-9zm7t"]
Jul 20 18:30:23.025903 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:30:23.025872    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf48f1345_ccad_4a61_aaab_7980ec379448.slice/crio-1fd09b1686e0094e3d7f0a88d5a92ae693b5596d39ae62c370b70d76b40ce6e8 WatchSource:0}: Error finding container 1fd09b1686e0094e3d7f0a88d5a92ae693b5596d39ae62c370b70d76b40ce6e8: Status 404 returned error can't find the container with id 1fd09b1686e0094e3d7f0a88d5a92ae693b5596d39ae62c370b70d76b40ce6e8
Jul 20 18:30:23.027226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:23.027208    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:30:23.077802 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:23.077764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f9bdd66f-9zm7t" event={"ID":"f48f1345-ccad-4a61-aaab-7980ec379448","Type":"ContainerStarted","Data":"1fd09b1686e0094e3d7f0a88d5a92ae693b5596d39ae62c370b70d76b40ce6e8"}
Jul 20 18:30:24.086518 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.086473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f9bdd66f-9zm7t" event={"ID":"f48f1345-ccad-4a61-aaab-7980ec379448","Type":"ContainerStarted","Data":"28e27890fe217e028e0db19fcb8cd59f21c03fa2084d0990a27cf54dc36590e4"}
Jul 20 18:30:24.109975 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.109907    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f9bdd66f-9zm7t" podStartSLOduration=1.697627816 podStartE2EDuration="2.10988152s" totalImagesPullingTime="412.253704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:30:24.105557819 +0000 UTC m=+1021.341826235" watchObservedRunningTime="2026-07-20 18:30:24.10988152 +0000 UTC m=+1021.346149936"
Jul 20 18:30:24.137810 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.137768    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7759448f7b-p6h2r"]
Jul 20 18:30:24.138011 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.137933    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7759448f7b-p6h2r" podUID="5930ad7b-1b05-417c-b429-69d97073d088" containerName="authorino" containerID="cri-o://c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4" gracePeriod=30
Jul 20 18:30:24.423415 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.423387    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:30:24.431974 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.431229    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5930ad7b-1b05-417c-b429-69d97073d088-tls-cert\") pod \"5930ad7b-1b05-417c-b429-69d97073d088\" (UID: \"5930ad7b-1b05-417c-b429-69d97073d088\") "
Jul 20 18:30:24.431974 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.431323    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5nb6\" (UniqueName: \"kubernetes.io/projected/5930ad7b-1b05-417c-b429-69d97073d088-kube-api-access-d5nb6\") pod \"5930ad7b-1b05-417c-b429-69d97073d088\" (UID: \"5930ad7b-1b05-417c-b429-69d97073d088\") "
Jul 20 18:30:24.434111 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.434082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5930ad7b-1b05-417c-b429-69d97073d088-kube-api-access-d5nb6" (OuterVolumeSpecName: "kube-api-access-d5nb6") pod "5930ad7b-1b05-417c-b429-69d97073d088" (UID: "5930ad7b-1b05-417c-b429-69d97073d088"). InnerVolumeSpecName "kube-api-access-d5nb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:30:24.444679 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.444632    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5930ad7b-1b05-417c-b429-69d97073d088-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5930ad7b-1b05-417c-b429-69d97073d088" (UID: "5930ad7b-1b05-417c-b429-69d97073d088"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:30:24.532634 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.532596    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5930ad7b-1b05-417c-b429-69d97073d088-tls-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:30:24.532634 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:24.532626    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5nb6\" (UniqueName: \"kubernetes.io/projected/5930ad7b-1b05-417c-b429-69d97073d088-kube-api-access-d5nb6\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:30:25.093122 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.093026    2560 generic.go:356] "Generic (PLEG): container finished" podID="5930ad7b-1b05-417c-b429-69d97073d088" containerID="c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4" exitCode=0
Jul 20 18:30:25.093122 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.093081    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7759448f7b-p6h2r"
Jul 20 18:30:25.093122 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.093114    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7759448f7b-p6h2r" event={"ID":"5930ad7b-1b05-417c-b429-69d97073d088","Type":"ContainerDied","Data":"c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4"}
Jul 20 18:30:25.093700 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.093157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7759448f7b-p6h2r" event={"ID":"5930ad7b-1b05-417c-b429-69d97073d088","Type":"ContainerDied","Data":"7d76f7aa89f7d22a060cc4cd7cea592ae852ee9fb808fbbef7f38e31415e7f40"}
Jul 20 18:30:25.093700 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.093178    2560 scope.go:117] "RemoveContainer" containerID="c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4"
Jul 20 18:30:25.104299 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.104281    2560 scope.go:117] "RemoveContainer" containerID="c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4"
Jul 20 18:30:25.104711 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:30:25.104693    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4\": container with ID starting with c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4 not found: ID does not exist" containerID="c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4"
Jul 20 18:30:25.104791 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.104724    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4"} err="failed to get container status \"c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4\": rpc error: code = NotFound desc = could not find container \"c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4\": container with ID starting with c68dc2517df99d368b3af27bdb3f5a84c47b133fa4d71839e2811fbf300fbfe4 not found: ID does not exist"
Jul 20 18:30:25.126456 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.126395    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7759448f7b-p6h2r"]
Jul 20 18:30:25.129217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.129188    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7759448f7b-p6h2r"]
Jul 20 18:30:25.493685 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:25.493641    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5930ad7b-1b05-417c-b429-69d97073d088" path="/var/lib/kubelet/pods/5930ad7b-1b05-417c-b429-69d97073d088/volumes"
Jul 20 18:30:55.293241 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:30:55.293197    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:31:04.595070 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:31:04.595038    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:31:15.106400 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:31:15.106289    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:32:54.191804 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:32:54.191714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:33:09.632413 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:33:09.632376    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:33:41.686397 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:33:41.686360    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:33:51.181746 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:33:51.181712    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:34:00.420318 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:34:00.420282    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:34:08.892796 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:34:08.892762    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:34:20.384581 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:34:20.384479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:34:30.218319 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:34:30.218281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:34:40.908160 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:34:40.908122    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:34:51.085988 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:34:51.085954    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:35:15.904024 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:35:15.903984    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:35:28.384824 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:35:28.384784    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:35:53.393560 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:35:53.393477    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:36:04.581938 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:36:04.581903    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:36:18.911253 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:36:18.911216    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:36:30.510479 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:36:30.510421    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:36:45.287175 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:36:45.287136    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:37:23.452505 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:23.452406    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"]
Jul 20 18:37:23.453159 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:23.452666    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57" podUID="4f7d267a-60c8-4f1f-bcbd-f16862bdf6da" containerName="manager" containerID="cri-o://ec7269450befb5fe91f5079dacaed27b1abcafc53c5c051f841e4e52ee1b1d7b" gracePeriod=10
Jul 20 18:37:26.507181 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:26.507153    2560 generic.go:356] "Generic (PLEG): container finished" podID="4f7d267a-60c8-4f1f-bcbd-f16862bdf6da" containerID="ec7269450befb5fe91f5079dacaed27b1abcafc53c5c051f841e4e52ee1b1d7b" exitCode=0
Jul 20 18:37:26.507503 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:26.507208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57" event={"ID":"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da","Type":"ContainerDied","Data":"ec7269450befb5fe91f5079dacaed27b1abcafc53c5c051f841e4e52ee1b1d7b"}
Jul 20 18:37:27.008647 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.008625    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:37:27.172928 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.172902    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-extensions-socket-volume\") pod \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\" (UID: \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\") "
Jul 20 18:37:27.173134 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.172978    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6l5t\" (UniqueName: \"kubernetes.io/projected/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-kube-api-access-r6l5t\") pod \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\" (UID: \"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da\") "
Jul 20 18:37:27.173276 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.173250    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4f7d267a-60c8-4f1f-bcbd-f16862bdf6da" (UID: "4f7d267a-60c8-4f1f-bcbd-f16862bdf6da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:37:27.174929 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.174908    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-kube-api-access-r6l5t" (OuterVolumeSpecName: "kube-api-access-r6l5t") pod "4f7d267a-60c8-4f1f-bcbd-f16862bdf6da" (UID: "4f7d267a-60c8-4f1f-bcbd-f16862bdf6da"). InnerVolumeSpecName "kube-api-access-r6l5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:37:27.273540 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.273502    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-extensions-socket-volume\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:37:27.273540 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.273537    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6l5t\" (UniqueName: \"kubernetes.io/projected/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da-kube-api-access-r6l5t\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:37:27.513384 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.513359    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"
Jul 20 18:37:27.513813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.513393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57" event={"ID":"4f7d267a-60c8-4f1f-bcbd-f16862bdf6da","Type":"ContainerDied","Data":"5fef9e703d2a540c445d34db4565494483f5f80e3516fc091d4a6a9a938bfeca"}
Jul 20 18:37:27.513813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.513480    2560 scope.go:117] "RemoveContainer" containerID="ec7269450befb5fe91f5079dacaed27b1abcafc53c5c051f841e4e52ee1b1d7b"
Jul 20 18:37:27.531526 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.531504    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"]
Jul 20 18:37:27.535906 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:27.535879    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fk57"]
Jul 20 18:37:29.488742 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:37:29.488707    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f7d267a-60c8-4f1f-bcbd-f16862bdf6da" path="/var/lib/kubelet/pods/4f7d267a-60c8-4f1f-bcbd-f16862bdf6da/volumes"
Jul 20 18:38:24.639191 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.639154    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"]
Jul 20 18:38:24.639813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.639795    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f7d267a-60c8-4f1f-bcbd-f16862bdf6da" containerName="manager"
Jul 20 18:38:24.639859 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.639816    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f7d267a-60c8-4f1f-bcbd-f16862bdf6da" containerName="manager"
Jul 20 18:38:24.639859 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.639844    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5930ad7b-1b05-417c-b429-69d97073d088" containerName="authorino"
Jul 20 18:38:24.639859 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.639854    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5930ad7b-1b05-417c-b429-69d97073d088" containerName="authorino"
Jul 20 18:38:24.639955 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.639942    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f7d267a-60c8-4f1f-bcbd-f16862bdf6da" containerName="manager"
Jul 20 18:38:24.639955 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.639954    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5930ad7b-1b05-417c-b429-69d97073d088" containerName="authorino"
Jul 20 18:38:24.643472 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.643455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:24.645938 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.645920    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z2ttw\""
Jul 20 18:38:24.658893 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.658859    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"]
Jul 20 18:38:24.760321 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.760278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e07cae97-1a7c-4073-ad04-b34debe347df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfmm\" (UID: \"e07cae97-1a7c-4073-ad04-b34debe347df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:24.760538 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.760379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76986\" (UniqueName: \"kubernetes.io/projected/e07cae97-1a7c-4073-ad04-b34debe347df-kube-api-access-76986\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfmm\" (UID: \"e07cae97-1a7c-4073-ad04-b34debe347df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:24.861664 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.861631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76986\" (UniqueName: \"kubernetes.io/projected/e07cae97-1a7c-4073-ad04-b34debe347df-kube-api-access-76986\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfmm\" (UID: \"e07cae97-1a7c-4073-ad04-b34debe347df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:24.861868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.861696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e07cae97-1a7c-4073-ad04-b34debe347df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfmm\" (UID: \"e07cae97-1a7c-4073-ad04-b34debe347df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:24.862102 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.862079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e07cae97-1a7c-4073-ad04-b34debe347df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfmm\" (UID: \"e07cae97-1a7c-4073-ad04-b34debe347df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:24.870188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.870166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76986\" (UniqueName: \"kubernetes.io/projected/e07cae97-1a7c-4073-ad04-b34debe347df-kube-api-access-76986\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfmm\" (UID: \"e07cae97-1a7c-4073-ad04-b34debe347df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:24.954219 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:24.954131    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:25.122254 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:38:25.122221    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07cae97_1a7c_4073_ad04_b34debe347df.slice/crio-1f0b4274332a9b45a9a62276904b91bec75dc5a80967e90e4d3069ec26fff863 WatchSource:0}: Error finding container 1f0b4274332a9b45a9a62276904b91bec75dc5a80967e90e4d3069ec26fff863: Status 404 returned error can't find the container with id 1f0b4274332a9b45a9a62276904b91bec75dc5a80967e90e4d3069ec26fff863
Jul 20 18:38:25.123603 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:25.123575    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"]
Jul 20 18:38:25.838684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:25.838647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm" event={"ID":"e07cae97-1a7c-4073-ad04-b34debe347df","Type":"ContainerStarted","Data":"686a91b94c2083921d7d03b073041616e9b908119d3596cefe3f6339ef7ad531"}
Jul 20 18:38:25.839170 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:25.838724    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm" event={"ID":"e07cae97-1a7c-4073-ad04-b34debe347df","Type":"ContainerStarted","Data":"1f0b4274332a9b45a9a62276904b91bec75dc5a80967e90e4d3069ec26fff863"}
Jul 20 18:38:25.839170 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:25.838753    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:25.868107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:25.868044    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm" podStartSLOduration=1.8680263209999999 podStartE2EDuration="1.868026321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:38:25.85914486 +0000 UTC m=+1503.095413299" watchObservedRunningTime="2026-07-20 18:38:25.868026321 +0000 UTC m=+1503.104294736"
Jul 20 18:38:36.846690 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:36.846658    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfmm"
Jul 20 18:38:44.982503 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:44.982397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:38:56.696904 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:38:56.696867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:39:05.684198 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:39:05.684158    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:39:17.599005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:39:17.598960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:39:29.191958 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:39:29.191917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:39:38.689401 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:39:38.689362    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:39:48.091179 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:39:48.091146    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:39:59.794187 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:39:59.794148    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:40:10.792496 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:40:10.792452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:40:19.497378 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:40:19.497289    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:40:30.588369 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:40:30.588331    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:40:56.688731 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:40:56.688692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:41:04.383837 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:04.383803    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:41:12.696888 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.696842    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"]
Jul 20 18:41:12.700604 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.700586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.703105 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.703084    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-5cab9fec-kserve-self-signed-certs\""
Jul 20 18:41:12.720088 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.720062    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"]
Jul 20 18:41:12.791097 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.791055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpn78\" (UniqueName: \"kubernetes.io/projected/2f33e6fb-6631-40ea-8302-765a9357d804-kube-api-access-wpn78\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.791305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.791109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-home\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.791305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.791193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f33e6fb-6631-40ea-8302-765a9357d804-tls-certs\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.791305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.791239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-tmp-dir\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.791305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.791258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-model-cache\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.791305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.791300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-dshm\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892289 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpn78\" (UniqueName: \"kubernetes.io/projected/2f33e6fb-6631-40ea-8302-765a9357d804-kube-api-access-wpn78\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892542 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-home\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892542 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f33e6fb-6631-40ea-8302-765a9357d804-tls-certs\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892542 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-tmp-dir\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892542 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-model-cache\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892542 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-dshm\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892867 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-model-cache\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892921 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-home\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.892921 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.892889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-tmp-dir\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.894843 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.894819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-dshm\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.895019 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.895001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f33e6fb-6631-40ea-8302-765a9357d804-tls-certs\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:12.900981 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:12.900957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpn78\" (UniqueName: \"kubernetes.io/projected/2f33e6fb-6631-40ea-8302-765a9357d804-kube-api-access-wpn78\") pod \"e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") " pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:13.009698 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:13.009609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:13.155344 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:13.155307    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"]
Jul 20 18:41:13.158028 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:41:13.157996    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f33e6fb_6631_40ea_8302_765a9357d804.slice/crio-1ec169f068e3f2849bb759cb3717a935bf2e2ada7f6ca5500345fd82740cd04b WatchSource:0}: Error finding container 1ec169f068e3f2849bb759cb3717a935bf2e2ada7f6ca5500345fd82740cd04b: Status 404 returned error can't find the container with id 1ec169f068e3f2849bb759cb3717a935bf2e2ada7f6ca5500345fd82740cd04b
Jul 20 18:41:13.817153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:13.817118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g" event={"ID":"2f33e6fb-6631-40ea-8302-765a9357d804","Type":"ContainerStarted","Data":"0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449"}
Jul 20 18:41:13.817690 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:13.817167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g" event={"ID":"2f33e6fb-6631-40ea-8302-765a9357d804","Type":"ContainerStarted","Data":"1ec169f068e3f2849bb759cb3717a935bf2e2ada7f6ca5500345fd82740cd04b"}
Jul 20 18:41:13.838232 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:13.838168    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g" podStartSLOduration=1.8381460029999999 podStartE2EDuration="1.838146003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:41:13.836619374 +0000 UTC m=+1671.072887789" watchObservedRunningTime="2026-07-20 18:41:13.838146003 +0000 UTC m=+1671.074414419"
Jul 20 18:41:16.388563 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:16.388527    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:41:23.009992 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.009905    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:23.010410 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.010186    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:23.022311 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.022284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:23.162426 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.162387    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"]
Jul 20 18:41:23.166332 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.166309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.168614 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.168596    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-5cab9fec-kserve-self-signed-certs\""
Jul 20 18:41:23.177549 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.177527    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"]
Jul 20 18:41:23.287213 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.287094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-model-cache\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.287213 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.287141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tmp-dir\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.287213 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.287191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rr2v\" (UniqueName: \"kubernetes.io/projected/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-kube-api-access-5rr2v\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.287471 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.287218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-home\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.287471 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.287271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-dshm\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.287471 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.287293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tls-certs\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.388766 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.388730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rr2v\" (UniqueName: \"kubernetes.io/projected/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-kube-api-access-5rr2v\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.388952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.388777    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-home\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.388952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.388820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-dshm\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.388952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.388845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tls-certs\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.388952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.388864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-model-cache\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.388952 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.388892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tmp-dir\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.389363 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.389334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-home\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.389485 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.389411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tmp-dir\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.389485 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.389470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-model-cache\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.391228 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.391209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-dshm\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.391545 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.391530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tls-certs\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.396834 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.396810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rr2v\" (UniqueName: \"kubernetes.io/projected/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-kube-api-access-5rr2v\") pod \"e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") " pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.477057 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.477022    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:23.624973 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.624944    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"]
Jul 20 18:41:23.627381 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:41:23.627351    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33f17d77_70a3_4ffa_9b65_7dd89ef0064f.slice/crio-f67aa0461cadf4788acd75148cea787be3f9b2ffec8c12419fa244493bf46ee0 WatchSource:0}: Error finding container f67aa0461cadf4788acd75148cea787be3f9b2ffec8c12419fa244493bf46ee0: Status 404 returned error can't find the container with id f67aa0461cadf4788acd75148cea787be3f9b2ffec8c12419fa244493bf46ee0
Jul 20 18:41:23.879240 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.879199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd" event={"ID":"33f17d77-70a3-4ffa-9b65-7dd89ef0064f","Type":"ContainerStarted","Data":"8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab"}
Jul 20 18:41:23.879677 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.879254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd" event={"ID":"33f17d77-70a3-4ffa-9b65-7dd89ef0064f","Type":"ContainerStarted","Data":"f67aa0461cadf4788acd75148cea787be3f9b2ffec8c12419fa244493bf46ee0"}
Jul 20 18:41:23.890795 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.890770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:41:23.898914 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:23.898864    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd" podStartSLOduration=0.898849673 podStartE2EDuration="898.849673ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:41:23.896566433 +0000 UTC m=+1681.132834849" watchObservedRunningTime="2026-07-20 18:41:23.898849673 +0000 UTC m=+1681.135118087"
Jul 20 18:41:28.689399 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:28.689357    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:41:33.477543 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:33.477501    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:33.477543 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:33.477553    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:33.490217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:33.490191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:33.950267 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:33.950240    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:41:59.162853 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:41:59.162770    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"]
Jul 20 18:42:00.685841 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:00.685806    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"]
Jul 20 18:42:03.490601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:03.490558    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:42:14.185796 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.185735    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g" podUID="2f33e6fb-6631-40ea-8302-765a9357d804" containerName="main" containerID="cri-o://0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449" gracePeriod=45
Jul 20 18:42:14.466917 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.466891    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:42:14.549351 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-model-cache\") pod \"2f33e6fb-6631-40ea-8302-765a9357d804\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") "
Jul 20 18:42:14.549576 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f33e6fb-6631-40ea-8302-765a9357d804-tls-certs\") pod \"2f33e6fb-6631-40ea-8302-765a9357d804\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") "
Jul 20 18:42:14.549576 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549515    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-tmp-dir\") pod \"2f33e6fb-6631-40ea-8302-765a9357d804\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") "
Jul 20 18:42:14.549576 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549553    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-home\") pod \"2f33e6fb-6631-40ea-8302-765a9357d804\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") "
Jul 20 18:42:14.549753 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549590    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-dshm\") pod \"2f33e6fb-6631-40ea-8302-765a9357d804\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") "
Jul 20 18:42:14.549753 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549633    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f33e6fb-6631-40ea-8302-765a9357d804" (UID: "2f33e6fb-6631-40ea-8302-765a9357d804"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:42:14.549753 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549668    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpn78\" (UniqueName: \"kubernetes.io/projected/2f33e6fb-6631-40ea-8302-765a9357d804-kube-api-access-wpn78\") pod \"2f33e6fb-6631-40ea-8302-765a9357d804\" (UID: \"2f33e6fb-6631-40ea-8302-765a9357d804\") "
Jul 20 18:42:14.549904 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549804    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-home" (OuterVolumeSpecName: "home") pod "2f33e6fb-6631-40ea-8302-765a9357d804" (UID: "2f33e6fb-6631-40ea-8302-765a9357d804"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:42:14.549958 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549943    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-model-cache\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:14.550021 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.549962    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-home\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:14.550124 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.550103    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f33e6fb-6631-40ea-8302-765a9357d804" (UID: "2f33e6fb-6631-40ea-8302-765a9357d804"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:42:14.551813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.551787    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f33e6fb-6631-40ea-8302-765a9357d804-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f33e6fb-6631-40ea-8302-765a9357d804" (UID: "2f33e6fb-6631-40ea-8302-765a9357d804"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:42:14.551813 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.551792    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-dshm" (OuterVolumeSpecName: "dshm") pod "2f33e6fb-6631-40ea-8302-765a9357d804" (UID: "2f33e6fb-6631-40ea-8302-765a9357d804"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:42:14.551956 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.551835    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f33e6fb-6631-40ea-8302-765a9357d804-kube-api-access-wpn78" (OuterVolumeSpecName: "kube-api-access-wpn78") pod "2f33e6fb-6631-40ea-8302-765a9357d804" (UID: "2f33e6fb-6631-40ea-8302-765a9357d804"). InnerVolumeSpecName "kube-api-access-wpn78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:42:14.650978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.650938    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpn78\" (UniqueName: \"kubernetes.io/projected/2f33e6fb-6631-40ea-8302-765a9357d804-kube-api-access-wpn78\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:14.650978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.650972    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f33e6fb-6631-40ea-8302-765a9357d804-tls-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:14.650978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.650984    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-tmp-dir\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:14.650978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:14.650992    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f33e6fb-6631-40ea-8302-765a9357d804-dshm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:15.181873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.181831    2560 generic.go:356] "Generic (PLEG): container finished" podID="2f33e6fb-6631-40ea-8302-765a9357d804" containerID="0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449" exitCode=0
Jul 20 18:42:15.182052 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.181882    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"
Jul 20 18:42:15.182052 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.181906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g" event={"ID":"2f33e6fb-6631-40ea-8302-765a9357d804","Type":"ContainerDied","Data":"0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449"}
Jul 20 18:42:15.182052 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.181951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g" event={"ID":"2f33e6fb-6631-40ea-8302-765a9357d804","Type":"ContainerDied","Data":"1ec169f068e3f2849bb759cb3717a935bf2e2ada7f6ca5500345fd82740cd04b"}
Jul 20 18:42:15.182052 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.181969    2560 scope.go:117] "RemoveContainer" containerID="0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449"
Jul 20 18:42:15.195742 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.195572    2560 scope.go:117] "RemoveContainer" containerID="0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449"
Jul 20 18:42:15.196002 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:42:15.195905    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449\": container with ID starting with 0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449 not found: ID does not exist" containerID="0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449"
Jul 20 18:42:15.196002 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.195932    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449"} err="failed to get container status \"0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449\": rpc error: code = NotFound desc = could not find container \"0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449\": container with ID starting with 0368d8c608d1e027095e446fb46d2885019fe744c74794afaf484b18609db449 not found: ID does not exist"
Jul 20 18:42:15.206060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.206037    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"]
Jul 20 18:42:15.210319 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.210296    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-5cab9fec-kserve-7fdcd84c7f-fj22g"]
Jul 20 18:42:15.489998 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.489915    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f33e6fb-6631-40ea-8302-765a9357d804" path="/var/lib/kubelet/pods/2f33e6fb-6631-40ea-8302-765a9357d804/volumes"
Jul 20 18:42:15.707510 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.707470    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd" podUID="33f17d77-70a3-4ffa-9b65-7dd89ef0064f" containerName="main" containerID="cri-o://8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab" gracePeriod=45
Jul 20 18:42:15.974573 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:15.974547    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:42:16.065197 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-dshm\") pod \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") "
Jul 20 18:42:16.065415 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tmp-dir\") pod \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") "
Jul 20 18:42:16.065415 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rr2v\" (UniqueName: \"kubernetes.io/projected/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-kube-api-access-5rr2v\") pod \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") "
Jul 20 18:42:16.065415 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065273    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tls-certs\") pod \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") "
Jul 20 18:42:16.065415 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065363    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-model-cache\") pod \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") "
Jul 20 18:42:16.065415 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065389    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-home\") pod \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\" (UID: \"33f17d77-70a3-4ffa-9b65-7dd89ef0064f\") "
Jul 20 18:42:16.065764 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065560    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33f17d77-70a3-4ffa-9b65-7dd89ef0064f" (UID: "33f17d77-70a3-4ffa-9b65-7dd89ef0064f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:42:16.065764 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065709    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tmp-dir\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:16.065865 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065762    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-home" (OuterVolumeSpecName: "home") pod "33f17d77-70a3-4ffa-9b65-7dd89ef0064f" (UID: "33f17d77-70a3-4ffa-9b65-7dd89ef0064f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:42:16.065865 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.065793    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-model-cache" (OuterVolumeSpecName: "model-cache") pod "33f17d77-70a3-4ffa-9b65-7dd89ef0064f" (UID: "33f17d77-70a3-4ffa-9b65-7dd89ef0064f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:42:16.067586 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.067555    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33f17d77-70a3-4ffa-9b65-7dd89ef0064f" (UID: "33f17d77-70a3-4ffa-9b65-7dd89ef0064f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:42:16.067586 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.067581    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-dshm" (OuterVolumeSpecName: "dshm") pod "33f17d77-70a3-4ffa-9b65-7dd89ef0064f" (UID: "33f17d77-70a3-4ffa-9b65-7dd89ef0064f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:42:16.067752 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.067674    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-kube-api-access-5rr2v" (OuterVolumeSpecName: "kube-api-access-5rr2v") pod "33f17d77-70a3-4ffa-9b65-7dd89ef0064f" (UID: "33f17d77-70a3-4ffa-9b65-7dd89ef0064f"). InnerVolumeSpecName "kube-api-access-5rr2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:42:16.166238 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.166201    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-home\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:16.166238 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.166230    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-dshm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:16.166238 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.166239    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rr2v\" (UniqueName: \"kubernetes.io/projected/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-kube-api-access-5rr2v\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:16.166238 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.166249    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-tls-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:16.166553 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.166259    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f17d77-70a3-4ffa-9b65-7dd89ef0064f-model-cache\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:42:16.190287 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.190254    2560 generic.go:356] "Generic (PLEG): container finished" podID="33f17d77-70a3-4ffa-9b65-7dd89ef0064f" containerID="8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab" exitCode=0
Jul 20 18:42:16.190477 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.190294    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"
Jul 20 18:42:16.190477 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.190342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd" event={"ID":"33f17d77-70a3-4ffa-9b65-7dd89ef0064f","Type":"ContainerDied","Data":"8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab"}
Jul 20 18:42:16.190477 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.190386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd" event={"ID":"33f17d77-70a3-4ffa-9b65-7dd89ef0064f","Type":"ContainerDied","Data":"f67aa0461cadf4788acd75148cea787be3f9b2ffec8c12419fa244493bf46ee0"}
Jul 20 18:42:16.190477 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.190405    2560 scope.go:117] "RemoveContainer" containerID="8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab"
Jul 20 18:42:16.200214 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.200045    2560 scope.go:117] "RemoveContainer" containerID="8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab"
Jul 20 18:42:16.200475 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:42:16.200313    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab\": container with ID starting with 8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab not found: ID does not exist" containerID="8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab"
Jul 20 18:42:16.200475 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.200337    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab"} err="failed to get container status \"8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab\": rpc error: code = NotFound desc = could not find container \"8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab\": container with ID starting with 8a5cffe183239d2c9cef5d31bac99f5d03582cb8da6a8337f67d799ed61f32ab not found: ID does not exist"
Jul 20 18:42:16.212304 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.212278    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"]
Jul 20 18:42:16.216032 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:16.216004    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-5cab9fec-kserve-58fff94879-b46wd"]
Jul 20 18:42:17.489103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:17.489072    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f17d77-70a3-4ffa-9b65-7dd89ef0064f" path="/var/lib/kubelet/pods/33f17d77-70a3-4ffa-9b65-7dd89ef0064f/volumes"
Jul 20 18:42:17.993408 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:17.993366    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:42:24.788474 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:24.788421    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:42:41.490036 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:41.490000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:42:51.687656 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:42:51.687610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:43:01.400685 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:43:01.400642    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:43:09.400362 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:43:09.400322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:43:20.611167 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:43:20.611084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:43:30.292329 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:43:30.292293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:43:43.886630 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:43:43.886594    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:43:58.384428 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:43:58.384390    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:44:08.194488 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:44:08.194436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:44:15.079358 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:44:15.079322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:44:26.582778 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:44:26.582741    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:44:36.290291 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:44:36.290252    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:44:48.295511 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:44:48.295418    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:45:00.584546 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:00.584507    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:45:13.489472 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:13.489425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:45:26.791269 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:26.791224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:45:39.286874 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:39.286834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:45:48.482034 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:48.481988    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:45:53.846306 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.846278    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"]
Jul 20 18:45:53.846745 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.846703    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f33e6fb-6631-40ea-8302-765a9357d804" containerName="main"
Jul 20 18:45:53.846745 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.846715    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f33e6fb-6631-40ea-8302-765a9357d804" containerName="main"
Jul 20 18:45:53.846745 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.846729    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f17d77-70a3-4ffa-9b65-7dd89ef0064f" containerName="main"
Jul 20 18:45:53.846745 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.846734    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f17d77-70a3-4ffa-9b65-7dd89ef0064f" containerName="main"
Jul 20 18:45:53.846924 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.846811    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f33e6fb-6631-40ea-8302-765a9357d804" containerName="main"
Jul 20 18:45:53.846924 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.846821    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f17d77-70a3-4ffa-9b65-7dd89ef0064f" containerName="main"
Jul 20 18:45:53.850304 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.850284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:53.852779 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.852759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5b7f2845-openshift-default-dockercfg-44c8k\""
Jul 20 18:45:53.865336 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:53.865308    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"]
Jul 20 18:45:54.022781 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.022749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-socket\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.022781 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.022783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-data\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.023060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.022813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99297051-d39b-49db-8767-77b89efa6a12-istiod-ca-cert\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.023060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.022872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tpxh\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-kube-api-access-5tpxh\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.023060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.022913    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-istio-token\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.023060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.022957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-envoy\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.023060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.023010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-certs\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.023060 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.023031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-credential-socket\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.023376 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.023062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99297051-d39b-49db-8767-77b89efa6a12-istio-podinfo\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.123961 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.123934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-istio-token\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.123986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-envoy\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-certs\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-credential-socket\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99297051-d39b-49db-8767-77b89efa6a12-istio-podinfo\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-socket\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-data\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99297051-d39b-49db-8767-77b89efa6a12-istiod-ca-cert\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tpxh\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-kube-api-access-5tpxh\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124630 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-certs\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124852 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-socket\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.124852 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.124818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-data\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.125028 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.125007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-credential-socket\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.125345 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.125321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99297051-d39b-49db-8767-77b89efa6a12-istiod-ca-cert\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.127126 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.127105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99297051-d39b-49db-8767-77b89efa6a12-istio-podinfo\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.127288 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.127236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-envoy\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.133555 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.133532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tpxh\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-kube-api-access-5tpxh\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.133702 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.133683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-istio-token\") pod \"e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") " pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.160876 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.160847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:54.310854 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.310831    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"]
Jul 20 18:45:54.312181 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:45:54.312154    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99297051_d39b_49db_8767_77b89efa6a12.slice/crio-d56624ee009f266b15b04d26210d33ae659e79c0175892814e184e57c439d103 WatchSource:0}: Error finding container d56624ee009f266b15b04d26210d33ae659e79c0175892814e184e57c439d103: Status 404 returned error can't find the container with id d56624ee009f266b15b04d26210d33ae659e79c0175892814e184e57c439d103
Jul 20 18:45:54.314353 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.314321    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:45:54.314431 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.314403    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:45:54.314504 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.314432    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:45:54.447086 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.447053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" event={"ID":"99297051-d39b-49db-8767-77b89efa6a12","Type":"ContainerStarted","Data":"6ca35d51aa1c278a9a8adfc07940288d2d1746d0accd9c510bbdc955f0aeee39"}
Jul 20 18:45:54.447281 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.447110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" event={"ID":"99297051-d39b-49db-8767-77b89efa6a12","Type":"ContainerStarted","Data":"d56624ee009f266b15b04d26210d33ae659e79c0175892814e184e57c439d103"}
Jul 20 18:45:54.469762 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:54.469702    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" podStartSLOduration=1.469679506 podStartE2EDuration="1.469679506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:45:54.468585815 +0000 UTC m=+1951.704854235" watchObservedRunningTime="2026-07-20 18:45:54.469679506 +0000 UTC m=+1951.705947923"
Jul 20 18:45:55.161757 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:55.161721    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:55.163299 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:55.163273    2560 patch_prober.go:28] interesting pod/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 18:45:55.163453 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:55.163322    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 18:45:56.166616 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:56.166578    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:56.460521 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:56.460428    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:56.461522 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:56.461501    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:45:59.189898 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:45:59.189864    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:46:07.525318 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:07.525230    2560 generic.go:356] "Generic (PLEG): container finished" podID="99297051-d39b-49db-8767-77b89efa6a12" containerID="6ca35d51aa1c278a9a8adfc07940288d2d1746d0accd9c510bbdc955f0aeee39" exitCode=0
Jul 20 18:46:07.525318 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:07.525293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" event={"ID":"99297051-d39b-49db-8767-77b89efa6a12","Type":"ContainerDied","Data":"6ca35d51aa1c278a9a8adfc07940288d2d1746d0accd9c510bbdc955f0aeee39"}
Jul 20 18:46:07.525807 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:07.525661    2560 scope.go:117] "RemoveContainer" containerID="6ca35d51aa1c278a9a8adfc07940288d2d1746d0accd9c510bbdc955f0aeee39"
Jul 20 18:46:07.526748 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:07.526721    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:46:07.526815 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:07.526792    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:46:07.526855 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:07.526828    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:46:08.536391 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:08.536355    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" event={"ID":"99297051-d39b-49db-8767-77b89efa6a12","Type":"ContainerStarted","Data":"99692279a4bc125b1608bcdbaeff649da9467af29cd22b2d466fb5306240cf21"}
Jul 20 18:46:09.161034 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:09.160998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:46:09.162017 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:09.161992    2560 patch_prober.go:28] interesting pod/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 18:46:09.162072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:09.162044    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 18:46:10.161464 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:10.161396    2560 patch_prober.go:28] interesting pod/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 18:46:10.161988 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:10.161492    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 18:46:11.162045 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:11.162013    2560 patch_prober.go:28] interesting pod/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 18:46:11.162560 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:11.162533    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 18:46:11.460422 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:11.460334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:46:12.161963 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:12.161924    2560 patch_prober.go:28] interesting pod/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 18:46:12.162154 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:12.161998    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 18:46:13.164876 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:13.164845    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:46:13.165897 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:13.165879    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:46:34.882704 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:34.882609    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:46:36.597760 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:36.597723    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"]
Jul 20 18:46:36.598177 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:36.598016    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy" containerID="cri-o://99692279a4bc125b1608bcdbaeff649da9467af29cd22b2d466fb5306240cf21" gracePeriod=30
Jul 20 18:46:41.738135 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.738093    2560 generic.go:356] "Generic (PLEG): container finished" podID="99297051-d39b-49db-8767-77b89efa6a12" containerID="99692279a4bc125b1608bcdbaeff649da9467af29cd22b2d466fb5306240cf21" exitCode=0
Jul 20 18:46:41.738588 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.738167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" event={"ID":"99297051-d39b-49db-8767-77b89efa6a12","Type":"ContainerDied","Data":"99692279a4bc125b1608bcdbaeff649da9467af29cd22b2d466fb5306240cf21"}
Jul 20 18:46:41.738588 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.738264    2560 scope.go:117] "RemoveContainer" containerID="6ca35d51aa1c278a9a8adfc07940288d2d1746d0accd9c510bbdc955f0aeee39"
Jul 20 18:46:41.862615 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.862550    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:46:41.981382 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981347    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-istio-token\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.981611 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99297051-d39b-49db-8767-77b89efa6a12-istiod-ca-cert\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.981611 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981416    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tpxh\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-kube-api-access-5tpxh\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.981611 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981566    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-envoy\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.981611 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981601    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-socket\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.981853 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981643    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-data\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.981853 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981695    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-credential-socket\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.981853 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-certs\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.981853 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981777    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99297051-d39b-49db-8767-77b89efa6a12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:46:41.981853 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981797    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99297051-d39b-49db-8767-77b89efa6a12-istio-podinfo\") pod \"99297051-d39b-49db-8767-77b89efa6a12\" (UID: \"99297051-d39b-49db-8767-77b89efa6a12\") "
Jul 20 18:46:41.982108 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.981946    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:46:41.982108 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.982077    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:46:41.982215 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.982105    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:41.982215 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.982115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:46:41.982215 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.982126    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99297051-d39b-49db-8767-77b89efa6a12-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:41.982519 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.982498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-data" (OuterVolumeSpecName: "istio-data") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:46:41.983764 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.983741    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-kube-api-access-5tpxh" (OuterVolumeSpecName: "kube-api-access-5tpxh") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "kube-api-access-5tpxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:46:41.983883 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.983785    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-istio-token" (OuterVolumeSpecName: "istio-token") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:46:41.984044 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.984020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:46:41.984044 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:41.984037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99297051-d39b-49db-8767-77b89efa6a12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99297051-d39b-49db-8767-77b89efa6a12" (UID: "99297051-d39b-49db-8767-77b89efa6a12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:46:42.082831 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.082796    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:42.082831 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.082824    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tpxh\" (UniqueName: \"kubernetes.io/projected/99297051-d39b-49db-8767-77b89efa6a12-kube-api-access-5tpxh\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:42.082831 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.082834    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:42.082831 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.082842    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:42.083103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.082850    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:42.083103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.082859    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99297051-d39b-49db-8767-77b89efa6a12-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:42.083103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.082866    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99297051-d39b-49db-8767-77b89efa6a12-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:46:42.748235 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.748205    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"
Jul 20 18:46:42.748770 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.748210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss" event={"ID":"99297051-d39b-49db-8767-77b89efa6a12","Type":"ContainerDied","Data":"d56624ee009f266b15b04d26210d33ae659e79c0175892814e184e57c439d103"}
Jul 20 18:46:42.748770 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.748357    2560 scope.go:117] "RemoveContainer" containerID="99692279a4bc125b1608bcdbaeff649da9467af29cd22b2d466fb5306240cf21"
Jul 20 18:46:42.771106 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.771080    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"]
Jul 20 18:46:42.775892 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:42.775866    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5b7f2845-openshift-default-c4cddc869-bz7ss"]
Jul 20 18:46:43.488995 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:43.488960    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99297051-d39b-49db-8767-77b89efa6a12" path="/var/lib/kubelet/pods/99297051-d39b-49db-8767-77b89efa6a12/volumes"
Jul 20 18:46:46.178777 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:46:46.178739    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:47:18.387790 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:18.387752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:47:20.748234 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.748195    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"]
Jul 20 18:47:20.748827 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.748809    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy"
Jul 20 18:47:20.748883 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.748829    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy"
Jul 20 18:47:20.748921 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.748902    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy"
Jul 20 18:47:20.748921 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.748914    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy"
Jul 20 18:47:20.751024 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.751006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.754276 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.754257    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bae9791c-openshift-default-dockercfg-46ndg\""
Jul 20 18:47:20.764466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.764427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"]
Jul 20 18:47:20.834458 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-data\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.834458 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rln46\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-kube-api-access-rln46\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.834724 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-envoy\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.834724 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10dab6-065e-423e-b07a-23747b31213c-istio-podinfo\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.834724 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10dab6-065e-423e-b07a-23747b31213c-istiod-ca-cert\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.834724 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-socket\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.834724 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-credential-socket\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.834977 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-certs\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.834977 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.834807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-istio-token\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.935690 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.935652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-istio-token\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.935868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.935740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-data\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.935868 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.935773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rln46\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-kube-api-access-rln46\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936000 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.935913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-envoy\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936000 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.935956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10dab6-065e-423e-b07a-23747b31213c-istio-podinfo\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.935998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10dab6-065e-423e-b07a-23747b31213c-istiod-ca-cert\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.936032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-socket\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.936058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-credential-socket\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.936086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-certs\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936309 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.936111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-data\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936404 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.936380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-socket\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936490 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.936426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-credential-socket\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936567 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.936508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-certs\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.936777 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.936761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10dab6-065e-423e-b07a-23747b31213c-istiod-ca-cert\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.938577 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.938546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10dab6-065e-423e-b07a-23747b31213c-istio-podinfo\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.938701 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.938619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-envoy\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.945224 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.945204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-istio-token\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:20.945560 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:20.945540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rln46\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-kube-api-access-rln46\") pod \"e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") " pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:21.061878 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:21.061794    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:21.203387 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:21.203299    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"]
Jul 20 18:47:21.212835 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:47:21.212806    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d10dab6_065e_423e_b07a_23747b31213c.slice/crio-2d2c07e5cee17c66699132ee7e76a8c2f8df3738e13464003785ef2fbc196874 WatchSource:0}: Error finding container 2d2c07e5cee17c66699132ee7e76a8c2f8df3738e13464003785ef2fbc196874: Status 404 returned error can't find the container with id 2d2c07e5cee17c66699132ee7e76a8c2f8df3738e13464003785ef2fbc196874
Jul 20 18:47:21.215044 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:21.215010    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:47:21.215152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:21.215078    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:47:21.215152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:21.215109    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:47:21.965933 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:21.965889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" event={"ID":"3d10dab6-065e-423e-b07a-23747b31213c","Type":"ContainerStarted","Data":"7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb"}
Jul 20 18:47:21.966318 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:21.965987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" event={"ID":"3d10dab6-065e-423e-b07a-23747b31213c","Type":"ContainerStarted","Data":"2d2c07e5cee17c66699132ee7e76a8c2f8df3738e13464003785ef2fbc196874"}
Jul 20 18:47:21.988760 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:21.988709    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" podStartSLOduration=1.988695144 podStartE2EDuration="1.988695144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:47:21.987506974 +0000 UTC m=+2039.223775390" watchObservedRunningTime="2026-07-20 18:47:21.988695144 +0000 UTC m=+2039.224963617"
Jul 20 18:47:22.062300 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:22.062270    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:22.067676 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:22.067651    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:22.971310 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:22.971270    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:22.972337 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:22.972317    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:29.401203 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:29.401166    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:47:37.973401 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:37.973367    2560 patch_prober.go:28] interesting pod/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 18:47:37.973835 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:37.973430    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 18:47:38.065369 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:38.065338    2560 generic.go:356] "Generic (PLEG): container finished" podID="3d10dab6-065e-423e-b07a-23747b31213c" containerID="7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb" exitCode=0
Jul 20 18:47:38.065541 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:38.065417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" event={"ID":"3d10dab6-065e-423e-b07a-23747b31213c","Type":"ContainerDied","Data":"7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb"}
Jul 20 18:47:38.065833 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:38.065819    2560 scope.go:117] "RemoveContainer" containerID="7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb"
Jul 20 18:47:38.066798 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:38.066772    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:47:38.066870 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:38.066838    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:47:38.066925 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:38.066868    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:47:39.072569 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:39.072536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" event={"ID":"3d10dab6-065e-423e-b07a-23747b31213c","Type":"ContainerStarted","Data":"98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef"}
Jul 20 18:47:40.062776 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:40.062738    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:40.062979 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:40.062955    2560 patch_prober.go:28] interesting pod/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 18:47:40.063025 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:40.063005    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 18:47:41.062366 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:41.062332    2560 patch_prober.go:28] interesting pod/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 18:47:41.062798 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:41.062393    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 18:47:42.062304 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:42.062269    2560 patch_prober.go:28] interesting pod/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 18:47:42.062585 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:42.062324    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 18:47:43.062678 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:43.062640    2560 patch_prober.go:28] interesting pod/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 18:47:43.063196 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:43.062697    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 18:47:44.065900 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:44.065869    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:44.066365 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:44.066238    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:47:44.066883 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:47:44.066867    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:48:02.899701 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:02.899623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:48:05.479100 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:05.479068    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"]
Jul 20 18:48:05.479598 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:05.479323    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy" containerID="cri-o://98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef" gracePeriod=30
Jul 20 18:48:10.733097 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.733070    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:48:10.905742 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.905714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10dab6-065e-423e-b07a-23747b31213c-istio-podinfo\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.905920 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.905759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rln46\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-kube-api-access-rln46\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.905920 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.905786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-envoy\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.905920 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.905800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-certs\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.905920 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.905819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-istio-token\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.905920 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.905866    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-credential-socket\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.905920 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.905902    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-data\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.906255 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.905935    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10dab6-065e-423e-b07a-23747b31213c-istiod-ca-cert\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.906255 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.906004    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-socket\") pod \"3d10dab6-065e-423e-b07a-23747b31213c\" (UID: \"3d10dab6-065e-423e-b07a-23747b31213c\") "
Jul 20 18:48:10.906255 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.906072    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:48:10.906416 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.906291    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:10.906537 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.906518    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:48:10.906606 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.906586    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:48:10.906665 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.906646    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d10dab6-065e-423e-b07a-23747b31213c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:48:10.906809 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.906786    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:48:10.908073 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.908045    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d10dab6-065e-423e-b07a-23747b31213c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:48:10.908073 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.908053    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-kube-api-access-rln46" (OuterVolumeSpecName: "kube-api-access-rln46") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "kube-api-access-rln46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:48:10.908210 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.908121    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:48:10.908210 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:10.908168    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d10dab6-065e-423e-b07a-23747b31213c" (UID: "3d10dab6-065e-423e-b07a-23747b31213c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:48:11.007459 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.007416    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:11.007638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.007477    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:11.007638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.007491    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:11.007638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.007504    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:11.007638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.007514    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d10dab6-065e-423e-b07a-23747b31213c-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:11.007638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.007526    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d10dab6-065e-423e-b07a-23747b31213c-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:11.007638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.007536    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d10dab6-065e-423e-b07a-23747b31213c-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:11.007638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.007548    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rln46\" (UniqueName: \"kubernetes.io/projected/3d10dab6-065e-423e-b07a-23747b31213c-kube-api-access-rln46\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:48:11.253898 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.253808    2560 generic.go:356] "Generic (PLEG): container finished" podID="3d10dab6-065e-423e-b07a-23747b31213c" containerID="98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef" exitCode=0
Jul 20 18:48:11.253898 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.253852    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"
Jul 20 18:48:11.253898 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.253870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" event={"ID":"3d10dab6-065e-423e-b07a-23747b31213c","Type":"ContainerDied","Data":"98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef"}
Jul 20 18:48:11.254183 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.253923    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt" event={"ID":"3d10dab6-065e-423e-b07a-23747b31213c","Type":"ContainerDied","Data":"2d2c07e5cee17c66699132ee7e76a8c2f8df3738e13464003785ef2fbc196874"}
Jul 20 18:48:11.254183 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.253954    2560 scope.go:117] "RemoveContainer" containerID="98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef"
Jul 20 18:48:11.263417 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.263397    2560 scope.go:117] "RemoveContainer" containerID="7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb"
Jul 20 18:48:11.271188 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.271171    2560 scope.go:117] "RemoveContainer" containerID="98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef"
Jul 20 18:48:11.271432 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:48:11.271416    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef\": container with ID starting with 98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef not found: ID does not exist" containerID="98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef"
Jul 20 18:48:11.271510 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.271453    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef"} err="failed to get container status \"98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef\": rpc error: code = NotFound desc = could not find container \"98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef\": container with ID starting with 98e35d4d4d3d7df25d7d5b442c97d7b03f39f1bd92d23b8d3e07c18d345e97ef not found: ID does not exist"
Jul 20 18:48:11.271510 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.271472    2560 scope.go:117] "RemoveContainer" containerID="7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb"
Jul 20 18:48:11.271701 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:48:11.271684    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb\": container with ID starting with 7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb not found: ID does not exist" containerID="7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb"
Jul 20 18:48:11.271752 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.271709    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb"} err="failed to get container status \"7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb\": rpc error: code = NotFound desc = could not find container \"7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb\": container with ID starting with 7f35f105f3d26caf85b26f4dcfaad18647c3a2e7212e0c7f4f078a6c45d011fb not found: ID does not exist"
Jul 20 18:48:11.276298 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.276278    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"]
Jul 20 18:48:11.281632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.281611    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bae9791c-openshift-default-67c8b5fb97-bwqvt"]
Jul 20 18:48:11.489191 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:11.489154    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d10dab6-065e-423e-b07a-23747b31213c" path="/var/lib/kubelet/pods/3d10dab6-065e-423e-b07a-23747b31213c/volumes"
Jul 20 18:48:14.186125 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:14.186094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:48:47.488281 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:48:47.488253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:50:16.891027 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:16.890997    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:50:26.584694 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:26.584652    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:50:31.341262 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341229    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"]
Jul 20 18:50:31.341802 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341785    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy"
Jul 20 18:50:31.341858 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341804    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="99297051-d39b-49db-8767-77b89efa6a12" containerName="istio-proxy"
Jul 20 18:50:31.341858 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341815    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy"
Jul 20 18:50:31.341858 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341823    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy"
Jul 20 18:50:31.341858 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341840    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy"
Jul 20 18:50:31.341858 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341847    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy"
Jul 20 18:50:31.342014 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341956    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy"
Jul 20 18:50:31.342014 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.341969    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d10dab6-065e-423e-b07a-23747b31213c" containerName="istio-proxy"
Jul 20 18:50:31.346002 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.345978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.352286 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.352258    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bffbe307-openshift-default-dockercfg-q2rcn\""
Jul 20 18:50:31.371415 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.371389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"]
Jul 20 18:50:31.372006 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.371977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-socket\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.372123 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.372020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-data\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.372123 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.372053    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-certs\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.372123 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.372081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-credential-socket\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.372289 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.372124    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istiod-ca-cert\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.372289 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.372149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh89d\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-kube-api-access-hh89d\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.372289 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.372210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-envoy\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.372289 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.372269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-podinfo\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.372472 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.372298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-token\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.473643 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-certs\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.473807 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-credential-socket\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.473807 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istiod-ca-cert\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.473807 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh89d\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-kube-api-access-hh89d\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.473807 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-envoy\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474015 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-podinfo\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474015 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-token\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474015 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-socket\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474015 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.474001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-data\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.474023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-credential-socket\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.473911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-certs\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474377 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.474324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-data\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474543 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.474418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-socket\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.474618 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.474574    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istiod-ca-cert\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.476392 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.476371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-podinfo\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.476524 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.476503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-envoy\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.485072 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.485026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh89d\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-kube-api-access-hh89d\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.487018 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.486999    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-token\") pod \"e2e-mt-bffbe307-openshift-default-84476df99-sxslc\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") " pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.664119 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.664096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:31.819584 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.819558    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"]
Jul 20 18:50:31.821415 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:50:31.821375    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1b2a63_a08d_454e_b24a_6e6462aa8060.slice/crio-27002d8694782712e861fa19bc50e81559fe3c003e86e0f464065d5e925536d5 WatchSource:0}: Error finding container 27002d8694782712e861fa19bc50e81559fe3c003e86e0f464065d5e925536d5: Status 404 returned error can't find the container with id 27002d8694782712e861fa19bc50e81559fe3c003e86e0f464065d5e925536d5
Jul 20 18:50:31.824993 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.824950    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:50:31.825113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.825045    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:50:31.825113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:31.825086    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:50:32.034521 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:32.034360    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" event={"ID":"bf1b2a63-a08d-454e-b24a-6e6462aa8060","Type":"ContainerStarted","Data":"dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512"}
Jul 20 18:50:32.034521 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:32.034423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" event={"ID":"bf1b2a63-a08d-454e-b24a-6e6462aa8060","Type":"ContainerStarted","Data":"27002d8694782712e861fa19bc50e81559fe3c003e86e0f464065d5e925536d5"}
Jul 20 18:50:32.058467 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:32.058395    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" podStartSLOduration=1.058378884 podStartE2EDuration="1.058378884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:50:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:50:32.056715025 +0000 UTC m=+2229.292983441" watchObservedRunningTime="2026-07-20 18:50:32.058378884 +0000 UTC m=+2229.294647375"
Jul 20 18:50:32.665339 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:32.665300    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:32.670519 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:32.670489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:33.041309 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:33.041228    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:33.042290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:33.042273    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:37.585239 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:37.585204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:50:46.117937 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:46.117906    2560 generic.go:356] "Generic (PLEG): container finished" podID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerID="dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512" exitCode=0
Jul 20 18:50:46.118361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:46.117980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" event={"ID":"bf1b2a63-a08d-454e-b24a-6e6462aa8060","Type":"ContainerDied","Data":"dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512"}
Jul 20 18:50:46.118361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:46.118348    2560 scope.go:117] "RemoveContainer" containerID="dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512"
Jul 20 18:50:46.119331 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:46.119290    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:50:46.119455 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:46.119373    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:50:46.119455 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:46.119408    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:50:47.127043 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:47.126997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" event={"ID":"bf1b2a63-a08d-454e-b24a-6e6462aa8060","Type":"ContainerStarted","Data":"bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2"}
Jul 20 18:50:47.664326 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:47.664292    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:47.665487 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:47.665431    2560 patch_prober.go:28] interesting pod/e2e-mt-bffbe307-openshift-default-84476df99-sxslc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 18:50:47.665551 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:47.665531    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 18:50:48.041227 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:48.041135    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:48.665273 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:48.665239    2560 patch_prober.go:28] interesting pod/e2e-mt-bffbe307-openshift-default-84476df99-sxslc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 18:50:48.665702 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:48.665308    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 18:50:49.664654 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:49.664620    2560 patch_prober.go:28] interesting pod/e2e-mt-bffbe307-openshift-default-84476df99-sxslc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 18:50:49.664823 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:49.664672    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 18:50:50.664808 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:50.664772    2560 patch_prober.go:28] interesting pod/e2e-mt-bffbe307-openshift-default-84476df99-sxslc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 18:50:50.665198 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:50.664854    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 18:50:51.668600 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:51.668571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:51.669772 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:51.669755    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:50:59.687737 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:50:59.687705    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:51:07.773420 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:07.773385    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"]
Jul 20 18:51:07.773909 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:07.773636    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy" containerID="cri-o://bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2" gracePeriod=30
Jul 20 18:51:13.035141 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.035117    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:51:13.141217 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-token\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141384 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141237    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-socket\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141384 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141273    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh89d\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-kube-api-access-hh89d\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141384 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-certs\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141384 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141332    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-credential-socket\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141398    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istiod-ca-cert\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141425    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-data\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141486    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-envoy\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141537    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-podinfo\") pod \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\" (UID: \"bf1b2a63-a08d-454e-b24a-6e6462aa8060\") "
Jul 20 18:51:13.141638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141614    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:51:13.141638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141630    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:51:13.141943 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141795    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:51:13.141943 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141895    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.141943 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141914    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.141943 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.141925    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.142373 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.142348    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:51:13.142672 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.142643    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:51:13.143625 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.143601    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:51:13.143726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.143644    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-kube-api-access-hh89d" (OuterVolumeSpecName: "kube-api-access-hh89d") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "kube-api-access-hh89d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:51:13.143784 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.143733    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:51:13.143784 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.143767    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf1b2a63-a08d-454e-b24a-6e6462aa8060" (UID: "bf1b2a63-a08d-454e-b24a-6e6462aa8060"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:51:13.242261 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.242237    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.242261 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.242256    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh89d\" (UniqueName: \"kubernetes.io/projected/bf1b2a63-a08d-454e-b24a-6e6462aa8060-kube-api-access-hh89d\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.242261 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.242265    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.242419 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.242273    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.242419 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.242282    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.242419 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.242289    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf1b2a63-a08d-454e-b24a-6e6462aa8060-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:51:13.293561 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.293535    2560 generic.go:356] "Generic (PLEG): container finished" podID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerID="bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2" exitCode=0
Jul 20 18:51:13.293685 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.293580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" event={"ID":"bf1b2a63-a08d-454e-b24a-6e6462aa8060","Type":"ContainerDied","Data":"bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2"}
Jul 20 18:51:13.293685 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.293586    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"
Jul 20 18:51:13.293802 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.293694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc" event={"ID":"bf1b2a63-a08d-454e-b24a-6e6462aa8060","Type":"ContainerDied","Data":"27002d8694782712e861fa19bc50e81559fe3c003e86e0f464065d5e925536d5"}
Jul 20 18:51:13.293802 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.293730    2560 scope.go:117] "RemoveContainer" containerID="bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2"
Jul 20 18:51:13.303193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.303178    2560 scope.go:117] "RemoveContainer" containerID="dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512"
Jul 20 18:51:13.311393 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.311376    2560 scope.go:117] "RemoveContainer" containerID="bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2"
Jul 20 18:51:13.311679 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:51:13.311659    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2\": container with ID starting with bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2 not found: ID does not exist" containerID="bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2"
Jul 20 18:51:13.311726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.311688    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2"} err="failed to get container status \"bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2\": rpc error: code = NotFound desc = could not find container \"bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2\": container with ID starting with bbff34015c017f0a5924c6ee068e60a98a7f6046374d629a6821de220471dbf2 not found: ID does not exist"
Jul 20 18:51:13.311726 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.311704    2560 scope.go:117] "RemoveContainer" containerID="dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512"
Jul 20 18:51:13.311957 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:51:13.311940    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512\": container with ID starting with dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512 not found: ID does not exist" containerID="dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512"
Jul 20 18:51:13.311999 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.311963    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512"} err="failed to get container status \"dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512\": rpc error: code = NotFound desc = could not find container \"dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512\": container with ID starting with dcd232e0f032cde783611fc455c17d109f95b88faaa02d8e06f616449a7f6512 not found: ID does not exist"
Jul 20 18:51:13.317501 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.317478    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"]
Jul 20 18:51:13.322076 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.322056    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bffbe307-openshift-default-84476df99-sxslc"]
Jul 20 18:51:13.489321 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:13.489240    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" path="/var/lib/kubelet/pods/bf1b2a63-a08d-454e-b24a-6e6462aa8060/volumes"
Jul 20 18:51:36.390733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:36.390698    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:51:45.691452 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.691403    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"]
Jul 20 18:51:45.692008 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.691983    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy"
Jul 20 18:51:45.692008 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.692002    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy"
Jul 20 18:51:45.692138 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.692015    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy"
Jul 20 18:51:45.692138 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.692023    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy"
Jul 20 18:51:45.692236 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.692145    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy"
Jul 20 18:51:45.694207 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.694186    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.697800 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.697776    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d9481028\"/\"default-dockercfg-s4ncp\""
Jul 20 18:51:45.697926 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.697811    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d9481028\"/\"kube-root-ca.crt\""
Jul 20 18:51:45.697926 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.697837    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d9481028\"/\"openshift-service-ca.crt\""
Jul 20 18:51:45.698141 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.698120    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d9481028\"/\"e2e-lifecycle-model-d9481028-kserve-self-signed-certs\""
Jul 20 18:51:45.706466 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.706433    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"]
Jul 20 18:51:45.803393 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.803364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-dshm\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.803546 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.803410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tls-certs\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.803546 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.803428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tmp-dir\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.803546 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.803522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-model-cache\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.803668 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.803552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-home\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.803668 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.803569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhk9n\" (UniqueName: \"kubernetes.io/projected/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-kube-api-access-mhk9n\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.904451 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.904416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-model-cache\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.904602 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.904463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-home\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.904602 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.904484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhk9n\" (UniqueName: \"kubernetes.io/projected/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-kube-api-access-mhk9n\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.904602 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.904528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-dshm\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.904602 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.904578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tls-certs\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.904602 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.904594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tmp-dir\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.904921 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.904900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-home\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.904978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.904949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-model-cache\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.905206 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.905186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tmp-dir\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.906925 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.906904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-dshm\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.907120 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.907106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tls-certs\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:45.914221 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:45.914198    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhk9n\" (UniqueName: \"kubernetes.io/projected/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-kube-api-access-mhk9n\") pod \"e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") " pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:46.003747 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:46.003662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:46.138985 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:46.138957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"]
Jul 20 18:51:46.140298 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:51:46.140271    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bde1b78_ff9a_4b43_8bc0_32405bd04feb.slice/crio-58f6f60c7dcf67de4ec642555c8ab31caed179ebc90b97147e532d0800d88d18 WatchSource:0}: Error finding container 58f6f60c7dcf67de4ec642555c8ab31caed179ebc90b97147e532d0800d88d18: Status 404 returned error can't find the container with id 58f6f60c7dcf67de4ec642555c8ab31caed179ebc90b97147e532d0800d88d18
Jul 20 18:51:46.484460 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:46.484409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z" event={"ID":"1bde1b78-ff9a-4b43-8bc0-32405bd04feb","Type":"ContainerStarted","Data":"2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af"}
Jul 20 18:51:46.484646 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:46.484468    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z" event={"ID":"1bde1b78-ff9a-4b43-8bc0-32405bd04feb","Type":"ContainerStarted","Data":"58f6f60c7dcf67de4ec642555c8ab31caed179ebc90b97147e532d0800d88d18"}
Jul 20 18:51:46.510145 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:46.510099    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z" podStartSLOduration=1.510086524 podStartE2EDuration="1.510086524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:51:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:51:46.508357009 +0000 UTC m=+2303.744625424" watchObservedRunningTime="2026-07-20 18:51:46.510086524 +0000 UTC m=+2303.746354937"
Jul 20 18:51:48.994702 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:48.994672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:51:56.004285 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:56.004250    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:56.004797 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:56.004298    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:56.016795 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:56.016767    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:51:56.549917 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:51:56.549887    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:52:13.290296 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:52:13.290265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:52:33.691772 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:52:33.691684    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:52:43.789193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:52:43.789159    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:52:46.855919 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:52:46.855888    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"]
Jul 20 18:53:01.879073 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:01.879033    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z" podUID="1bde1b78-ff9a-4b43-8bc0-32405bd04feb" containerName="main" containerID="cri-o://2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af" gracePeriod=45
Jul 20 18:53:02.131147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.131084    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:53:02.216957 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.216928    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tmp-dir\") pod \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") "
Jul 20 18:53:02.217142 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.216981    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-home\") pod \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") "
Jul 20 18:53:02.217142 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217033    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-dshm\") pod \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") "
Jul 20 18:53:02.217142 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-model-cache\") pod \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") "
Jul 20 18:53:02.217142 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217111    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tls-certs\") pod \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") "
Jul 20 18:53:02.217368 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhk9n\" (UniqueName: \"kubernetes.io/projected/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-kube-api-access-mhk9n\") pod \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\" (UID: \"1bde1b78-ff9a-4b43-8bc0-32405bd04feb\") "
Jul 20 18:53:02.217368 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217263    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1bde1b78-ff9a-4b43-8bc0-32405bd04feb" (UID: "1bde1b78-ff9a-4b43-8bc0-32405bd04feb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:53:02.217368 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217322    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-home" (OuterVolumeSpecName: "home") pod "1bde1b78-ff9a-4b43-8bc0-32405bd04feb" (UID: "1bde1b78-ff9a-4b43-8bc0-32405bd04feb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:53:02.217554 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217422    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-model-cache" (OuterVolumeSpecName: "model-cache") pod "1bde1b78-ff9a-4b43-8bc0-32405bd04feb" (UID: "1bde1b78-ff9a-4b43-8bc0-32405bd04feb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:53:02.217610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217582    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tmp-dir\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:53:02.217610 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217603    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-home\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:53:02.217712 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.217618    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-model-cache\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:53:02.219264 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.219244    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-dshm" (OuterVolumeSpecName: "dshm") pod "1bde1b78-ff9a-4b43-8bc0-32405bd04feb" (UID: "1bde1b78-ff9a-4b43-8bc0-32405bd04feb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:53:02.219657 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.219636    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1bde1b78-ff9a-4b43-8bc0-32405bd04feb" (UID: "1bde1b78-ff9a-4b43-8bc0-32405bd04feb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:53:02.219708 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.219657    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-kube-api-access-mhk9n" (OuterVolumeSpecName: "kube-api-access-mhk9n") pod "1bde1b78-ff9a-4b43-8bc0-32405bd04feb" (UID: "1bde1b78-ff9a-4b43-8bc0-32405bd04feb"). InnerVolumeSpecName "kube-api-access-mhk9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:53:02.318680 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.318652    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-dshm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:53:02.318680 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.318675    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-tls-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:53:02.318887 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.318687    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhk9n\" (UniqueName: \"kubernetes.io/projected/1bde1b78-ff9a-4b43-8bc0-32405bd04feb-kube-api-access-mhk9n\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:53:02.891776 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.891738    2560 generic.go:356] "Generic (PLEG): container finished" podID="1bde1b78-ff9a-4b43-8bc0-32405bd04feb" containerID="2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af" exitCode=0
Jul 20 18:53:02.892160 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.891796    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"
Jul 20 18:53:02.892160 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.891825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z" event={"ID":"1bde1b78-ff9a-4b43-8bc0-32405bd04feb","Type":"ContainerDied","Data":"2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af"}
Jul 20 18:53:02.892160 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.891871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z" event={"ID":"1bde1b78-ff9a-4b43-8bc0-32405bd04feb","Type":"ContainerDied","Data":"58f6f60c7dcf67de4ec642555c8ab31caed179ebc90b97147e532d0800d88d18"}
Jul 20 18:53:02.892160 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.891892    2560 scope.go:117] "RemoveContainer" containerID="2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af"
Jul 20 18:53:02.901143 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.901126    2560 scope.go:117] "RemoveContainer" containerID="2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af"
Jul 20 18:53:02.901392 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:53:02.901370    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af\": container with ID starting with 2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af not found: ID does not exist" containerID="2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af"
Jul 20 18:53:02.901489 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.901403    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af"} err="failed to get container status \"2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af\": rpc error: code = NotFound desc = could not find container \"2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af\": container with ID starting with 2d8f411c40fe5a2da57d0b874c3c56e2f6ac9fb231b53a0eea6bf41ab21a79af not found: ID does not exist"
Jul 20 18:53:02.913770 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.913743    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"]
Jul 20 18:53:02.917403 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:02.917384    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d9481028/e2e-lifecycle-model-d9481028-kserve-6f64b8d8c5-rv42z"]
Jul 20 18:53:03.489385 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:03.489353    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bde1b78-ff9a-4b43-8bc0-32405bd04feb" path="/var/lib/kubelet/pods/1bde1b78-ff9a-4b43-8bc0-32405bd04feb/volumes"
Jul 20 18:53:37.392372 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:37.392338    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:53:47.489561 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:53:47.489479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:54:34.326854 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.326818    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"]
Jul 20 18:54:34.327471 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.327427    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bde1b78-ff9a-4b43-8bc0-32405bd04feb" containerName="main"
Jul 20 18:54:34.327471 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.327462    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bde1b78-ff9a-4b43-8bc0-32405bd04feb" containerName="main"
Jul 20 18:54:34.327608 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.327591    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bde1b78-ff9a-4b43-8bc0-32405bd04feb" containerName="main"
Jul 20 18:54:34.327662 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.327610    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1b2a63-a08d-454e-b24a-6e6462aa8060" containerName="istio-proxy"
Jul 20 18:54:34.330834 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.330814    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.333136 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.333116    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9e16a1-openshift-default-dockercfg-s27fz\""
Jul 20 18:54:34.342906 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.342887    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"]
Jul 20 18:54:34.394899 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.394877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64641007-aa33-4a2f-8327-f58d36664c5a-istio-podinfo\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.395012 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.394907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-istio-token\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.395012 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.394926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-credential-socket\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.395012 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.394945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-certs\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.395124 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.395020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-envoy\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.395124 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.395085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64641007-aa33-4a2f-8327-f58d36664c5a-istiod-ca-cert\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.395124 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.395104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-socket\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.395218 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.395135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t847\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-kube-api-access-8t847\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.395218 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.395168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-data\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496122 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64641007-aa33-4a2f-8327-f58d36664c5a-istio-podinfo\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496251 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-istio-token\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496251 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-credential-socket\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496251 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-certs\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496418 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-envoy\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496512 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64641007-aa33-4a2f-8327-f58d36664c5a-istiod-ca-cert\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496512 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-socket\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496620 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t847\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-kube-api-access-8t847\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496620 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-data\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496620 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-certs\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496620 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-credential-socket\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496925 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-socket\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.496997 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.496950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-data\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.497100 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.497082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64641007-aa33-4a2f-8327-f58d36664c5a-istiod-ca-cert\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.498509 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.498488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-envoy\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.498715 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.498700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64641007-aa33-4a2f-8327-f58d36664c5a-istio-podinfo\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.504341 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.504321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-istio-token\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.504526 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.504510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t847\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-kube-api-access-8t847\") pod \"e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") " pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.642232 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.642199    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:34.680913 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.680880    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:54:34.787776 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.787755    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"]
Jul 20 18:54:34.789845 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:54:34.789813    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64641007_aa33_4a2f_8327_f58d36664c5a.slice/crio-d6fa922fef5aa71d47414250080332db9351f9f185c44aac841bd82404678e3b WatchSource:0}: Error finding container d6fa922fef5aa71d47414250080332db9351f9f185c44aac841bd82404678e3b: Status 404 returned error can't find the container with id d6fa922fef5aa71d47414250080332db9351f9f185c44aac841bd82404678e3b
Jul 20 18:54:34.792718 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.792687    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:54:34.792785 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.792749    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:54:34.792785 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:34.792776    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:54:35.408571 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:35.408528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" event={"ID":"64641007-aa33-4a2f-8327-f58d36664c5a","Type":"ContainerStarted","Data":"0c115387ec5fe5efaf6b6ee41f95b48fd9805365494d3a2c6638de10986e3786"}
Jul 20 18:54:35.408973 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:35.408592    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" event={"ID":"64641007-aa33-4a2f-8327-f58d36664c5a","Type":"ContainerStarted","Data":"d6fa922fef5aa71d47414250080332db9351f9f185c44aac841bd82404678e3b"}
Jul 20 18:54:35.431114 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:35.431069    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" podStartSLOduration=1.4310533460000001 podStartE2EDuration="1.431053346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:54:35.429636482 +0000 UTC m=+2472.665904898" watchObservedRunningTime="2026-07-20 18:54:35.431053346 +0000 UTC m=+2472.667321761"
Jul 20 18:54:35.642514 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:35.642484    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:35.647734 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:35.647708    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:36.413741 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:36.413712    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:36.414778 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:36.414761    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:43.092245 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:43.092203    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:54:51.414883 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:51.414849    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 18:54:51.415228 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:51.414914    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 18:54:51.505601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:51.505543    2560 generic.go:356] "Generic (PLEG): container finished" podID="64641007-aa33-4a2f-8327-f58d36664c5a" containerID="0c115387ec5fe5efaf6b6ee41f95b48fd9805365494d3a2c6638de10986e3786" exitCode=0
Jul 20 18:54:51.505703 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:51.505615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" event={"ID":"64641007-aa33-4a2f-8327-f58d36664c5a","Type":"ContainerDied","Data":"0c115387ec5fe5efaf6b6ee41f95b48fd9805365494d3a2c6638de10986e3786"}
Jul 20 18:54:51.505933 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:51.505921    2560 scope.go:117] "RemoveContainer" containerID="0c115387ec5fe5efaf6b6ee41f95b48fd9805365494d3a2c6638de10986e3786"
Jul 20 18:54:51.506882 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:51.506854    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:54:51.506940 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:51.506924    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:54:51.506977 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:51.506957    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:54:52.513184 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:52.513153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" event={"ID":"64641007-aa33-4a2f-8327-f58d36664c5a","Type":"ContainerStarted","Data":"416c54aacc74ffcedbed45ad994be4fecbfd9b7ba1d2000a7bc9a3d1791516bf"}
Jul 20 18:54:52.644119 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:52.643674    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:52.644119 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:52.643804    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 18:54:52.644119 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:52.643852    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 18:54:53.643622 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:53.643584    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 18:54:53.644234 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:53.644193    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 18:54:54.643632 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:54.643595    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 18:54:54.644381 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:54.644347    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 18:54:55.643807 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:55.643354    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 18:54:55.643807 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:55.643427    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 18:54:56.646323 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:56.646297    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:56.646800 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:56.646731    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:56.647491 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:56.647468    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:54:58.789078 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.789049    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"]
Jul 20 18:54:58.792720 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.792697    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:58.795311 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.795288    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c017f1\"/\"openshift-service-ca.crt\""
Jul 20 18:54:58.795505 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.795386    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c017f1\"/\"default-dockercfg-vs5hw\""
Jul 20 18:54:58.796146 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.796128    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c017f1\"/\"kube-root-ca.crt\""
Jul 20 18:54:58.796269 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.796233    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c017f1\"/\"test-model-c017f1-kserve-self-signed-certs\""
Jul 20 18:54:58.809388 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.809359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"]
Jul 20 18:54:58.911298 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.911269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-home\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:58.911474 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.911309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-dshm\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:58.911474 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.911332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-model-cache\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:58.911474 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.911421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tmp-dir\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:58.911474 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.911466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wfkt\" (UniqueName: \"kubernetes.io/projected/ae938a78-8b8c-4fda-a872-6b285b25e5ae-kube-api-access-5wfkt\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:58.911625 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:58.911574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tls-certs\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tmp-dir\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012152 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wfkt\" (UniqueName: \"kubernetes.io/projected/ae938a78-8b8c-4fda-a872-6b285b25e5ae-kube-api-access-5wfkt\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012374 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tls-certs\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012374 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-home\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012535 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-dshm\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012535 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-model-cache\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012535 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tmp-dir\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012709 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-home\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.012760 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.012742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-model-cache\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.014531 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.014506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-dshm\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.014825 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.014805    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tls-certs\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.021008 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.020987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wfkt\" (UniqueName: \"kubernetes.io/projected/ae938a78-8b8c-4fda-a872-6b285b25e5ae-kube-api-access-5wfkt\") pod \"test-model-c017f1-kserve-8475bd9749-lvtqw\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") " pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.108869 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.108799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:54:59.257103 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.257077    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"]
Jul 20 18:54:59.259592 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:54:59.259568    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae938a78_8b8c_4fda_a872_6b285b25e5ae.slice/crio-29ccf92800b49ee4b424e49264de05e879c910c48633694cb073414a3a3a24f8 WatchSource:0}: Error finding container 29ccf92800b49ee4b424e49264de05e879c910c48633694cb073414a3a3a24f8: Status 404 returned error can't find the container with id 29ccf92800b49ee4b424e49264de05e879c910c48633694cb073414a3a3a24f8
Jul 20 18:54:59.557811 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.557778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw" event={"ID":"ae938a78-8b8c-4fda-a872-6b285b25e5ae","Type":"ContainerStarted","Data":"403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972"}
Jul 20 18:54:59.557984 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.557822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw" event={"ID":"ae938a78-8b8c-4fda-a872-6b285b25e5ae","Type":"ContainerStarted","Data":"29ccf92800b49ee4b424e49264de05e879c910c48633694cb073414a3a3a24f8"}
Jul 20 18:54:59.574947 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:54:59.574897    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw" podStartSLOduration=1.57487957 podStartE2EDuration="1.57487957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:54:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:54:59.574365629 +0000 UTC m=+2496.810634046" watchObservedRunningTime="2026-07-20 18:54:59.57487957 +0000 UTC m=+2496.811147987"
Jul 20 18:55:02.086545 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:55:02.086509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:55:09.109449 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:55:09.109414    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:55:09.109964 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:55:09.109484    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:55:09.122147 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:55:09.122124    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:55:09.627804 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:55:09.627774    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:55:13.784637 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:55:13.784604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:55:29.089721 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:55:29.089637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:56:11.958652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:11.958618    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"]
Jul 20 18:56:13.056079 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.056048    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"]
Jul 20 18:56:13.059660 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.059643    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"
Jul 20 18:56:13.061998 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.061973    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 18:56:13.062109 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.062090    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8qkh\""
Jul 20 18:56:13.067088 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.067062    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"]
Jul 20 18:56:13.243779 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.243749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01b26742-7a60-4fa0-95bf-bdcf4be464a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd\" (UID: \"01b26742-7a60-4fa0-95bf-bdcf4be464a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"
Jul 20 18:56:13.345140 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.345079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01b26742-7a60-4fa0-95bf-bdcf4be464a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd\" (UID: \"01b26742-7a60-4fa0-95bf-bdcf4be464a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"
Jul 20 18:56:13.345679 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.345660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01b26742-7a60-4fa0-95bf-bdcf4be464a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd\" (UID: \"01b26742-7a60-4fa0-95bf-bdcf4be464a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"
Jul 20 18:56:13.371946 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.371924    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"
Jul 20 18:56:13.715872 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.715842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"]
Jul 20 18:56:13.717231 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:56:13.717210    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b26742_7a60_4fa0_95bf_bdcf4be464a2.slice/crio-75d8787451390c4dc0b378e51bc2e01f74ba0215b052b39e061f12bd92da92e5 WatchSource:0}: Error finding container 75d8787451390c4dc0b378e51bc2e01f74ba0215b052b39e061f12bd92da92e5: Status 404 returned error can't find the container with id 75d8787451390c4dc0b378e51bc2e01f74ba0215b052b39e061f12bd92da92e5
Jul 20 18:56:13.719221 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.719201    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:56:13.981937 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:13.981853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd" event={"ID":"01b26742-7a60-4fa0-95bf-bdcf4be464a2","Type":"ContainerStarted","Data":"75d8787451390c4dc0b378e51bc2e01f74ba0215b052b39e061f12bd92da92e5"}
Jul 20 18:56:17.001575 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:17.001484    2560 generic.go:356] "Generic (PLEG): container finished" podID="01b26742-7a60-4fa0-95bf-bdcf4be464a2" containerID="da79cf43ba742df2822ab39712fe3179f673ece0e75b13036d530c8c8102306e" exitCode=0
Jul 20 18:56:17.001575 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:17.001538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd" event={"ID":"01b26742-7a60-4fa0-95bf-bdcf4be464a2","Type":"ContainerDied","Data":"da79cf43ba742df2822ab39712fe3179f673ece0e75b13036d530c8c8102306e"}
Jul 20 18:56:17.279498 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:17.279390    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:56:18.135382 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:18.135353    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"
Jul 20 18:56:18.187825 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:18.187795    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01b26742-7a60-4fa0-95bf-bdcf4be464a2-maas-api-service-ca\") pod \"01b26742-7a60-4fa0-95bf-bdcf4be464a2\" (UID: \"01b26742-7a60-4fa0-95bf-bdcf4be464a2\") "
Jul 20 18:56:18.188134 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:18.188114    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01b26742-7a60-4fa0-95bf-bdcf4be464a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01b26742-7a60-4fa0-95bf-bdcf4be464a2" (UID: "01b26742-7a60-4fa0-95bf-bdcf4be464a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:56:18.289487 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:18.289386    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01b26742-7a60-4fa0-95bf-bdcf4be464a2-maas-api-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:56:19.013412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:19.013383    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"
Jul 20 18:56:19.013412 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:19.013394    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd" event={"ID":"01b26742-7a60-4fa0-95bf-bdcf4be464a2","Type":"ContainerDied","Data":"75d8787451390c4dc0b378e51bc2e01f74ba0215b052b39e061f12bd92da92e5"}
Jul 20 18:56:19.013692 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:19.013459    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75d8787451390c4dc0b378e51bc2e01f74ba0215b052b39e061f12bd92da92e5"
Jul 20 18:56:26.979272 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:26.979230    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw" podUID="ae938a78-8b8c-4fda-a872-6b285b25e5ae" containerName="main" containerID="cri-o://403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972" gracePeriod=45
Jul 20 18:56:27.240422 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.240366    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:56:27.256276 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-model-cache\") pod \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") "
Jul 20 18:56:27.256408 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wfkt\" (UniqueName: \"kubernetes.io/projected/ae938a78-8b8c-4fda-a872-6b285b25e5ae-kube-api-access-5wfkt\") pod \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") "
Jul 20 18:56:27.256408 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256356    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-home\") pod \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") "
Jul 20 18:56:27.256547 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256431    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tmp-dir\") pod \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") "
Jul 20 18:56:27.256547 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tls-certs\") pod \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") "
Jul 20 18:56:27.257873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256579    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-dshm\") pod \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\" (UID: \"ae938a78-8b8c-4fda-a872-6b285b25e5ae\") "
Jul 20 18:56:27.257873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256640    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "ae938a78-8b8c-4fda-a872-6b285b25e5ae" (UID: "ae938a78-8b8c-4fda-a872-6b285b25e5ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:56:27.257873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256689    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-home" (OuterVolumeSpecName: "home") pod "ae938a78-8b8c-4fda-a872-6b285b25e5ae" (UID: "ae938a78-8b8c-4fda-a872-6b285b25e5ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:56:27.257873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256973    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-model-cache\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:56:27.257873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.256992    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-home\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:56:27.257873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.257309    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ae938a78-8b8c-4fda-a872-6b285b25e5ae" (UID: "ae938a78-8b8c-4fda-a872-6b285b25e5ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:56:27.259200 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.259162    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae938a78-8b8c-4fda-a872-6b285b25e5ae-kube-api-access-5wfkt" (OuterVolumeSpecName: "kube-api-access-5wfkt") pod "ae938a78-8b8c-4fda-a872-6b285b25e5ae" (UID: "ae938a78-8b8c-4fda-a872-6b285b25e5ae"). InnerVolumeSpecName "kube-api-access-5wfkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:56:27.259516 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.259488    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-dshm" (OuterVolumeSpecName: "dshm") pod "ae938a78-8b8c-4fda-a872-6b285b25e5ae" (UID: "ae938a78-8b8c-4fda-a872-6b285b25e5ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:56:27.260139 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.260108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ae938a78-8b8c-4fda-a872-6b285b25e5ae" (UID: "ae938a78-8b8c-4fda-a872-6b285b25e5ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:56:27.358226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.358202    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tmp-dir\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:56:27.358226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.358224    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae938a78-8b8c-4fda-a872-6b285b25e5ae-tls-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:56:27.358416 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.358234    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae938a78-8b8c-4fda-a872-6b285b25e5ae-dshm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:56:27.358416 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:27.358244    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wfkt\" (UniqueName: \"kubernetes.io/projected/ae938a78-8b8c-4fda-a872-6b285b25e5ae-kube-api-access-5wfkt\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:56:28.068860 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.068826    2560 generic.go:356] "Generic (PLEG): container finished" podID="ae938a78-8b8c-4fda-a872-6b285b25e5ae" containerID="403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972" exitCode=0
Jul 20 18:56:28.069351 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.068866    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"
Jul 20 18:56:28.069351 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.068903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw" event={"ID":"ae938a78-8b8c-4fda-a872-6b285b25e5ae","Type":"ContainerDied","Data":"403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972"}
Jul 20 18:56:28.069351 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.068951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw" event={"ID":"ae938a78-8b8c-4fda-a872-6b285b25e5ae","Type":"ContainerDied","Data":"29ccf92800b49ee4b424e49264de05e879c910c48633694cb073414a3a3a24f8"}
Jul 20 18:56:28.069351 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.068969    2560 scope.go:117] "RemoveContainer" containerID="403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972"
Jul 20 18:56:28.078166 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.078149    2560 scope.go:117] "RemoveContainer" containerID="403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972"
Jul 20 18:56:28.078425 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:56:28.078407    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972\": container with ID starting with 403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972 not found: ID does not exist" containerID="403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972"
Jul 20 18:56:28.078509 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.078434    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972"} err="failed to get container status \"403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972\": rpc error: code = NotFound desc = could not find container \"403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972\": container with ID starting with 403713522aa652430cb5f3bf5b10274b4189e82fbdbf48e06d23b52965b9d972 not found: ID does not exist"
Jul 20 18:56:28.083991 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.083966    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"]
Jul 20 18:56:28.087820 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.087801    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c017f1/test-model-c017f1-kserve-8475bd9749-lvtqw"]
Jul 20 18:56:28.152506 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.152484    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"]
Jul 20 18:56:28.155523 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:28.155504    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c017f1-kfcjd"]
Jul 20 18:56:29.489110 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:29.489078    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01b26742-7a60-4fa0-95bf-bdcf4be464a2" path="/var/lib/kubelet/pods/01b26742-7a60-4fa0-95bf-bdcf4be464a2/volumes"
Jul 20 18:56:29.489523 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:29.489508    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae938a78-8b8c-4fda-a872-6b285b25e5ae" path="/var/lib/kubelet/pods/ae938a78-8b8c-4fda-a872-6b285b25e5ae/volumes"
Jul 20 18:56:32.185951 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:32.185910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:56:48.886130 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:48.886051    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:56:57.049216 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:57.049182    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"]
Jul 20 18:56:57.049679 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:56:57.049391    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy" containerID="cri-o://416c54aacc74ffcedbed45ad994be4fecbfd9b7ba1d2000a7bc9a3d1791516bf" gracePeriod=30
Jul 20 18:57:02.270823 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.270784    2560 generic.go:356] "Generic (PLEG): container finished" podID="64641007-aa33-4a2f-8327-f58d36664c5a" containerID="416c54aacc74ffcedbed45ad994be4fecbfd9b7ba1d2000a7bc9a3d1791516bf" exitCode=0
Jul 20 18:57:02.271225 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.270856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" event={"ID":"64641007-aa33-4a2f-8327-f58d36664c5a","Type":"ContainerDied","Data":"416c54aacc74ffcedbed45ad994be4fecbfd9b7ba1d2000a7bc9a3d1791516bf"}
Jul 20 18:57:02.271225 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.270917    2560 scope.go:117] "RemoveContainer" containerID="0c115387ec5fe5efaf6b6ee41f95b48fd9805365494d3a2c6638de10986e3786"
Jul 20 18:57:02.310870 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.310822    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:57:02.472562 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64641007-aa33-4a2f-8327-f58d36664c5a-istio-podinfo\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.472733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472578    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-envoy\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.472733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472602    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64641007-aa33-4a2f-8327-f58d36664c5a-istiod-ca-cert\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.472733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472715    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t847\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-kube-api-access-8t847\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.472908 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472778    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-credential-socket\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.472908 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472804    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-istio-token\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.472908 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472826    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-certs\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.472908 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472865    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-data\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.473183 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-socket\") pod \"64641007-aa33-4a2f-8327-f58d36664c5a\" (UID: \"64641007-aa33-4a2f-8327-f58d36664c5a\") "
Jul 20 18:57:02.473183 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.472976    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64641007-aa33-4a2f-8327-f58d36664c5a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:57:02.473183 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.473002    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:57:02.473183 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.473120    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:57:02.473394 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.473198    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64641007-aa33-4a2f-8327-f58d36664c5a-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:02.473394 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.473216    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:02.473394 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.473231    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:02.473394 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.473301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:57:02.473948 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.473923    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-data" (OuterVolumeSpecName: "istio-data") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:57:02.474927 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.474867    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64641007-aa33-4a2f-8327-f58d36664c5a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:57:02.475031 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.474965    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:57:02.475126 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.475110    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-kube-api-access-8t847" (OuterVolumeSpecName: "kube-api-access-8t847") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "kube-api-access-8t847". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:57:02.475228 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.475210    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-istio-token" (OuterVolumeSpecName: "istio-token") pod "64641007-aa33-4a2f-8327-f58d36664c5a" (UID: "64641007-aa33-4a2f-8327-f58d36664c5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:57:02.574557 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.574497    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:02.574557 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.574520    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:02.574557 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.574528    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:02.574557 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.574536    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64641007-aa33-4a2f-8327-f58d36664c5a-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:02.574557 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.574544    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64641007-aa33-4a2f-8327-f58d36664c5a-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:02.574557 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:02.574552    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t847\" (UniqueName: \"kubernetes.io/projected/64641007-aa33-4a2f-8327-f58d36664c5a-kube-api-access-8t847\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:57:03.278212 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:03.278181    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"
Jul 20 18:57:03.278654 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:03.278231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9" event={"ID":"64641007-aa33-4a2f-8327-f58d36664c5a","Type":"ContainerDied","Data":"d6fa922fef5aa71d47414250080332db9351f9f185c44aac841bd82404678e3b"}
Jul 20 18:57:03.278654 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:03.278285    2560 scope.go:117] "RemoveContainer" containerID="416c54aacc74ffcedbed45ad994be4fecbfd9b7ba1d2000a7bc9a3d1791516bf"
Jul 20 18:57:03.300613 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:03.300585    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"]
Jul 20 18:57:03.303828 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:03.303805    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9e16a1-openshift-default-5d45c48d9c-qj6f9"]
Jul 20 18:57:03.489257 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:03.489228    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" path="/var/lib/kubelet/pods/64641007-aa33-4a2f-8327-f58d36664c5a/volumes"
Jul 20 18:57:06.039281 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039240    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"]
Jul 20 18:57:06.039877 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039861    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy"
Jul 20 18:57:06.039932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039880    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy"
Jul 20 18:57:06.039932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039903    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy"
Jul 20 18:57:06.039932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039912    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy"
Jul 20 18:57:06.040032 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039937    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae938a78-8b8c-4fda-a872-6b285b25e5ae" containerName="main"
Jul 20 18:57:06.040032 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039949    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae938a78-8b8c-4fda-a872-6b285b25e5ae" containerName="main"
Jul 20 18:57:06.040032 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039966    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b26742-7a60-4fa0-95bf-bdcf4be464a2" containerName="revoke-keys"
Jul 20 18:57:06.040032 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.039975    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b26742-7a60-4fa0-95bf-bdcf4be464a2" containerName="revoke-keys"
Jul 20 18:57:06.040151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.040059    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy"
Jul 20 18:57:06.040151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.040070    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="64641007-aa33-4a2f-8327-f58d36664c5a" containerName="istio-proxy"
Jul 20 18:57:06.040151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.040080    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae938a78-8b8c-4fda-a872-6b285b25e5ae" containerName="main"
Jul 20 18:57:06.040151 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.040089    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b26742-7a60-4fa0-95bf-bdcf4be464a2" containerName="revoke-keys"
Jul 20 18:57:06.044973 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.044950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.047533 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.047513    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-15b416-openshift-default-dockercfg-skvkk\""
Jul 20 18:57:06.061032 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.061006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"]
Jul 20 18:57:06.100765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.100724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-certs\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.100886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.100780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-data\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.100886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.100801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-podinfo\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.100886 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.100856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-credential-socket\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.101006 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.100895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-token\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.101006 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.100912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-socket\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.101006 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.100932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-envoy\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.101006 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.100998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjsbm\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-kube-api-access-kjsbm\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.101138 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.101016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istiod-ca-cert\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.201733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.201687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-token\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.201733 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.201737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-socket\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.201935 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.201898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-envoy\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.201985 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.201969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjsbm\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-kube-api-access-kjsbm\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202033 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istiod-ca-cert\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202033 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-certs\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202127 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-data\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202127 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-podinfo\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202127 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-socket\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202286 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-credential-socket\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202404 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-certs\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202517 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-data\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202517 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-credential-socket\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.202799 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.202778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istiod-ca-cert\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.204063 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.204034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-envoy\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.204491 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.204470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-podinfo\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.213770 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.213747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-token\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.214681 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.214662    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjsbm\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-kube-api-access-kjsbm\") pod \"e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") " pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.360203 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.360099    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:06.504425 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.504401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"]
Jul 20 18:57:06.506266 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:57:06.506245    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4beeec39_2934_4f55_8ba4_2ea7a7d45faf.slice/crio-6096fdc3cdcc00cf776e6abc5270c8ba903869109e89475fabb2aa7d0130f198 WatchSource:0}: Error finding container 6096fdc3cdcc00cf776e6abc5270c8ba903869109e89475fabb2aa7d0130f198: Status 404 returned error can't find the container with id 6096fdc3cdcc00cf776e6abc5270c8ba903869109e89475fabb2aa7d0130f198
Jul 20 18:57:06.508237 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.508204    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:57:06.508334 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.508265    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:57:06.508334 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:06.508299    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:57:07.303295 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:07.303262    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" event={"ID":"4beeec39-2934-4f55-8ba4-2ea7a7d45faf","Type":"ContainerStarted","Data":"2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251"}
Jul 20 18:57:07.303815 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:07.303318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" event={"ID":"4beeec39-2934-4f55-8ba4-2ea7a7d45faf","Type":"ContainerStarted","Data":"6096fdc3cdcc00cf776e6abc5270c8ba903869109e89475fabb2aa7d0130f198"}
Jul 20 18:57:07.327391 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:07.327337    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" podStartSLOduration=1.327323469 podStartE2EDuration="1.327323469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:57:07.324413138 +0000 UTC m=+2624.560681554" watchObservedRunningTime="2026-07-20 18:57:07.327323469 +0000 UTC m=+2624.563591883"
Jul 20 18:57:07.360701 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:07.360673    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:07.365623 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:07.365600    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:08.291751 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:08.291711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:57:08.309279 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:08.309246    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:08.310246 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:08.310226    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:09.298183 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.298150    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"]
Jul 20 18:57:09.302685 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.302662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.305192 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.305168    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 18:57:09.305999 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.305979    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vvgb2\""
Jul 20 18:57:09.305999 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.305992    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-15b416-serving-cert\""
Jul 20 18:57:09.306156 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.305989    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 18:57:09.315160 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.314794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"]
Jul 20 18:57:09.331762 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.331720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdshc\" (UniqueName: \"kubernetes.io/projected/71629a1b-ccce-46c8-9d9f-4925d818a75e-kube-api-access-qdshc\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.331924 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.331883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.331990 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.331945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71629a1b-ccce-46c8-9d9f-4925d818a75e-openshift-service-ca\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.432933 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.432893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.432933 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.432939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71629a1b-ccce-46c8-9d9f-4925d818a75e-openshift-service-ca\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.433205 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.433003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdshc\" (UniqueName: \"kubernetes.io/projected/71629a1b-ccce-46c8-9d9f-4925d818a75e-kube-api-access-qdshc\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.433205 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:57:09.433046    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-serving-cert: secret "maas-api-e2e-api-b-15b416-serving-cert" not found
Jul 20 18:57:09.433205 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:57:09.433126    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls podName:71629a1b-ccce-46c8-9d9f-4925d818a75e nodeName:}" failed. No retries permitted until 2026-07-20 18:57:09.933103757 +0000 UTC m=+2627.169372159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls") pod "maas-api-e2e-api-b-15b416-6c475b78bc-pzm57" (UID: "71629a1b-ccce-46c8-9d9f-4925d818a75e") : secret "maas-api-e2e-api-b-15b416-serving-cert" not found
Jul 20 18:57:09.433830 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.433808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71629a1b-ccce-46c8-9d9f-4925d818a75e-openshift-service-ca\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.449802 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.449768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdshc\" (UniqueName: \"kubernetes.io/projected/71629a1b-ccce-46c8-9d9f-4925d818a75e-kube-api-access-qdshc\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.938281 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.938247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:09.940838 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:09.940809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls\") pod \"maas-api-e2e-api-b-15b416-6c475b78bc-pzm57\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:10.216707 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:10.216621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:10.362368 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:10.362344    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"]
Jul 20 18:57:10.363713 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:57:10.363673    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71629a1b_ccce_46c8_9d9f_4925d818a75e.slice/crio-52429d132a9d3813df0880eafe18421cf25b409aa4a21deb454652c68ee07af6 WatchSource:0}: Error finding container 52429d132a9d3813df0880eafe18421cf25b409aa4a21deb454652c68ee07af6: Status 404 returned error can't find the container with id 52429d132a9d3813df0880eafe18421cf25b409aa4a21deb454652c68ee07af6
Jul 20 18:57:11.334831 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:11.334787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57" event={"ID":"71629a1b-ccce-46c8-9d9f-4925d818a75e","Type":"ContainerStarted","Data":"52429d132a9d3813df0880eafe18421cf25b409aa4a21deb454652c68ee07af6"}
Jul 20 18:57:13.349130 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:13.349094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57" event={"ID":"71629a1b-ccce-46c8-9d9f-4925d818a75e","Type":"ContainerStarted","Data":"1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958"}
Jul 20 18:57:13.349538 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:13.349231    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:13.366647 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:13.366593    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57" podStartSLOduration=2.226942357 podStartE2EDuration="4.366575638s" totalImagesPullingTime="2.139633281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:57:13.366019108 +0000 UTC m=+2630.602287523" watchObservedRunningTime="2026-07-20 18:57:13.366575638 +0000 UTC m=+2630.602844053"
Jul 20 18:57:19.361600 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:19.361571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:57:24.352597 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:24.352555    2560 patch_prober.go:28] interesting pod/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 18:57:24.353108 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:24.352606    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 18:57:25.421792 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:25.421750    2560 generic.go:356] "Generic (PLEG): container finished" podID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerID="2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251" exitCode=0
Jul 20 18:57:25.422194 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:25.421819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" event={"ID":"4beeec39-2934-4f55-8ba4-2ea7a7d45faf","Type":"ContainerDied","Data":"2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251"}
Jul 20 18:57:25.422263 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:25.422246    2560 scope.go:117] "RemoveContainer" containerID="2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251"
Jul 20 18:57:25.423368 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:25.423338    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:57:25.423459 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:25.423415    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:57:25.423504 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:25.423470    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:57:25.493321 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:25.493296    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:57:26.434065 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:26.434022    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" event={"ID":"4beeec39-2934-4f55-8ba4-2ea7a7d45faf","Type":"ContainerStarted","Data":"78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128"}
Jul 20 18:57:27.361249 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:27.361211    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:27.361505 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:27.361394    2560 patch_prober.go:28] interesting pod/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 18:57:27.361505 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:27.361474    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 18:57:28.360485 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:28.360407    2560 patch_prober.go:28] interesting pod/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 18:57:28.360873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:28.360507    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 18:57:29.360371 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:29.360332    2560 patch_prober.go:28] interesting pod/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 18:57:29.360582 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:29.360390    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 18:57:30.360665 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:30.360622    2560 patch_prober.go:28] interesting pod/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 18:57:30.361078 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:30.360695    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 18:57:31.364504 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:31.364469    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:31.364938 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:31.364781    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:31.365413 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:31.365398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:57:41.291113 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:57:41.291082    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:58:04.619064 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.619029    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"]
Jul 20 18:58:04.619667 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.619265    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57" podUID="71629a1b-ccce-46c8-9d9f-4925d818a75e" containerName="maas-api" containerID="cri-o://1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958" gracePeriod=30
Jul 20 18:58:04.874751 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.874698    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:58:04.938359 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.938334    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls\") pod \"71629a1b-ccce-46c8-9d9f-4925d818a75e\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") "
Jul 20 18:58:04.938505 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.938417    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdshc\" (UniqueName: \"kubernetes.io/projected/71629a1b-ccce-46c8-9d9f-4925d818a75e-kube-api-access-qdshc\") pod \"71629a1b-ccce-46c8-9d9f-4925d818a75e\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") "
Jul 20 18:58:04.938552 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.938517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71629a1b-ccce-46c8-9d9f-4925d818a75e-openshift-service-ca\") pod \"71629a1b-ccce-46c8-9d9f-4925d818a75e\" (UID: \"71629a1b-ccce-46c8-9d9f-4925d818a75e\") "
Jul 20 18:58:04.938855 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.938828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71629a1b-ccce-46c8-9d9f-4925d818a75e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71629a1b-ccce-46c8-9d9f-4925d818a75e" (UID: "71629a1b-ccce-46c8-9d9f-4925d818a75e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:58:04.940483 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.940462    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71629a1b-ccce-46c8-9d9f-4925d818a75e" (UID: "71629a1b-ccce-46c8-9d9f-4925d818a75e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:58:04.940560 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:04.940499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71629a1b-ccce-46c8-9d9f-4925d818a75e-kube-api-access-qdshc" (OuterVolumeSpecName: "kube-api-access-qdshc") pod "71629a1b-ccce-46c8-9d9f-4925d818a75e" (UID: "71629a1b-ccce-46c8-9d9f-4925d818a75e"). InnerVolumeSpecName "kube-api-access-qdshc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:58:05.039290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.039258    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71629a1b-ccce-46c8-9d9f-4925d818a75e-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:05.039290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.039284    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71629a1b-ccce-46c8-9d9f-4925d818a75e-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:05.039290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.039293    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdshc\" (UniqueName: \"kubernetes.io/projected/71629a1b-ccce-46c8-9d9f-4925d818a75e-kube-api-access-qdshc\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:05.659014 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.658977    2560 generic.go:356] "Generic (PLEG): container finished" podID="71629a1b-ccce-46c8-9d9f-4925d818a75e" containerID="1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958" exitCode=0
Jul 20 18:58:05.659434 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.659031    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"
Jul 20 18:58:05.659434 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.659062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57" event={"ID":"71629a1b-ccce-46c8-9d9f-4925d818a75e","Type":"ContainerDied","Data":"1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958"}
Jul 20 18:58:05.659434 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.659120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57" event={"ID":"71629a1b-ccce-46c8-9d9f-4925d818a75e","Type":"ContainerDied","Data":"52429d132a9d3813df0880eafe18421cf25b409aa4a21deb454652c68ee07af6"}
Jul 20 18:58:05.659434 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.659141    2560 scope.go:117] "RemoveContainer" containerID="1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958"
Jul 20 18:58:05.668623 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.668609    2560 scope.go:117] "RemoveContainer" containerID="1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958"
Jul 20 18:58:05.668873 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:58:05.668852    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958\": container with ID starting with 1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958 not found: ID does not exist" containerID="1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958"
Jul 20 18:58:05.668924 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.668882    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958"} err="failed to get container status \"1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958\": rpc error: code = NotFound desc = could not find container \"1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958\": container with ID starting with 1fde9795ec16704a71526f02a21c9f7013cb8d08b5316f5fa623187587942958 not found: ID does not exist"
Jul 20 18:58:05.676367 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.676347    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"]
Jul 20 18:58:05.678620 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:05.678600    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-15b416-6c475b78bc-pzm57"]
Jul 20 18:58:07.489305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:07.489271    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71629a1b-ccce-46c8-9d9f-4925d818a75e" path="/var/lib/kubelet/pods/71629a1b-ccce-46c8-9d9f-4925d818a75e/volumes"
Jul 20 18:58:10.082268 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:10.082233    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:58:15.030336 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:15.030244    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"]
Jul 20 18:58:15.030799 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:15.030588    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy" containerID="cri-o://78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128" gracePeriod=30
Jul 20 18:58:16.367314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:16.367279    2560 patch_prober.go:28] interesting pod/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 18:58:16.367736 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:16.367347    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 18:58:20.294161 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.294105    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:58:20.472231 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472200    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-podinfo\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472242    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-socket\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472302    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-token\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472338    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-envoy\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472398 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472382    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-certs\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472656 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472409    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-credential-socket\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472656 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472437    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjsbm\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-kube-api-access-kjsbm\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472656 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472493    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istiod-ca-cert\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472656 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472528    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-data\") pod \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\" (UID: \"4beeec39-2934-4f55-8ba4-2ea7a7d45faf\") "
Jul 20 18:58:20.472656 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472613    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:58:20.472932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472718    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:58:20.472932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472888    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.472932 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.472909    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.473090 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.473037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:58:20.473207 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.473183    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:58:20.473643 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.473616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-data" (OuterVolumeSpecName: "istio-data") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:58:20.474648 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.474624    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 18:58:20.474648 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.474639    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:58:20.474811 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.474669    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-token" (OuterVolumeSpecName: "istio-token") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:58:20.474811 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.474709    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-kube-api-access-kjsbm" (OuterVolumeSpecName: "kube-api-access-kjsbm") pod "4beeec39-2934-4f55-8ba4-2ea7a7d45faf" (UID: "4beeec39-2934-4f55-8ba4-2ea7a7d45faf"). InnerVolumeSpecName "kube-api-access-kjsbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:58:20.573971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.573916    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.573971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.573937    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.573971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.573946    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.573971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.573954    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.573971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.573962    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjsbm\" (UniqueName: \"kubernetes.io/projected/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-kube-api-access-kjsbm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.573971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.573970    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.574228 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.573978    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beeec39-2934-4f55-8ba4-2ea7a7d45faf-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 18:58:20.743131 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.743093    2560 generic.go:356] "Generic (PLEG): container finished" podID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerID="78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128" exitCode=0
Jul 20 18:58:20.743308 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.743142    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"
Jul 20 18:58:20.743308 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.743178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" event={"ID":"4beeec39-2934-4f55-8ba4-2ea7a7d45faf","Type":"ContainerDied","Data":"78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128"}
Jul 20 18:58:20.743308 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.743239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq" event={"ID":"4beeec39-2934-4f55-8ba4-2ea7a7d45faf","Type":"ContainerDied","Data":"6096fdc3cdcc00cf776e6abc5270c8ba903869109e89475fabb2aa7d0130f198"}
Jul 20 18:58:20.743308 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.743268    2560 scope.go:117] "RemoveContainer" containerID="78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128"
Jul 20 18:58:20.753008 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.752991    2560 scope.go:117] "RemoveContainer" containerID="2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251"
Jul 20 18:58:20.761488 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.761472    2560 scope.go:117] "RemoveContainer" containerID="78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128"
Jul 20 18:58:20.761719 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:58:20.761702    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128\": container with ID starting with 78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128 not found: ID does not exist" containerID="78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128"
Jul 20 18:58:20.761766 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.761727    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128"} err="failed to get container status \"78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128\": rpc error: code = NotFound desc = could not find container \"78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128\": container with ID starting with 78fe9340c2c31876e100b9d1f12046448383e733456ed62af8c6d7500d775128 not found: ID does not exist"
Jul 20 18:58:20.761766 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.761742    2560 scope.go:117] "RemoveContainer" containerID="2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251"
Jul 20 18:58:20.761970 ip-10-0-138-45 kubenswrapper[2560]: E0720 18:58:20.761955    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251\": container with ID starting with 2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251 not found: ID does not exist" containerID="2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251"
Jul 20 18:58:20.762011 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.761973    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251"} err="failed to get container status \"2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251\": rpc error: code = NotFound desc = could not find container \"2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251\": container with ID starting with 2ffc83c90cbdc1c54ca62dc69c9716a0566f6010bd4dabeff6ae9355693fd251 not found: ID does not exist"
Jul 20 18:58:20.766636 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.766614    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"]
Jul 20 18:58:20.773142 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:20.773123    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-15b416-openshift-default-7b6cfc8bf9-zcvmq"]
Jul 20 18:58:21.488387 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:21.488355    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" path="/var/lib/kubelet/pods/4beeec39-2934-4f55-8ba4-2ea7a7d45faf/volumes"
Jul 20 18:58:24.221881 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.221846    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"]
Jul 20 18:58:24.222429 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.222402    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy"
Jul 20 18:58:24.222429 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.222419    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy"
Jul 20 18:58:24.222576 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.222457    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71629a1b-ccce-46c8-9d9f-4925d818a75e" containerName="maas-api"
Jul 20 18:58:24.222576 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.222467    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71629a1b-ccce-46c8-9d9f-4925d818a75e" containerName="maas-api"
Jul 20 18:58:24.222576 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.222574    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy"
Jul 20 18:58:24.222723 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.222590    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="71629a1b-ccce-46c8-9d9f-4925d818a75e" containerName="maas-api"
Jul 20 18:58:24.228777 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.228756    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.231211 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.231189    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a2f866-openshift-default-dockercfg-cp9mz\""
Jul 20 18:58:24.238832 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.238808    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"]
Jul 20 18:58:24.405004 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.404977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-token\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.405193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.405016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-certs\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.405193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.405039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-data\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.405193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.405097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istiod-ca-cert\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.405193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.405117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-socket\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.405193 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.405179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-podinfo\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.405393 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.405201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxf6v\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-kube-api-access-qxf6v\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.405393 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.405232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-credential-socket\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.405393 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.405263    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-envoy\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.506601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istiod-ca-cert\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.506601 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-socket\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.506792 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-podinfo\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.506792 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxf6v\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-kube-api-access-qxf6v\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.506792 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-credential-socket\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.506792 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-envoy\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.507005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-token\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.507005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-certs\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.507005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-data\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.507005 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.506920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-socket\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.507230 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.507113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-credential-socket\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.507305 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.507285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-certs\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.507378 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.507355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-data\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.507507 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.507357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istiod-ca-cert\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.508958 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.508941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-envoy\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.509399 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.509375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-podinfo\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.515743 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.515721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-token\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.516850 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.516828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxf6v\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-kube-api-access-qxf6v\") pod \"e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") " pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.541651 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.541631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:24.686657 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.686628    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"]
Jul 20 18:58:24.688202 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:58:24.688170    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdfc9fa_a0ba_4ecd_ab0d_eadf0ac05b7c.slice/crio-6523ab18b92b43b48da733e096c73aad23ca59006826fe2e51fbb0bb88d4f970 WatchSource:0}: Error finding container 6523ab18b92b43b48da733e096c73aad23ca59006826fe2e51fbb0bb88d4f970: Status 404 returned error can't find the container with id 6523ab18b92b43b48da733e096c73aad23ca59006826fe2e51fbb0bb88d4f970
Jul 20 18:58:24.690541 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.690499    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:58:24.690638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.690587    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:58:24.690638 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.690628    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:58:24.771476 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.771361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" event={"ID":"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c","Type":"ContainerStarted","Data":"09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7"}
Jul 20 18:58:24.771476 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.771431    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" event={"ID":"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c","Type":"ContainerStarted","Data":"6523ab18b92b43b48da733e096c73aad23ca59006826fe2e51fbb0bb88d4f970"}
Jul 20 18:58:24.792807 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.792757    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" podStartSLOduration=0.792741647 podStartE2EDuration="792.741647ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:58:24.79134843 +0000 UTC m=+2702.027616847" watchObservedRunningTime="2026-07-20 18:58:24.792741647 +0000 UTC m=+2702.029010062"
Jul 20 18:58:24.983341 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:24.983309    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:58:25.542153 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:25.542120    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:25.547523 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:25.547501    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:25.776687 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:25.776660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:25.777541 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:25.777523    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:26.890411 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.890381    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"]
Jul 20 18:58:26.890812 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.890791    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy"
Jul 20 18:58:26.890812 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.890803    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy"
Jul 20 18:58:26.890912 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.890897    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4beeec39-2934-4f55-8ba4-2ea7a7d45faf" containerName="istio-proxy"
Jul 20 18:58:26.894456 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.894423    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:26.897324 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.897299    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a2f866-serving-cert\""
Jul 20 18:58:26.897436 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.897337    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 18:58:26.897550 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.897523    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vvgb2\""
Jul 20 18:58:26.898765 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.898747    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 18:58:26.913208 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:26.913188    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"]
Jul 20 18:58:27.030971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.030943    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086854c-b7e2-414c-b08b-0a1bfb287fec-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.030971 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.030973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz9nj\" (UniqueName: \"kubernetes.io/projected/d086854c-b7e2-414c-b08b-0a1bfb287fec-kube-api-access-xz9nj\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.031187 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.030998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d086854c-b7e2-414c-b08b-0a1bfb287fec-maas-api-tls\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.132361 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.132322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086854c-b7e2-414c-b08b-0a1bfb287fec-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.132529 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.132368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz9nj\" (UniqueName: \"kubernetes.io/projected/d086854c-b7e2-414c-b08b-0a1bfb287fec-kube-api-access-xz9nj\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.132529 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.132487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d086854c-b7e2-414c-b08b-0a1bfb287fec-maas-api-tls\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.132980 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.132960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086854c-b7e2-414c-b08b-0a1bfb287fec-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.134954 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.134932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d086854c-b7e2-414c-b08b-0a1bfb287fec-maas-api-tls\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.140811 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.140759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz9nj\" (UniqueName: \"kubernetes.io/projected/d086854c-b7e2-414c-b08b-0a1bfb287fec-kube-api-access-xz9nj\") pod \"maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.205652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.205621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:27.347401 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.347374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"]
Jul 20 18:58:27.349565 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:58:27.349530    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd086854c_b7e2_414c_b08b_0a1bfb287fec.slice/crio-3b109092bae17cdaa62cb7089f29168f2f507af1115e5f08c1d1f5243ed2ef2f WatchSource:0}: Error finding container 3b109092bae17cdaa62cb7089f29168f2f507af1115e5f08c1d1f5243ed2ef2f: Status 404 returned error can't find the container with id 3b109092bae17cdaa62cb7089f29168f2f507af1115e5f08c1d1f5243ed2ef2f
Jul 20 18:58:27.789958 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.789929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt" event={"ID":"d086854c-b7e2-414c-b08b-0a1bfb287fec","Type":"ContainerStarted","Data":"57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868"}
Jul 20 18:58:27.790100 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.789980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt" event={"ID":"d086854c-b7e2-414c-b08b-0a1bfb287fec","Type":"ContainerStarted","Data":"3b109092bae17cdaa62cb7089f29168f2f507af1115e5f08c1d1f5243ed2ef2f"}
Jul 20 18:58:27.808238 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:27.808170    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt" podStartSLOduration=1.4904106449999999 podStartE2EDuration="1.808147603s" totalImagesPullingTime="317.736958ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:58:27.806323223 +0000 UTC m=+2705.042591641" watchObservedRunningTime="2026-07-20 18:58:27.808147603 +0000 UTC m=+2705.044416021"
Jul 20 18:58:28.795684 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:28.795648    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:34.806290 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:34.806262    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 18:58:38.859665 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:38.859580    2560 generic.go:356] "Generic (PLEG): container finished" podID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerID="09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7" exitCode=0
Jul 20 18:58:38.859665 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:38.859637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" event={"ID":"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c","Type":"ContainerDied","Data":"09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7"}
Jul 20 18:58:38.860157 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:38.860030    2560 scope.go:117] "RemoveContainer" containerID="09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7"
Jul 20 18:58:38.861094 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:38.861053    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:58:38.861161 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:38.861140    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:58:38.861198 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:38.861187    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 18:58:39.201769 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:39.201731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:58:39.866331 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:39.866294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" event={"ID":"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c","Type":"ContainerStarted","Data":"1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974"}
Jul 20 18:58:40.543226 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:40.543189    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:40.543652 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:40.543630    2560 patch_prober.go:28] interesting pod/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 20 18:58:40.543818 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:40.543793    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 20 18:58:40.777621 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:40.777585    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:41.542867 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:41.542823    2560 patch_prober.go:28] interesting pod/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 20 18:58:41.543375 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:41.542892    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 20 18:58:42.542314 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:42.542275    2560 patch_prober.go:28] interesting pod/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 20 18:58:42.543235 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:42.543202    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 20 18:58:43.542978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:43.542535    2560 patch_prober.go:28] interesting pod/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 20 18:58:43.542978 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:43.542606    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 20 18:58:44.546635 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:44.546607    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:44.547734 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:44.547714    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 18:58:52.975860 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:58:52.975827    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:59:13.087488 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.087450    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"]
Jul 20 18:59:13.089957 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.089941    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.092428 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.092408    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a2f866\"/\"openshift-service-ca.crt\""
Jul 20 18:59:13.092563 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.092430    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a2f866\"/\"kube-root-ca.crt\""
Jul 20 18:59:13.093198 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.093179    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a2f866\"/\"default-dockercfg-lckq7\""
Jul 20 18:59:13.093293 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.093253    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a2f866\"/\"auth-test-model-a2f866-kserve-self-signed-certs\""
Jul 20 18:59:13.100322 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.100300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"]
Jul 20 18:59:13.225873 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.225840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tmp-dir\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.226003 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.225890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-dshm\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.226068 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.226044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-model-cache\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.226107 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.226091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-home\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.226170 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.226154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tls-certs\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.226212 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.226187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwbpc\" (UniqueName: \"kubernetes.io/projected/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-kube-api-access-jwbpc\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.327504 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.327476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-model-cache\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.327679 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.327522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-home\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.327679 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.327568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tls-certs\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.327934 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.327904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwbpc\" (UniqueName: \"kubernetes.io/projected/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-kube-api-access-jwbpc\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.328062 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.327967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tmp-dir\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.328062 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.327974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-home\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.328062 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.327995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-model-cache\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.328062 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.328002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-dshm\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.328408 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.328381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tmp-dir\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.330169 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.330140    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-dshm\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.330344 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.330328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tls-certs\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.335772 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.335748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwbpc\" (UniqueName: \"kubernetes.io/projected/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-kube-api-access-jwbpc\") pod \"auth-test-model-a2f866-kserve-648bfc79cf-8qrfn\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") " pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.399353 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.399317    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:13.534317 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:13.534293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"]
Jul 20 18:59:13.536865 ip-10-0-138-45 kubenswrapper[2560]: W0720 18:59:13.536833    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc461aeb0_d05b_4fed_8a3a_4c403a3a5719.slice/crio-af0141ab05fd58ea9b70aa37aa570ff579484edf00c1674b466ac6294627f380 WatchSource:0}: Error finding container af0141ab05fd58ea9b70aa37aa570ff579484edf00c1674b466ac6294627f380: Status 404 returned error can't find the container with id af0141ab05fd58ea9b70aa37aa570ff579484edf00c1674b466ac6294627f380
Jul 20 18:59:14.059272 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:14.059233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn" event={"ID":"c461aeb0-d05b-4fed-8a3a-4c403a3a5719","Type":"ContainerStarted","Data":"ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d"}
Jul 20 18:59:14.059473 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:14.059279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn" event={"ID":"c461aeb0-d05b-4fed-8a3a-4c403a3a5719","Type":"ContainerStarted","Data":"af0141ab05fd58ea9b70aa37aa570ff579484edf00c1674b466ac6294627f380"}
Jul 20 18:59:14.078085 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:14.078035    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn" podStartSLOduration=1.078017978 podStartE2EDuration="1.078017978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:59:14.074981802 +0000 UTC m=+2751.311250214" watchObservedRunningTime="2026-07-20 18:59:14.078017978 +0000 UTC m=+2751.314286398"
Jul 20 18:59:16.378063 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:16.378025    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:59:23.399583 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:23.399553    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:23.399583 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:23.399590    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:23.412098 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:23.412073    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:24.128221 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:24.128189    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 18:59:35.781774 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:35.781744    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 18:59:47.987811 ip-10-0-138-45 kubenswrapper[2560]: I0720 18:59:47.987730    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:00:05.588507 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:00:05.588474    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:00:23.477364 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:00:23.477329    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:00:40.788365 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:00:40.788322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:00:59.490754 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:00:59.490723    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:01:16.087789 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:16.087712    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"]
Jul 20 19:01:18.275698 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:18.275663    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:01:30.588633 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:30.588600    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:01:31.108086 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.108050    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn" podUID="c461aeb0-d05b-4fed-8a3a-4c403a3a5719" containerName="main" containerID="cri-o://ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d" gracePeriod=45
Jul 20 19:01:31.368467 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.368428    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 19:01:31.393063 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-model-cache\") pod \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") "
Jul 20 19:01:31.393188 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tls-certs\") pod \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") "
Jul 20 19:01:31.393188 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-home\") pod \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") "
Jul 20 19:01:31.393188 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393144    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwbpc\" (UniqueName: \"kubernetes.io/projected/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-kube-api-access-jwbpc\") pod \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") "
Jul 20 19:01:31.393188 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393184    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tmp-dir\") pod \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") "
Jul 20 19:01:31.393395 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393259    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-dshm\") pod \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\" (UID: \"c461aeb0-d05b-4fed-8a3a-4c403a3a5719\") "
Jul 20 19:01:31.393395 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393290    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-model-cache" (OuterVolumeSpecName: "model-cache") pod "c461aeb0-d05b-4fed-8a3a-4c403a3a5719" (UID: "c461aeb0-d05b-4fed-8a3a-4c403a3a5719"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:01:31.393539 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393389    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-home" (OuterVolumeSpecName: "home") pod "c461aeb0-d05b-4fed-8a3a-4c403a3a5719" (UID: "c461aeb0-d05b-4fed-8a3a-4c403a3a5719"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:01:31.393640 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393614    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-model-cache\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:01:31.393640 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393641    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-home\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:01:31.393828 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.393716    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c461aeb0-d05b-4fed-8a3a-4c403a3a5719" (UID: "c461aeb0-d05b-4fed-8a3a-4c403a3a5719"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:01:31.395473 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.395425    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-dshm" (OuterVolumeSpecName: "dshm") pod "c461aeb0-d05b-4fed-8a3a-4c403a3a5719" (UID: "c461aeb0-d05b-4fed-8a3a-4c403a3a5719"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:01:31.395770 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.395747    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c461aeb0-d05b-4fed-8a3a-4c403a3a5719" (UID: "c461aeb0-d05b-4fed-8a3a-4c403a3a5719"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:01:31.395770 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.395763    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-kube-api-access-jwbpc" (OuterVolumeSpecName: "kube-api-access-jwbpc") pod "c461aeb0-d05b-4fed-8a3a-4c403a3a5719" (UID: "c461aeb0-d05b-4fed-8a3a-4c403a3a5719"). InnerVolumeSpecName "kube-api-access-jwbpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:01:31.494276 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.494245    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tls-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:01:31.494276 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.494268    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwbpc\" (UniqueName: \"kubernetes.io/projected/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-kube-api-access-jwbpc\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:01:31.494522 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.494281    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-tmp-dir\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:01:31.494522 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.494294    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c461aeb0-d05b-4fed-8a3a-4c403a3a5719-dshm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:01:31.836771 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.836685    2560 generic.go:356] "Generic (PLEG): container finished" podID="c461aeb0-d05b-4fed-8a3a-4c403a3a5719" containerID="ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d" exitCode=0
Jul 20 19:01:31.836771 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.836732    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"
Jul 20 19:01:31.837214 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.836772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn" event={"ID":"c461aeb0-d05b-4fed-8a3a-4c403a3a5719","Type":"ContainerDied","Data":"ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d"}
Jul 20 19:01:31.837214 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.836815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn" event={"ID":"c461aeb0-d05b-4fed-8a3a-4c403a3a5719","Type":"ContainerDied","Data":"af0141ab05fd58ea9b70aa37aa570ff579484edf00c1674b466ac6294627f380"}
Jul 20 19:01:31.837214 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.836838    2560 scope.go:117] "RemoveContainer" containerID="ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d"
Jul 20 19:01:31.846347 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.846328    2560 scope.go:117] "RemoveContainer" containerID="ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d"
Jul 20 19:01:31.846632 ip-10-0-138-45 kubenswrapper[2560]: E0720 19:01:31.846613    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d\": container with ID starting with ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d not found: ID does not exist" containerID="ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d"
Jul 20 19:01:31.846687 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.846640    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d"} err="failed to get container status \"ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d\": rpc error: code = NotFound desc = could not find container \"ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d\": container with ID starting with ec2d06c146321c7ffda2dd3b2f2d727dc59c9a865daff6c966c5ab18c271809d not found: ID does not exist"
Jul 20 19:01:31.854075 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.854050    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"]
Jul 20 19:01:31.859649 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:31.859629    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/auth-test-model-a2f866-kserve-648bfc79cf-8qrfn"]
Jul 20 19:01:33.489483 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:33.489435    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c461aeb0-d05b-4fed-8a3a-4c403a3a5719" path="/var/lib/kubelet/pods/c461aeb0-d05b-4fed-8a3a-4c403a3a5719/volumes"
Jul 20 19:01:55.189895 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.189861    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"]
Jul 20 19:01:55.190314 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.190301    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c461aeb0-d05b-4fed-8a3a-4c403a3a5719" containerName="main"
Jul 20 19:01:55.190314 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.190315    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c461aeb0-d05b-4fed-8a3a-4c403a3a5719" containerName="main"
Jul 20 19:01:55.190394 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.190379    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c461aeb0-d05b-4fed-8a3a-4c403a3a5719" containerName="main"
Jul 20 19:01:55.194881 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.194863    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.198176 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.198156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a2f866\"/\"openshift-service-ca.crt\""
Jul 20 19:01:55.198375 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.198155    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a2f866\"/\"default-dockercfg-lckq7\""
Jul 20 19:01:55.198375 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.198301    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a2f866\"/\"kube-root-ca.crt\""
Jul 20 19:01:55.198375 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.198318    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a2f866\"/\"sub-test-model-a2f866-kserve-self-signed-certs\""
Jul 20 19:01:55.202146 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.202121    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"]
Jul 20 19:01:55.279340 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.279313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/809e9bf1-67e1-47b8-91e5-044449446546-tls-certs\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.279538 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.279362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-tmp-dir\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.279538 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.279388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2mvj\" (UniqueName: \"kubernetes.io/projected/809e9bf1-67e1-47b8-91e5-044449446546-kube-api-access-x2mvj\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.279538 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.279424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-dshm\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.279538 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.279513    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-home\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.279732 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.279572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-model-cache\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.380524 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.380489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-dshm\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.380698 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.380554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-home\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.380698 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.380607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-model-cache\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.380698 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.380657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/809e9bf1-67e1-47b8-91e5-044449446546-tls-certs\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.380698 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.380696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-tmp-dir\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.380928 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.380718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2mvj\" (UniqueName: \"kubernetes.io/projected/809e9bf1-67e1-47b8-91e5-044449446546-kube-api-access-x2mvj\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.381047 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.381025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-home\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.381099 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.381078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-model-cache\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.381147 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.381130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-tmp-dir\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.382933 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.382913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-dshm\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.383104 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.383089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/809e9bf1-67e1-47b8-91e5-044449446546-tls-certs\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.388686 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.388668    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2mvj\" (UniqueName: \"kubernetes.io/projected/809e9bf1-67e1-47b8-91e5-044449446546-kube-api-access-x2mvj\") pod \"sub-test-model-a2f866-kserve-679b6bb76f-fn6fx\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") " pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.505949 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.505890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:01:55.650135 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.650109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"]
Jul 20 19:01:55.651785 ip-10-0-138-45 kubenswrapper[2560]: W0720 19:01:55.651749    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod809e9bf1_67e1_47b8_91e5_044449446546.slice/crio-15793dc43de2684b47346dd57d40f0d3d2d11b16d8dc50c0e9a440f76e8dd228 WatchSource:0}: Error finding container 15793dc43de2684b47346dd57d40f0d3d2d11b16d8dc50c0e9a440f76e8dd228: Status 404 returned error can't find the container with id 15793dc43de2684b47346dd57d40f0d3d2d11b16d8dc50c0e9a440f76e8dd228
Jul 20 19:01:55.974827 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.974790    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx" event={"ID":"809e9bf1-67e1-47b8-91e5-044449446546","Type":"ContainerStarted","Data":"0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef"}
Jul 20 19:01:55.974994 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.974840    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx" event={"ID":"809e9bf1-67e1-47b8-91e5-044449446546","Type":"ContainerStarted","Data":"15793dc43de2684b47346dd57d40f0d3d2d11b16d8dc50c0e9a440f76e8dd228"}
Jul 20 19:01:55.993188 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:55.993145    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx" podStartSLOduration=0.993129429 podStartE2EDuration="993.129429ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:55.992015038 +0000 UTC m=+2913.228283454" watchObservedRunningTime="2026-07-20 19:01:55.993129429 +0000 UTC m=+2913.229397843"
Jul 20 19:01:59.582159 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:01:59.582120    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:02:05.506395 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:05.506364    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:02:05.506990 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:05.506415    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:02:05.518608 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:05.518588    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:02:06.043260 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:06.043229    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:02:12.981558 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:12.981520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:02:23.715900 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:23.715872    2560 scope.go:117] "RemoveContainer" containerID="da79cf43ba742df2822ab39712fe3179f673ece0e75b13036d530c8c8102306e"
Jul 20 19:02:34.870685 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:34.870652    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"]
Jul 20 19:02:36.485849 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:36.485820    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:02:41.481497 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.481434    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"]
Jul 20 19:02:41.485262 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.485232    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.488623 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.488468    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b7bb94\"/\"openshift-service-ca.crt\""
Jul 20 19:02:41.488623 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.488476    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b7bb94\"/\"rate-test-model-b7bb94-kserve-self-signed-certs\""
Jul 20 19:02:41.488623 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.488488    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b7bb94\"/\"default-dockercfg-27j9g\""
Jul 20 19:02:41.488623 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.488506    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b7bb94\"/\"kube-root-ca.crt\""
Jul 20 19:02:41.494644 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.494623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"]
Jul 20 19:02:41.569245 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.569175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4ws8\" (UniqueName: \"kubernetes.io/projected/7f5403aa-14a9-46d0-bbd4-863229a59cd4-kube-api-access-f4ws8\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.569245 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.569225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-home\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.569245 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.569245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tmp-dir\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.569502 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.569287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tls-certs\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.569502 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.569492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-dshm\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.569607 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.569555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-model-cache\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.670845 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.670820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-dshm\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.671009 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.670860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-model-cache\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.671009 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.670908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4ws8\" (UniqueName: \"kubernetes.io/projected/7f5403aa-14a9-46d0-bbd4-863229a59cd4-kube-api-access-f4ws8\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.671009 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.670932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-home\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.671009 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.670950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tmp-dir\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.671283 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.671266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tls-certs\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.671394 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.671296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-home\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.671394 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.671267    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-model-cache\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.671521 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.671422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tmp-dir\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.672892 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.672871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-dshm\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.673389 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.673370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tls-certs\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.680788 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.680765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4ws8\" (UniqueName: \"kubernetes.io/projected/7f5403aa-14a9-46d0-bbd4-863229a59cd4-kube-api-access-f4ws8\") pod \"rate-test-model-b7bb94-kserve-5487979c87-w4b9n\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") " pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.797256 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.797228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:41.955187 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:41.955160    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"]
Jul 20 19:02:41.956219 ip-10-0-138-45 kubenswrapper[2560]: W0720 19:02:41.956195    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f5403aa_14a9_46d0_bbd4_863229a59cd4.slice/crio-a0d677de6be8603094776e382fbceae993e8ee887c963aae78ef3eb5df08320b WatchSource:0}: Error finding container a0d677de6be8603094776e382fbceae993e8ee887c963aae78ef3eb5df08320b: Status 404 returned error can't find the container with id a0d677de6be8603094776e382fbceae993e8ee887c963aae78ef3eb5df08320b
Jul 20 19:02:42.246834 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:42.246798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n" event={"ID":"7f5403aa-14a9-46d0-bbd4-863229a59cd4","Type":"ContainerStarted","Data":"3b201ed8f1d49181936f139d91d4d6ae23fc4d028f84bb03d418299e57a64920"}
Jul 20 19:02:42.247007 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:42.246849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n" event={"ID":"7f5403aa-14a9-46d0-bbd4-863229a59cd4","Type":"ContainerStarted","Data":"a0d677de6be8603094776e382fbceae993e8ee887c963aae78ef3eb5df08320b"}
Jul 20 19:02:49.891820 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:49.891712    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx" podUID="809e9bf1-67e1-47b8-91e5-044449446546" containerName="main" containerID="cri-o://0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef" gracePeriod=45
Jul 20 19:02:50.163230 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.163206    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:02:50.181363 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.181305    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n" podStartSLOduration=9.18128885 podStartE2EDuration="9.18128885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:42.26338016 +0000 UTC m=+2959.499648576" watchObservedRunningTime="2026-07-20 19:02:50.18128885 +0000 UTC m=+2967.417557265"
Jul 20 19:02:50.244137 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244101    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-home\") pod \"809e9bf1-67e1-47b8-91e5-044449446546\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") "
Jul 20 19:02:50.244327 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244146    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2mvj\" (UniqueName: \"kubernetes.io/projected/809e9bf1-67e1-47b8-91e5-044449446546-kube-api-access-x2mvj\") pod \"809e9bf1-67e1-47b8-91e5-044449446546\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") "
Jul 20 19:02:50.244327 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244207    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-dshm\") pod \"809e9bf1-67e1-47b8-91e5-044449446546\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") "
Jul 20 19:02:50.244327 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244246    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/809e9bf1-67e1-47b8-91e5-044449446546-tls-certs\") pod \"809e9bf1-67e1-47b8-91e5-044449446546\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") "
Jul 20 19:02:50.244327 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244273    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-model-cache\") pod \"809e9bf1-67e1-47b8-91e5-044449446546\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") "
Jul 20 19:02:50.244327 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244314    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-tmp-dir\") pod \"809e9bf1-67e1-47b8-91e5-044449446546\" (UID: \"809e9bf1-67e1-47b8-91e5-044449446546\") "
Jul 20 19:02:50.244627 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244368    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-home" (OuterVolumeSpecName: "home") pod "809e9bf1-67e1-47b8-91e5-044449446546" (UID: "809e9bf1-67e1-47b8-91e5-044449446546"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:02:50.244627 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244617    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-home\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:02:50.244627 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244598    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-model-cache" (OuterVolumeSpecName: "model-cache") pod "809e9bf1-67e1-47b8-91e5-044449446546" (UID: "809e9bf1-67e1-47b8-91e5-044449446546"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:02:50.244735 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.244636    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "809e9bf1-67e1-47b8-91e5-044449446546" (UID: "809e9bf1-67e1-47b8-91e5-044449446546"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:02:50.246484 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.246436    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-dshm" (OuterVolumeSpecName: "dshm") pod "809e9bf1-67e1-47b8-91e5-044449446546" (UID: "809e9bf1-67e1-47b8-91e5-044449446546"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:02:50.246599 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.246497    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/809e9bf1-67e1-47b8-91e5-044449446546-kube-api-access-x2mvj" (OuterVolumeSpecName: "kube-api-access-x2mvj") pod "809e9bf1-67e1-47b8-91e5-044449446546" (UID: "809e9bf1-67e1-47b8-91e5-044449446546"). InnerVolumeSpecName "kube-api-access-x2mvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:50.246599 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.246555    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/809e9bf1-67e1-47b8-91e5-044449446546-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "809e9bf1-67e1-47b8-91e5-044449446546" (UID: "809e9bf1-67e1-47b8-91e5-044449446546"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:50.299132 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.299101    2560 generic.go:356] "Generic (PLEG): container finished" podID="809e9bf1-67e1-47b8-91e5-044449446546" containerID="0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef" exitCode=0
Jul 20 19:02:50.299274 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.299144    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"
Jul 20 19:02:50.299274 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.299187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx" event={"ID":"809e9bf1-67e1-47b8-91e5-044449446546","Type":"ContainerDied","Data":"0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef"}
Jul 20 19:02:50.299274 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.299232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx" event={"ID":"809e9bf1-67e1-47b8-91e5-044449446546","Type":"ContainerDied","Data":"15793dc43de2684b47346dd57d40f0d3d2d11b16d8dc50c0e9a440f76e8dd228"}
Jul 20 19:02:50.299274 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.299250    2560 scope.go:117] "RemoveContainer" containerID="0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef"
Jul 20 19:02:50.308631 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.308619    2560 scope.go:117] "RemoveContainer" containerID="0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef"
Jul 20 19:02:50.308888 ip-10-0-138-45 kubenswrapper[2560]: E0720 19:02:50.308867    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef\": container with ID starting with 0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef not found: ID does not exist" containerID="0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef"
Jul 20 19:02:50.308931 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.308896    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef"} err="failed to get container status \"0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef\": rpc error: code = NotFound desc = could not find container \"0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef\": container with ID starting with 0bccd0c3983bfbd44d2a56d6d52e845d0aff0a3e24bb031741d0dfadde1ceeef not found: ID does not exist"
Jul 20 19:02:50.320401 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.320372    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"]
Jul 20 19:02:50.324241 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.324218    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a2f866/sub-test-model-a2f866-kserve-679b6bb76f-fn6fx"]
Jul 20 19:02:50.345514 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.345496    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-dshm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:02:50.345606 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.345518    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/809e9bf1-67e1-47b8-91e5-044449446546-tls-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:02:50.345606 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.345528    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-model-cache\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:02:50.345606 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.345536    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/809e9bf1-67e1-47b8-91e5-044449446546-tmp-dir\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:02:50.345606 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.345544    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2mvj\" (UniqueName: \"kubernetes.io/projected/809e9bf1-67e1-47b8-91e5-044449446546-kube-api-access-x2mvj\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:02:50.487841 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:50.487761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:02:51.488465 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:51.488415    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="809e9bf1-67e1-47b8-91e5-044449446546" path="/var/lib/kubelet/pods/809e9bf1-67e1-47b8-91e5-044449446546/volumes"
Jul 20 19:02:51.798292 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:51.798204    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:51.798292 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:51.798262    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:51.810597 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:51.810564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:02:52.328336 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:02:52.328303    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:03:02.384405 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:02.384370    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:03:24.279512 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:24.279473    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:03:39.288735 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:39.288700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:03:46.572925 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:46.572889    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"]
Jul 20 19:03:51.769566 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.769534    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7643-140332939241776"]
Jul 20 19:03:51.769955 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.769941    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809e9bf1-67e1-47b8-91e5-044449446546" containerName="main"
Jul 20 19:03:51.769955 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.769955    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="809e9bf1-67e1-47b8-91e5-044449446546" containerName="main"
Jul 20 19:03:51.770043 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.770037    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="809e9bf1-67e1-47b8-91e5-044449446546" containerName="main"
Jul 20 19:03:51.772816 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.772801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332939241776"
Jul 20 19:03:51.775360 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.775338    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4l54m\""
Jul 20 19:03:51.781758 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.781737    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7643-140332939241776"]
Jul 20 19:03:51.898114 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.898090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzvd\" (UniqueName: \"kubernetes.io/projected/561cbfed-5e2d-4469-9ec0-ea65a96cbf1c-kube-api-access-gwzvd\") pod \"test-curl-7643-140332939241776\" (UID: \"561cbfed-5e2d-4469-9ec0-ea65a96cbf1c\") " pod="opendatahub/test-curl-7643-140332939241776"
Jul 20 19:03:51.999106 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:51.999079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzvd\" (UniqueName: \"kubernetes.io/projected/561cbfed-5e2d-4469-9ec0-ea65a96cbf1c-kube-api-access-gwzvd\") pod \"test-curl-7643-140332939241776\" (UID: \"561cbfed-5e2d-4469-9ec0-ea65a96cbf1c\") " pod="opendatahub/test-curl-7643-140332939241776"
Jul 20 19:03:52.007462 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:52.007419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzvd\" (UniqueName: \"kubernetes.io/projected/561cbfed-5e2d-4469-9ec0-ea65a96cbf1c-kube-api-access-gwzvd\") pod \"test-curl-7643-140332939241776\" (UID: \"561cbfed-5e2d-4469-9ec0-ea65a96cbf1c\") " pod="opendatahub/test-curl-7643-140332939241776"
Jul 20 19:03:52.083236 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:52.083166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332939241776"
Jul 20 19:03:52.223678 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:52.223529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7643-140332939241776"]
Jul 20 19:03:52.226806 ip-10-0-138-45 kubenswrapper[2560]: W0720 19:03:52.226641    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod561cbfed_5e2d_4469_9ec0_ea65a96cbf1c.slice/crio-12f4ec472fe8961677f23261fe4ba7d214924e9f7ea2b7e89c60a6d1d282ce63 WatchSource:0}: Error finding container 12f4ec472fe8961677f23261fe4ba7d214924e9f7ea2b7e89c60a6d1d282ce63: Status 404 returned error can't find the container with id 12f4ec472fe8961677f23261fe4ba7d214924e9f7ea2b7e89c60a6d1d282ce63
Jul 20 19:03:52.227500 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:52.227481    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:03:52.662013 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:52.661981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7643-140332939241776" event={"ID":"561cbfed-5e2d-4469-9ec0-ea65a96cbf1c","Type":"ContainerStarted","Data":"12f4ec472fe8961677f23261fe4ba7d214924e9f7ea2b7e89c60a6d1d282ce63"}
Jul 20 19:03:53.668194 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:53.668165    2560 generic.go:356] "Generic (PLEG): container finished" podID="561cbfed-5e2d-4469-9ec0-ea65a96cbf1c" containerID="8c7824e3732133da6c4280edcd90ab1883c69e6bd28794338e9446a3741bcf51" exitCode=0
Jul 20 19:03:53.668579 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:53.668250    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7643-140332939241776" event={"ID":"561cbfed-5e2d-4469-9ec0-ea65a96cbf1c","Type":"ContainerDied","Data":"8c7824e3732133da6c4280edcd90ab1883c69e6bd28794338e9446a3741bcf51"}
Jul 20 19:03:54.820792 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:54.820768    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332939241776"
Jul 20 19:03:54.856413 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:54.856384    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7643-140332939241776_561cbfed-5e2d-4469-9ec0-ea65a96cbf1c/test-curl-7643-140332939241776/0.log"
Jul 20 19:03:54.879356 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:54.879329    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7643-140332939241776"]
Jul 20 19:03:54.885016 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:54.884995    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7643-140332939241776"]
Jul 20 19:03:54.925602 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:54.925535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwzvd\" (UniqueName: \"kubernetes.io/projected/561cbfed-5e2d-4469-9ec0-ea65a96cbf1c-kube-api-access-gwzvd\") pod \"561cbfed-5e2d-4469-9ec0-ea65a96cbf1c\" (UID: \"561cbfed-5e2d-4469-9ec0-ea65a96cbf1c\") "
Jul 20 19:03:54.927867 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:54.927845    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561cbfed-5e2d-4469-9ec0-ea65a96cbf1c-kube-api-access-gwzvd" (OuterVolumeSpecName: "kube-api-access-gwzvd") pod "561cbfed-5e2d-4469-9ec0-ea65a96cbf1c" (UID: "561cbfed-5e2d-4469-9ec0-ea65a96cbf1c"). InnerVolumeSpecName "kube-api-access-gwzvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:03:55.026254 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:55.026215    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwzvd\" (UniqueName: \"kubernetes.io/projected/561cbfed-5e2d-4469-9ec0-ea65a96cbf1c-kube-api-access-gwzvd\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:03:55.493748 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:55.493716    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561cbfed-5e2d-4469-9ec0-ea65a96cbf1c" path="/var/lib/kubelet/pods/561cbfed-5e2d-4469-9ec0-ea65a96cbf1c/volumes"
Jul 20 19:03:55.680008 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:55.679966    2560 scope.go:117] "RemoveContainer" containerID="8c7824e3732133da6c4280edcd90ab1883c69e6bd28794338e9446a3741bcf51"
Jul 20 19:03:55.680008 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:55.679995    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332939241776"
Jul 20 19:03:55.983575 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:55.983546    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:03:57.818709 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:57.818678    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7643-140332939346112"]
Jul 20 19:03:57.819245 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:57.819225    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561cbfed-5e2d-4469-9ec0-ea65a96cbf1c" containerName="test-curl-7643-140332939241776"
Jul 20 19:03:57.819350 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:57.819248    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="561cbfed-5e2d-4469-9ec0-ea65a96cbf1c" containerName="test-curl-7643-140332939241776"
Jul 20 19:03:57.819409 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:57.819375    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="561cbfed-5e2d-4469-9ec0-ea65a96cbf1c" containerName="test-curl-7643-140332939241776"
Jul 20 19:03:57.824018 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:57.823999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332939346112"
Jul 20 19:03:57.827060 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:57.827038    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4l54m\""
Jul 20 19:03:57.828558 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:57.828524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7643-140332939346112"]
Jul 20 19:03:57.950550 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:57.950524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rzhg\" (UniqueName: \"kubernetes.io/projected/0f2ad0ec-5f38-4240-9c68-651eba0bd4f4-kube-api-access-9rzhg\") pod \"test-curl-7643-140332939346112\" (UID: \"0f2ad0ec-5f38-4240-9c68-651eba0bd4f4\") " pod="opendatahub/test-curl-7643-140332939346112"
Jul 20 19:03:58.050971 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:58.050941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rzhg\" (UniqueName: \"kubernetes.io/projected/0f2ad0ec-5f38-4240-9c68-651eba0bd4f4-kube-api-access-9rzhg\") pod \"test-curl-7643-140332939346112\" (UID: \"0f2ad0ec-5f38-4240-9c68-651eba0bd4f4\") " pod="opendatahub/test-curl-7643-140332939346112"
Jul 20 19:03:58.059500 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:58.059476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rzhg\" (UniqueName: \"kubernetes.io/projected/0f2ad0ec-5f38-4240-9c68-651eba0bd4f4-kube-api-access-9rzhg\") pod \"test-curl-7643-140332939346112\" (UID: \"0f2ad0ec-5f38-4240-9c68-651eba0bd4f4\") " pod="opendatahub/test-curl-7643-140332939346112"
Jul 20 19:03:58.136536 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:58.136514    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332939346112"
Jul 20 19:03:58.276524 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:58.276497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7643-140332939346112"]
Jul 20 19:03:58.278032 ip-10-0-138-45 kubenswrapper[2560]: W0720 19:03:58.277999    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f2ad0ec_5f38_4240_9c68_651eba0bd4f4.slice/crio-d15c3091eb93f4f45f1e1758a697b971cef19e5ff0ad512b15517955258cc0be WatchSource:0}: Error finding container d15c3091eb93f4f45f1e1758a697b971cef19e5ff0ad512b15517955258cc0be: Status 404 returned error can't find the container with id d15c3091eb93f4f45f1e1758a697b971cef19e5ff0ad512b15517955258cc0be
Jul 20 19:03:58.698098 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:58.698073    2560 generic.go:356] "Generic (PLEG): container finished" podID="0f2ad0ec-5f38-4240-9c68-651eba0bd4f4" containerID="4093c3196f5072db42402cee702f496cbfe5def6a538619d59576531b530443a" exitCode=0
Jul 20 19:03:58.698212 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:58.698108    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7643-140332939346112" event={"ID":"0f2ad0ec-5f38-4240-9c68-651eba0bd4f4","Type":"ContainerDied","Data":"4093c3196f5072db42402cee702f496cbfe5def6a538619d59576531b530443a"}
Jul 20 19:03:58.698212 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:58.698145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7643-140332939346112" event={"ID":"0f2ad0ec-5f38-4240-9c68-651eba0bd4f4","Type":"ContainerStarted","Data":"d15c3091eb93f4f45f1e1758a697b971cef19e5ff0ad512b15517955258cc0be"}
Jul 20 19:03:59.848244 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:59.848219    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332939346112"
Jul 20 19:03:59.870316 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:59.870226    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7643-140332939346112_0f2ad0ec-5f38-4240-9c68-651eba0bd4f4/test-curl-7643-140332939346112/0.log"
Jul 20 19:03:59.894501 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:59.894475    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7643-140332939346112"]
Jul 20 19:03:59.897979 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:59.897959    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7643-140332939346112"]
Jul 20 19:03:59.968987 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:59.968925    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rzhg\" (UniqueName: \"kubernetes.io/projected/0f2ad0ec-5f38-4240-9c68-651eba0bd4f4-kube-api-access-9rzhg\") pod \"0f2ad0ec-5f38-4240-9c68-651eba0bd4f4\" (UID: \"0f2ad0ec-5f38-4240-9c68-651eba0bd4f4\") "
Jul 20 19:03:59.970992 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:03:59.970962    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f2ad0ec-5f38-4240-9c68-651eba0bd4f4-kube-api-access-9rzhg" (OuterVolumeSpecName: "kube-api-access-9rzhg") pod "0f2ad0ec-5f38-4240-9c68-651eba0bd4f4" (UID: "0f2ad0ec-5f38-4240-9c68-651eba0bd4f4"). InnerVolumeSpecName "kube-api-access-9rzhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:00.070456 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.070406    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rzhg\" (UniqueName: \"kubernetes.io/projected/0f2ad0ec-5f38-4240-9c68-651eba0bd4f4-kube-api-access-9rzhg\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:00.070732 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.070712    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7643-140332936438816"]
Jul 20 19:04:00.071166 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.071153    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f2ad0ec-5f38-4240-9c68-651eba0bd4f4" containerName="test-curl-7643-140332939346112"
Jul 20 19:04:00.071211 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.071169    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f2ad0ec-5f38-4240-9c68-651eba0bd4f4" containerName="test-curl-7643-140332939346112"
Jul 20 19:04:00.071249 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.071238    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f2ad0ec-5f38-4240-9c68-651eba0bd4f4" containerName="test-curl-7643-140332939346112"
Jul 20 19:04:00.074286 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.074273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332936438816"
Jul 20 19:04:00.078775 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.078748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7643-140332936438816"]
Jul 20 19:04:00.171349 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.171324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzrld\" (UniqueName: \"kubernetes.io/projected/b16c7a91-be96-4b20-a60e-98134355c0b0-kube-api-access-jzrld\") pod \"test-curl-7643-140332936438816\" (UID: \"b16c7a91-be96-4b20-a60e-98134355c0b0\") " pod="opendatahub/test-curl-7643-140332936438816"
Jul 20 19:04:00.271798 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.271733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzrld\" (UniqueName: \"kubernetes.io/projected/b16c7a91-be96-4b20-a60e-98134355c0b0-kube-api-access-jzrld\") pod \"test-curl-7643-140332936438816\" (UID: \"b16c7a91-be96-4b20-a60e-98134355c0b0\") " pod="opendatahub/test-curl-7643-140332936438816"
Jul 20 19:04:00.280303 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.280278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzrld\" (UniqueName: \"kubernetes.io/projected/b16c7a91-be96-4b20-a60e-98134355c0b0-kube-api-access-jzrld\") pod \"test-curl-7643-140332936438816\" (UID: \"b16c7a91-be96-4b20-a60e-98134355c0b0\") " pod="opendatahub/test-curl-7643-140332936438816"
Jul 20 19:04:00.385812 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.385788    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332936438816"
Jul 20 19:04:00.520371 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.520341    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7643-140332936438816"]
Jul 20 19:04:00.522128 ip-10-0-138-45 kubenswrapper[2560]: W0720 19:04:00.522066    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb16c7a91_be96_4b20_a60e_98134355c0b0.slice/crio-b1c30358eb9c42cad5e2b018ec5174038f645c6cc7b87dcf8534200ade4d8608 WatchSource:0}: Error finding container b1c30358eb9c42cad5e2b018ec5174038f645c6cc7b87dcf8534200ade4d8608: Status 404 returned error can't find the container with id b1c30358eb9c42cad5e2b018ec5174038f645c6cc7b87dcf8534200ade4d8608
Jul 20 19:04:00.710320 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.710287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7643-140332936438816" event={"ID":"b16c7a91-be96-4b20-a60e-98134355c0b0","Type":"ContainerStarted","Data":"b1c30358eb9c42cad5e2b018ec5174038f645c6cc7b87dcf8534200ade4d8608"}
Jul 20 19:04:00.711535 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.711517    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d15c3091eb93f4f45f1e1758a697b971cef19e5ff0ad512b15517955258cc0be"
Jul 20 19:04:00.711640 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:00.711550    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332939346112"
Jul 20 19:04:00.721910 ip-10-0-138-45 kubenswrapper[2560]: E0720 19:04:00.721883    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7643-140332939346112\" is forbidden: User \"system:node:ip-10-0-138-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-45.ec2.internal' and this object" podUID="0f2ad0ec-5f38-4240-9c68-651eba0bd4f4" pod="opendatahub/test-curl-7643-140332939346112"
Jul 20 19:04:01.488879 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.488852    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f2ad0ec-5f38-4240-9c68-651eba0bd4f4" path="/var/lib/kubelet/pods/0f2ad0ec-5f38-4240-9c68-651eba0bd4f4/volumes"
Jul 20 19:04:01.596102 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.596020    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n" podUID="7f5403aa-14a9-46d0-bbd4-863229a59cd4" containerName="main" containerID="cri-o://3b201ed8f1d49181936f139d91d4d6ae23fc4d028f84bb03d418299e57a64920" gracePeriod=45
Jul 20 19:04:01.719283 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.719246    2560 generic.go:356] "Generic (PLEG): container finished" podID="7f5403aa-14a9-46d0-bbd4-863229a59cd4" containerID="3b201ed8f1d49181936f139d91d4d6ae23fc4d028f84bb03d418299e57a64920" exitCode=0
Jul 20 19:04:01.719418 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.719315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n" event={"ID":"7f5403aa-14a9-46d0-bbd4-863229a59cd4","Type":"ContainerDied","Data":"3b201ed8f1d49181936f139d91d4d6ae23fc4d028f84bb03d418299e57a64920"}
Jul 20 19:04:01.720919 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.720896    2560 generic.go:356] "Generic (PLEG): container finished" podID="b16c7a91-be96-4b20-a60e-98134355c0b0" containerID="746581cff2ee21266ba3e5a920163cbcc96aa55c45c5062ca28a0221c7b9807e" exitCode=0
Jul 20 19:04:01.721038 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.720998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7643-140332936438816" event={"ID":"b16c7a91-be96-4b20-a60e-98134355c0b0","Type":"ContainerDied","Data":"746581cff2ee21266ba3e5a920163cbcc96aa55c45c5062ca28a0221c7b9807e"}
Jul 20 19:04:01.859339 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.859286    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:04:01.988100 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4ws8\" (UniqueName: \"kubernetes.io/projected/7f5403aa-14a9-46d0-bbd4-863229a59cd4-kube-api-access-f4ws8\") pod \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") "
Jul 20 19:04:01.988249 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988116    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-model-cache\") pod \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") "
Jul 20 19:04:01.988249 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tmp-dir\") pod \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") "
Jul 20 19:04:01.988249 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988193    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-home\") pod \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") "
Jul 20 19:04:01.988249 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988221    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-dshm\") pod \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") "
Jul 20 19:04:01.988249 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988240    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tls-certs\") pod \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\" (UID: \"7f5403aa-14a9-46d0-bbd4-863229a59cd4\") "
Jul 20 19:04:01.988569 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988435    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-model-cache" (OuterVolumeSpecName: "model-cache") pod "7f5403aa-14a9-46d0-bbd4-863229a59cd4" (UID: "7f5403aa-14a9-46d0-bbd4-863229a59cd4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:01.988569 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988482    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7f5403aa-14a9-46d0-bbd4-863229a59cd4" (UID: "7f5403aa-14a9-46d0-bbd4-863229a59cd4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:01.988569 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-home" (OuterVolumeSpecName: "home") pod "7f5403aa-14a9-46d0-bbd4-863229a59cd4" (UID: "7f5403aa-14a9-46d0-bbd4-863229a59cd4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:01.988705 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988577    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tmp-dir\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:01.988705 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988594    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-home\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:01.988705 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.988603    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-model-cache\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:01.990395 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.990372    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-dshm" (OuterVolumeSpecName: "dshm") pod "7f5403aa-14a9-46d0-bbd4-863229a59cd4" (UID: "7f5403aa-14a9-46d0-bbd4-863229a59cd4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:01.990516 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.990431    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7f5403aa-14a9-46d0-bbd4-863229a59cd4" (UID: "7f5403aa-14a9-46d0-bbd4-863229a59cd4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:04:01.990516 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:01.990509    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5403aa-14a9-46d0-bbd4-863229a59cd4-kube-api-access-f4ws8" (OuterVolumeSpecName: "kube-api-access-f4ws8") pod "7f5403aa-14a9-46d0-bbd4-863229a59cd4" (UID: "7f5403aa-14a9-46d0-bbd4-863229a59cd4"). InnerVolumeSpecName "kube-api-access-f4ws8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:02.089382 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.089354    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4ws8\" (UniqueName: \"kubernetes.io/projected/7f5403aa-14a9-46d0-bbd4-863229a59cd4-kube-api-access-f4ws8\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:02.089382 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.089379    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5403aa-14a9-46d0-bbd4-863229a59cd4-dshm\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:02.089547 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.089393    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5403aa-14a9-46d0-bbd4-863229a59cd4-tls-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:02.728049 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.728020    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"
Jul 20 19:04:02.728595 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.728055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n" event={"ID":"7f5403aa-14a9-46d0-bbd4-863229a59cd4","Type":"ContainerDied","Data":"a0d677de6be8603094776e382fbceae993e8ee887c963aae78ef3eb5df08320b"}
Jul 20 19:04:02.728595 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.728095    2560 scope.go:117] "RemoveContainer" containerID="3b201ed8f1d49181936f139d91d4d6ae23fc4d028f84bb03d418299e57a64920"
Jul 20 19:04:02.752194 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.752166    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"]
Jul 20 19:04:02.754414 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.754392    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b7bb94/rate-test-model-b7bb94-kserve-5487979c87-w4b9n"]
Jul 20 19:04:02.869222 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.869202    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332936438816"
Jul 20 19:04:02.890111 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.890086    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7643-140332936438816_b16c7a91-be96-4b20-a60e-98134355c0b0/test-curl-7643-140332936438816/0.log"
Jul 20 19:04:02.920052 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.920012    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7643-140332936438816"]
Jul 20 19:04:02.922449 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.922425    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7643-140332936438816"]
Jul 20 19:04:02.998300 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:02.998247    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzrld\" (UniqueName: \"kubernetes.io/projected/b16c7a91-be96-4b20-a60e-98134355c0b0-kube-api-access-jzrld\") pod \"b16c7a91-be96-4b20-a60e-98134355c0b0\" (UID: \"b16c7a91-be96-4b20-a60e-98134355c0b0\") "
Jul 20 19:04:03.000303 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:03.000279    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16c7a91-be96-4b20-a60e-98134355c0b0-kube-api-access-jzrld" (OuterVolumeSpecName: "kube-api-access-jzrld") pod "b16c7a91-be96-4b20-a60e-98134355c0b0" (UID: "b16c7a91-be96-4b20-a60e-98134355c0b0"). InnerVolumeSpecName "kube-api-access-jzrld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:03.099027 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:03.099003    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzrld\" (UniqueName: \"kubernetes.io/projected/b16c7a91-be96-4b20-a60e-98134355c0b0-kube-api-access-jzrld\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:03.489225 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:03.489194    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f5403aa-14a9-46d0-bbd4-863229a59cd4" path="/var/lib/kubelet/pods/7f5403aa-14a9-46d0-bbd4-863229a59cd4/volumes"
Jul 20 19:04:03.489543 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:03.489530    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b16c7a91-be96-4b20-a60e-98134355c0b0" path="/var/lib/kubelet/pods/b16c7a91-be96-4b20-a60e-98134355c0b0/volumes"
Jul 20 19:04:03.742570 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:03.742499    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7643-140332936438816"
Jul 20 19:04:03.742570 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:03.742536    2560 scope.go:117] "RemoveContainer" containerID="746581cff2ee21266ba3e5a920163cbcc96aa55c45c5062ca28a0221c7b9807e"
Jul 20 19:04:19.578514 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:19.578424    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:04:38.172126 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.172091    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"]
Jul 20 19:04:38.172713 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.172429    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt" podUID="d086854c-b7e2-414c-b08b-0a1bfb287fec" containerName="maas-api" containerID="cri-o://57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868" gracePeriod=30
Jul 20 19:04:38.421378 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.421355    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 19:04:38.492750 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.492668    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086854c-b7e2-414c-b08b-0a1bfb287fec-openshift-service-ca\") pod \"d086854c-b7e2-414c-b08b-0a1bfb287fec\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") "
Jul 20 19:04:38.492750 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.492713    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d086854c-b7e2-414c-b08b-0a1bfb287fec-maas-api-tls\") pod \"d086854c-b7e2-414c-b08b-0a1bfb287fec\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") "
Jul 20 19:04:38.492955 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.492819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz9nj\" (UniqueName: \"kubernetes.io/projected/d086854c-b7e2-414c-b08b-0a1bfb287fec-kube-api-access-xz9nj\") pod \"d086854c-b7e2-414c-b08b-0a1bfb287fec\" (UID: \"d086854c-b7e2-414c-b08b-0a1bfb287fec\") "
Jul 20 19:04:38.493107 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.493081    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d086854c-b7e2-414c-b08b-0a1bfb287fec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d086854c-b7e2-414c-b08b-0a1bfb287fec" (UID: "d086854c-b7e2-414c-b08b-0a1bfb287fec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:04:38.494764 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.494738    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d086854c-b7e2-414c-b08b-0a1bfb287fec-kube-api-access-xz9nj" (OuterVolumeSpecName: "kube-api-access-xz9nj") pod "d086854c-b7e2-414c-b08b-0a1bfb287fec" (UID: "d086854c-b7e2-414c-b08b-0a1bfb287fec"). InnerVolumeSpecName "kube-api-access-xz9nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:38.494872 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.494828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d086854c-b7e2-414c-b08b-0a1bfb287fec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d086854c-b7e2-414c-b08b-0a1bfb287fec" (UID: "d086854c-b7e2-414c-b08b-0a1bfb287fec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:04:38.594287 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.594259    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086854c-b7e2-414c-b08b-0a1bfb287fec-openshift-service-ca\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:38.594287 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.594283    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d086854c-b7e2-414c-b08b-0a1bfb287fec-maas-api-tls\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:38.594434 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.594293    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz9nj\" (UniqueName: \"kubernetes.io/projected/d086854c-b7e2-414c-b08b-0a1bfb287fec-kube-api-access-xz9nj\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:38.946533 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.946499    2560 generic.go:356] "Generic (PLEG): container finished" podID="d086854c-b7e2-414c-b08b-0a1bfb287fec" containerID="57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868" exitCode=0
Jul 20 19:04:38.946683 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.946546    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"
Jul 20 19:04:38.946683 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.946580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt" event={"ID":"d086854c-b7e2-414c-b08b-0a1bfb287fec","Type":"ContainerDied","Data":"57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868"}
Jul 20 19:04:38.946683 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.946635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt" event={"ID":"d086854c-b7e2-414c-b08b-0a1bfb287fec","Type":"ContainerDied","Data":"3b109092bae17cdaa62cb7089f29168f2f507af1115e5f08c1d1f5243ed2ef2f"}
Jul 20 19:04:38.946683 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.946658    2560 scope.go:117] "RemoveContainer" containerID="57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868"
Jul 20 19:04:38.956167 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.956148    2560 scope.go:117] "RemoveContainer" containerID="57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868"
Jul 20 19:04:38.956423 ip-10-0-138-45 kubenswrapper[2560]: E0720 19:04:38.956400    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868\": container with ID starting with 57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868 not found: ID does not exist" containerID="57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868"
Jul 20 19:04:38.956501 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.956433    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868"} err="failed to get container status \"57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868\": rpc error: code = NotFound desc = could not find container \"57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868\": container with ID starting with 57858f9bbdfac2c1e8a135763049afae9eedff4f3795d7f68cbb781bd901f868 not found: ID does not exist"
Jul 20 19:04:38.968340 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.968320    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"]
Jul 20 19:04:38.971488 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:38.971466    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a2f866-6b99dc6c74-7dmbt"]
Jul 20 19:04:39.488827 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:39.488792    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d086854c-b7e2-414c-b08b-0a1bfb287fec" path="/var/lib/kubelet/pods/d086854c-b7e2-414c-b08b-0a1bfb287fec/volumes"
Jul 20 19:04:41.285588 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:41.285553    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7jrd9"]
Jul 20 19:04:49.281791 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:49.281760    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"]
Jul 20 19:04:49.282196 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:49.281982    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy" containerID="cri-o://1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974" gracePeriod=30
Jul 20 19:04:49.939151 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:49.939115    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9bdd66f-9zm7t_f48f1345-ccad-4a61-aaab-7980ec379448/authorino/0.log"
Jul 20 19:04:54.544861 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.544805    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 19:04:54.630250 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630209    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-data\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630408 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630278    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-podinfo\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630408 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630313    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-certs\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630408 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630359    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istiod-ca-cert\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630408 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630377    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-envoy\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630408 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630405    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-token\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630718 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630466    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-socket\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630718 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630494    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxf6v\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-kube-api-access-qxf6v\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630718 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-credential-socket\") pod \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\" (UID: \"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c\") "
Jul 20 19:04:54.630718 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630651    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:54.630923 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630765    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:54.630923 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630790    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:04:54.630923 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630813    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-certs\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:54.631083 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.630974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:54.631175 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.631155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:54.632639 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.632614    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:54.632768 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.632746    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:54.633029 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.633013    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:04:54.633076 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.633028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-kube-api-access-qxf6v" (OuterVolumeSpecName: "kube-api-access-qxf6v") pod "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" (UID: "7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c"). InnerVolumeSpecName "kube-api-access-qxf6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:54.732076 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.732053    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-podinfo\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:54.732076 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.732073    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istiod-ca-cert\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:54.732206 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.732082    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-envoy\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:54.732206 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.732091    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-token\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:54.732206 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.732098    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-workload-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:54.732206 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.732106    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxf6v\" (UniqueName: \"kubernetes.io/projected/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-kube-api-access-qxf6v\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:54.732206 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.732115    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-credential-socket\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:54.732206 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:54.732123    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c-istio-data\") on node \"ip-10-0-138-45.ec2.internal\" DevicePath \"\""
Jul 20 19:04:55.042274 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.042246    2560 generic.go:356] "Generic (PLEG): container finished" podID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerID="1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974" exitCode=0
Jul 20 19:04:55.042416 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.042292    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"
Jul 20 19:04:55.042416 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.042327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" event={"ID":"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c","Type":"ContainerDied","Data":"1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974"}
Jul 20 19:04:55.042416 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.042403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh" event={"ID":"7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c","Type":"ContainerDied","Data":"6523ab18b92b43b48da733e096c73aad23ca59006826fe2e51fbb0bb88d4f970"}
Jul 20 19:04:55.042568 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.042462    2560 scope.go:117] "RemoveContainer" containerID="1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974"
Jul 20 19:04:55.052583 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.052569    2560 scope.go:117] "RemoveContainer" containerID="09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7"
Jul 20 19:04:55.060714 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.060697    2560 scope.go:117] "RemoveContainer" containerID="1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974"
Jul 20 19:04:55.060984 ip-10-0-138-45 kubenswrapper[2560]: E0720 19:04:55.060968    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974\": container with ID starting with 1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974 not found: ID does not exist" containerID="1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974"
Jul 20 19:04:55.061024 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.060994    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974"} err="failed to get container status \"1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974\": rpc error: code = NotFound desc = could not find container \"1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974\": container with ID starting with 1ca0d8dfcbb31c0517c4f760e4436e61562ef13d86952598b38d7a2dde4cb974 not found: ID does not exist"
Jul 20 19:04:55.061024 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.061010    2560 scope.go:117] "RemoveContainer" containerID="09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7"
Jul 20 19:04:55.061233 ip-10-0-138-45 kubenswrapper[2560]: E0720 19:04:55.061215    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7\": container with ID starting with 09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7 not found: ID does not exist" containerID="09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7"
Jul 20 19:04:55.061269 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.061239    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7"} err="failed to get container status \"09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7\": rpc error: code = NotFound desc = could not find container \"09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7\": container with ID starting with 09d9b24df5f435db59548a1b213ce0b23fbe50d4ab3c519ddf21c2195a0bd7e7 not found: ID does not exist"
Jul 20 19:04:55.067879 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.067854    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"]
Jul 20 19:04:55.072072 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.072053    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a2f866-openshift-default-5f55986547-nltqh"]
Jul 20 19:04:55.361905 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.361822    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5t9vc_7e337b21-7026-42e8-98f2-f11f60e7a982/manager/0.log"
Jul 20 19:04:55.488874 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.488847    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fts9p_1b84c36a-da20-4bd9-9de5-0b0190dd7ebe/manager/0.log"
Jul 20 19:04:55.490874 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.490853    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" path="/var/lib/kubelet/pods/7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c/volumes"
Jul 20 19:04:55.736364 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.736339    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7mb72_795e01de-1725-44d9-bd3a-669dd10cff70/server/0.log"
Jul 20 19:04:55.860770 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:55.860745    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qspx4_228222fc-d919-4648-967d-135b37842334/manager/0.log"
Jul 20 19:04:56.118116 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:56.118093    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fdd66b9b-sqdk5_f141b0ac-2466-4713-adcb-034bfa224f12/copy-manifests/0.log"
Jul 20 19:04:56.138238 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:56.138213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fdd66b9b-sqdk5_f141b0ac-2466-4713-adcb-034bfa224f12/manager/0.log"
Jul 20 19:04:57.839053 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:57.839023    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr_c4e89309-80e9-4a64-a717-0d3d35ac9a02/util/0.log"
Jul 20 19:04:57.844700 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:57.844677    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr_c4e89309-80e9-4a64-a717-0d3d35ac9a02/pull/0.log"
Jul 20 19:04:57.850690 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:57.850663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr_c4e89309-80e9-4a64-a717-0d3d35ac9a02/extract/0.log"
Jul 20 19:04:57.961346 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:57.961326    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd_aa9e87e6-945d-41e7-b047-bf2eb27f00a6/util/0.log"
Jul 20 19:04:57.967986 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:57.967961    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd_aa9e87e6-945d-41e7-b047-bf2eb27f00a6/pull/0.log"
Jul 20 19:04:57.974369 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:57.974352    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd_aa9e87e6-945d-41e7-b047-bf2eb27f00a6/extract/0.log"
Jul 20 19:04:58.083116 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.083094    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt_fb1c7e68-cfce-4015-90a1-cd2f31556d2c/util/0.log"
Jul 20 19:04:58.089758 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.089697    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt_fb1c7e68-cfce-4015-90a1-cd2f31556d2c/pull/0.log"
Jul 20 19:04:58.095940 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.095919    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt_fb1c7e68-cfce-4015-90a1-cd2f31556d2c/extract/0.log"
Jul 20 19:04:58.204925 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.204903    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x_1ccd811a-1a2c-419f-a79a-071c4a652a1b/util/0.log"
Jul 20 19:04:58.211108 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.211080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x_1ccd811a-1a2c-419f-a79a-071c4a652a1b/pull/0.log"
Jul 20 19:04:58.217373 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.217354    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x_1ccd811a-1a2c-419f-a79a-071c4a652a1b/extract/0.log"
Jul 20 19:04:58.341060 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.340978    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9bdd66f-9zm7t_f48f1345-ccad-4a61-aaab-7980ec379448/authorino/0.log"
Jul 20 19:04:58.457368 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.457341    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vxhcr_a6591cfa-408f-43a2-a9b9-abd1266e4066/manager/0.log"
Jul 20 19:04:58.571836 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.571806    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rvvm2_9663cf35-98a7-45af-bcb8-6bfa13e0bea1/manager/0.log"
Jul 20 19:04:58.804238 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.804214    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m7sb4_98eaba12-6239-43d2-a800-f881b9ca5f92/registry-server/0.log"
Jul 20 19:04:58.929118 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:58.929095    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mqfmm_e07cae97-1a7c-4073-ad04-b34debe347df/manager/0.log"
Jul 20 19:04:59.043801 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:59.043781    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7jrd9_e3f8bc8b-4d7e-4bb1-b818-6357f516d18d/limitador/0.log"
Jul 20 19:04:59.173594 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:59.173565    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gqwxp_ccfdf1ae-4ef8-498f-bbb4-839590336b95/manager/0.log"
Jul 20 19:04:59.520222 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:59.520143    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hlfwq_d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e/istio-proxy/0.log"
Jul 20 19:04:59.749935 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:04:59.749905    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7596f649d-4rxdz_61212374-cc10-4872-8148-0f5353824115/kube-auth-proxy/0.log"
Jul 20 19:05:00.310559 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:00.310528    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6569bb95cd-22j2r_7a86a34c-77fd-4f28-ba1a-a62e9c2c604a/router/0.log"
Jul 20 19:05:01.237649 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:01.237619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-2q8st_9c58cc81-0508-4f83-a860-68fbf96b063c/main/0.log"
Jul 20 19:05:06.934632 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.934598    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wtj6n/must-gather-kvr52"]
Jul 20 19:05:06.935025 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.934955    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy"
Jul 20 19:05:06.935025 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.934966    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy"
Jul 20 19:05:06.935025 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.934982    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d086854c-b7e2-414c-b08b-0a1bfb287fec" containerName="maas-api"
Jul 20 19:05:06.935025 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.934988    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d086854c-b7e2-414c-b08b-0a1bfb287fec" containerName="maas-api"
Jul 20 19:05:06.935025 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.934995    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy"
Jul 20 19:05:06.935025 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935000    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy"
Jul 20 19:05:06.935025 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935014    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16c7a91-be96-4b20-a60e-98134355c0b0" containerName="test-curl-7643-140332936438816"
Jul 20 19:05:06.935025 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935019    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16c7a91-be96-4b20-a60e-98134355c0b0" containerName="test-curl-7643-140332936438816"
Jul 20 19:05:06.935295 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935032    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5403aa-14a9-46d0-bbd4-863229a59cd4" containerName="main"
Jul 20 19:05:06.935295 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935037    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5403aa-14a9-46d0-bbd4-863229a59cd4" containerName="main"
Jul 20 19:05:06.935295 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935111    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f5403aa-14a9-46d0-bbd4-863229a59cd4" containerName="main"
Jul 20 19:05:06.935295 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935119    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d086854c-b7e2-414c-b08b-0a1bfb287fec" containerName="maas-api"
Jul 20 19:05:06.935295 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935126    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy"
Jul 20 19:05:06.935295 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935132    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16c7a91-be96-4b20-a60e-98134355c0b0" containerName="test-curl-7643-140332936438816"
Jul 20 19:05:06.935295 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.935138    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bdfc9fa-a0ba-4ecd-ab0d-eadf0ac05b7c" containerName="istio-proxy"
Jul 20 19:05:06.938351 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.938331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtj6n/must-gather-kvr52"
Jul 20 19:05:06.940648 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.940619    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtj6n\"/\"openshift-service-ca.crt\""
Jul 20 19:05:06.940753 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.940736    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtj6n\"/\"kube-root-ca.crt\""
Jul 20 19:05:06.948319 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:06.948299    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtj6n/must-gather-kvr52"]
Jul 20 19:05:07.031971 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:07.031949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8b36dfb-a715-49bf-913d-69ce14699765-must-gather-output\") pod \"must-gather-kvr52\" (UID: \"f8b36dfb-a715-49bf-913d-69ce14699765\") " pod="openshift-must-gather-wtj6n/must-gather-kvr52"
Jul 20 19:05:07.032086 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:07.031983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65w4\" (UniqueName: \"kubernetes.io/projected/f8b36dfb-a715-49bf-913d-69ce14699765-kube-api-access-n65w4\") pod \"must-gather-kvr52\" (UID: \"f8b36dfb-a715-49bf-913d-69ce14699765\") " pod="openshift-must-gather-wtj6n/must-gather-kvr52"
Jul 20 19:05:07.132781 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:07.132755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8b36dfb-a715-49bf-913d-69ce14699765-must-gather-output\") pod \"must-gather-kvr52\" (UID: \"f8b36dfb-a715-49bf-913d-69ce14699765\") " pod="openshift-must-gather-wtj6n/must-gather-kvr52"
Jul 20 19:05:07.132893 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:07.132789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n65w4\" (UniqueName: \"kubernetes.io/projected/f8b36dfb-a715-49bf-913d-69ce14699765-kube-api-access-n65w4\") pod \"must-gather-kvr52\" (UID: \"f8b36dfb-a715-49bf-913d-69ce14699765\") " pod="openshift-must-gather-wtj6n/must-gather-kvr52"
Jul 20 19:05:07.133132 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:07.133115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8b36dfb-a715-49bf-913d-69ce14699765-must-gather-output\") pod \"must-gather-kvr52\" (UID: \"f8b36dfb-a715-49bf-913d-69ce14699765\") " pod="openshift-must-gather-wtj6n/must-gather-kvr52"
Jul 20 19:05:07.140978 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:07.140957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65w4\" (UniqueName: \"kubernetes.io/projected/f8b36dfb-a715-49bf-913d-69ce14699765-kube-api-access-n65w4\") pod \"must-gather-kvr52\" (UID: \"f8b36dfb-a715-49bf-913d-69ce14699765\") " pod="openshift-must-gather-wtj6n/must-gather-kvr52"
Jul 20 19:05:07.248078 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:07.248023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtj6n/must-gather-kvr52"
Jul 20 19:05:07.378971 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:07.378943    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtj6n/must-gather-kvr52"]
Jul 20 19:05:07.380396 ip-10-0-138-45 kubenswrapper[2560]: W0720 19:05:07.380373    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8b36dfb_a715_49bf_913d_69ce14699765.slice/crio-fd09c82b8cb3b0d4927d1c36b6ef0838df76d203ddaa121b1162336a2752384d WatchSource:0}: Error finding container fd09c82b8cb3b0d4927d1c36b6ef0838df76d203ddaa121b1162336a2752384d: Status 404 returned error can't find the container with id fd09c82b8cb3b0d4927d1c36b6ef0838df76d203ddaa121b1162336a2752384d
Jul 20 19:05:08.121510 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:08.121471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtj6n/must-gather-kvr52" event={"ID":"f8b36dfb-a715-49bf-913d-69ce14699765","Type":"ContainerStarted","Data":"fd09c82b8cb3b0d4927d1c36b6ef0838df76d203ddaa121b1162336a2752384d"}
Jul 20 19:05:09.130354 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:09.130310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtj6n/must-gather-kvr52" event={"ID":"f8b36dfb-a715-49bf-913d-69ce14699765","Type":"ContainerStarted","Data":"ac54f117c683181258ef0f93830d82f357b7776e78a8dc2039fd409e31703294"}
Jul 20 19:05:09.130855 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:09.130367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtj6n/must-gather-kvr52" event={"ID":"f8b36dfb-a715-49bf-913d-69ce14699765","Type":"ContainerStarted","Data":"b79ae571ac73ba05095d9b74d369026e1c929042ee527ad7590b4c65ef511cb1"}
Jul 20 19:05:09.147872 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:09.147814    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wtj6n/must-gather-kvr52" podStartSLOduration=2.035080341 podStartE2EDuration="3.14779244s" totalImagesPullingTime="1.112712099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:09.145866817 +0000 UTC m=+3106.382135229" watchObservedRunningTime="2026-07-20 19:05:09.14779244 +0000 UTC m=+3106.384060857"
Jul 20 19:05:09.995146 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:09.995101    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5hxn6_94b72186-398e-4d73-99b4-1eb9cd0ec618/global-pull-secret-syncer/0.log"
Jul 20 19:05:10.176373 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:10.176344    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qx2d7_d2e22dc2-1a0a-410f-a007-c904b419e154/konnectivity-agent/0.log"
Jul 20 19:05:10.261459 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:10.261366    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-45.ec2.internal_e2c28caece7ac4aa08342defb3f5e63b/haproxy/0.log"
Jul 20 19:05:14.723819 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.723781    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr_c4e89309-80e9-4a64-a717-0d3d35ac9a02/extract/0.log"
Jul 20 19:05:14.748088 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.748054    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr_c4e89309-80e9-4a64-a717-0d3d35ac9a02/util/0.log"
Jul 20 19:05:14.769961 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.769913    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z6zqr_c4e89309-80e9-4a64-a717-0d3d35ac9a02/pull/0.log"
Jul 20 19:05:14.798857 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.798810    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd_aa9e87e6-945d-41e7-b047-bf2eb27f00a6/extract/0.log"
Jul 20 19:05:14.822582 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.822551    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd_aa9e87e6-945d-41e7-b047-bf2eb27f00a6/util/0.log"
Jul 20 19:05:14.843209 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.843180    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05rnqd_aa9e87e6-945d-41e7-b047-bf2eb27f00a6/pull/0.log"
Jul 20 19:05:14.870628 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.870597    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt_fb1c7e68-cfce-4015-90a1-cd2f31556d2c/extract/0.log"
Jul 20 19:05:14.895723 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.895675    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt_fb1c7e68-cfce-4015-90a1-cd2f31556d2c/util/0.log"
Jul 20 19:05:14.916915 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.916880    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gqwlt_fb1c7e68-cfce-4015-90a1-cd2f31556d2c/pull/0.log"
Jul 20 19:05:14.943467 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.943409    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x_1ccd811a-1a2c-419f-a79a-071c4a652a1b/extract/0.log"
Jul 20 19:05:14.965501 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.965469    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x_1ccd811a-1a2c-419f-a79a-071c4a652a1b/util/0.log"
Jul 20 19:05:14.989646 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:14.989568    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18sl6x_1ccd811a-1a2c-419f-a79a-071c4a652a1b/pull/0.log"
Jul 20 19:05:15.617940 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:15.617858    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9bdd66f-9zm7t_f48f1345-ccad-4a61-aaab-7980ec379448/authorino/0.log"
Jul 20 19:05:15.647361 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:15.647311    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vxhcr_a6591cfa-408f-43a2-a9b9-abd1266e4066/manager/0.log"
Jul 20 19:05:15.686144 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:15.686117    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rvvm2_9663cf35-98a7-45af-bcb8-6bfa13e0bea1/manager/0.log"
Jul 20 19:05:15.764923 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:15.764882    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m7sb4_98eaba12-6239-43d2-a800-f881b9ca5f92/registry-server/0.log"
Jul 20 19:05:15.992054 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:15.991978    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mqfmm_e07cae97-1a7c-4073-ad04-b34debe347df/manager/0.log"
Jul 20 19:05:16.025543 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:16.025518    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7jrd9_e3f8bc8b-4d7e-4bb1-b818-6357f516d18d/limitador/0.log"
Jul 20 19:05:16.124689 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:16.124635    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gqwxp_ccfdf1ae-4ef8-498f-bbb4-839590336b95/manager/0.log"
Jul 20 19:05:17.848862 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:17.848824    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-shj78_96d1f641-f6b9-4b9a-a9d3-2439d014a479/cluster-monitoring-operator/0.log"
Jul 20 19:05:17.894511 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:17.894480    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-vbst2_9a05000f-440e-4391-aaad-b93e83915ea4/kube-state-metrics/0.log"
Jul 20 19:05:17.915908 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:17.915867    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-vbst2_9a05000f-440e-4391-aaad-b93e83915ea4/kube-rbac-proxy-main/0.log"
Jul 20 19:05:17.938222 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:17.938198    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-vbst2_9a05000f-440e-4391-aaad-b93e83915ea4/kube-rbac-proxy-self/0.log"
Jul 20 19:05:18.106492 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:18.106354    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7khc_bc36ddb0-7d5d-431c-90ee-70f44abe88a0/node-exporter/0.log"
Jul 20 19:05:18.124482 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:18.124451    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7khc_bc36ddb0-7d5d-431c-90ee-70f44abe88a0/kube-rbac-proxy/0.log"
Jul 20 19:05:18.147227 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:18.147196    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7khc_bc36ddb0-7d5d-431c-90ee-70f44abe88a0/init-textfile/0.log"
Jul 20 19:05:18.497904 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:18.497872    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-5nxsr_e168c82e-419f-496d-a4b9-0ceb80fbc58f/prometheus-operator/0.log"
Jul 20 19:05:18.519197 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:18.519163    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-5nxsr_e168c82e-419f-496d-a4b9-0ceb80fbc58f/kube-rbac-proxy/0.log"
Jul 20 19:05:19.916999 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:19.916963    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-mxg4j_57e76730-88c9-46d3-9f48-180cf3f4e378/networking-console-plugin/0.log"
Jul 20 19:05:20.248777 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.248677    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"]
Jul 20 19:05:20.254669 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.254640    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.257093 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.257062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wtj6n\"/\"default-dockercfg-pl49w\""
Jul 20 19:05:20.261835 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.261814    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"]
Jul 20 19:05:20.265670 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.265630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-lib-modules\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.265796 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.265717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-sys\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.265796 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.265751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz2wz\" (UniqueName: \"kubernetes.io/projected/f1601213-3274-4aae-933a-909683dca5f9-kube-api-access-wz2wz\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.265796 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.265776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-podres\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.265975 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.265844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-proc\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.367215 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.367169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-proc\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.368326 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.367433    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-proc\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.368326 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.367552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-lib-modules\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.368326 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.367617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-sys\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.368326 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.367648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz2wz\" (UniqueName: \"kubernetes.io/projected/f1601213-3274-4aae-933a-909683dca5f9-kube-api-access-wz2wz\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.368326 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.367677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-podres\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.368326 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.367852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-podres\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.368326 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.367955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-lib-modules\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.368326 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.368003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1601213-3274-4aae-933a-909683dca5f9-sys\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.384990 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.384963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz2wz\" (UniqueName: \"kubernetes.io/projected/f1601213-3274-4aae-933a-909683dca5f9-kube-api-access-wz2wz\") pod \"perf-node-gather-daemonset-5pxhn\" (UID: \"f1601213-3274-4aae-933a-909683dca5f9\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.572840 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.572763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:20.766940 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:20.766916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"]
Jul 20 19:05:20.769833 ip-10-0-138-45 kubenswrapper[2560]: W0720 19:05:20.769802    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf1601213_3274_4aae_933a_909683dca5f9.slice/crio-1ca4279d81543d778f91e78cec09a2b2f8133d283634ef7bcbba537ce274660b WatchSource:0}: Error finding container 1ca4279d81543d778f91e78cec09a2b2f8133d283634ef7bcbba537ce274660b: Status 404 returned error can't find the container with id 1ca4279d81543d778f91e78cec09a2b2f8133d283634ef7bcbba537ce274660b
Jul 20 19:05:21.073507 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:21.073418    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f4685dd7c-cnj62_c636d29f-5221-4eee-998c-5615a93ec386/console/0.log"
Jul 20 19:05:21.220580 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:21.220544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn" event={"ID":"f1601213-3274-4aae-933a-909683dca5f9","Type":"ContainerStarted","Data":"71e8a34cda705ec4a214a816dd534582d73c5895b0bc77698a8b211f4ec1401b"}
Jul 20 19:05:21.220773 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:21.220616    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn" event={"ID":"f1601213-3274-4aae-933a-909683dca5f9","Type":"ContainerStarted","Data":"1ca4279d81543d778f91e78cec09a2b2f8133d283634ef7bcbba537ce274660b"}
Jul 20 19:05:21.220773 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:21.220644    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:21.237749 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:21.237692    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn" podStartSLOduration=1.237670629 podStartE2EDuration="1.237670629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:21.234981574 +0000 UTC m=+3118.471249983" watchObservedRunningTime="2026-07-20 19:05:21.237670629 +0000 UTC m=+3118.473939044"
Jul 20 19:05:21.657602 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:21.657573    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-tnfhm_6662c817-7ec5-48ea-94e2-bc4991ebe698/volume-data-source-validator/0.log"
Jul 20 19:05:22.760061 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:22.760026    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gc6bn_f834878a-ddb3-4474-8e63-7ba9b1228509/dns/0.log"
Jul 20 19:05:22.780547 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:22.780521    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gc6bn_f834878a-ddb3-4474-8e63-7ba9b1228509/kube-rbac-proxy/0.log"
Jul 20 19:05:22.804359 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:22.804337    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-244j2_9d68d36a-6400-465b-939c-6a634d194eea/dns-node-resolver/0.log"
Jul 20 19:05:23.490203 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:23.489832    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8hts_c5a88467-7161-4264-9cf6-4dd9953c73eb/node-ca/0.log"
Jul 20 19:05:24.408045 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:24.407998    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hlfwq_d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e/istio-proxy/0.log"
Jul 20 19:05:24.554656 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:24.554626    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7596f649d-4rxdz_61212374-cc10-4872-8148-0f5353824115/kube-auth-proxy/0.log"
Jul 20 19:05:24.716851 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:24.716770    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6569bb95cd-22j2r_7a86a34c-77fd-4f28-ba1a-a62e9c2c604a/router/0.log"
Jul 20 19:05:25.447389 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:25.447347    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-btgjx_156f71cb-4b57-469a-b9c9-b4016addfb1e/serve-healthcheck-canary/0.log"
Jul 20 19:05:25.987889 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:25.987860    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qlf5_731543ec-13ce-406d-88d7-3d785ec5ae8d/kube-rbac-proxy/0.log"
Jul 20 19:05:26.008610 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:26.008562    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qlf5_731543ec-13ce-406d-88d7-3d785ec5ae8d/exporter/0.log"
Jul 20 19:05:26.031946 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:26.031909    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qlf5_731543ec-13ce-406d-88d7-3d785ec5ae8d/extractor/0.log"
Jul 20 19:05:27.242175 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:27.241387    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-5pxhn"
Jul 20 19:05:28.130130 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:28.130104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5t9vc_7e337b21-7026-42e8-98f2-f11f60e7a982/manager/0.log"
Jul 20 19:05:28.532925 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:28.532848    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fts9p_1b84c36a-da20-4bd9-9de5-0b0190dd7ebe/manager/0.log"
Jul 20 19:05:28.664019 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:28.663993    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7mb72_795e01de-1725-44d9-bd3a-669dd10cff70/server/0.log"
Jul 20 19:05:28.777000 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:28.776964    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qspx4_228222fc-d919-4648-967d-135b37842334/manager/0.log"
Jul 20 19:05:28.961932 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:28.961890    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fdd66b9b-sqdk5_f141b0ac-2466-4713-adcb-034bfa224f12/manager/0.log"
Jul 20 19:05:28.980052 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:28.980010    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fdd66b9b-sqdk5_f141b0ac-2466-4713-adcb-034bfa224f12/copy-manifests/0.log"
Jul 20 19:05:30.609553 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:30.609514    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hlfwq_d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e/istio-proxy/0.log"
Jul 20 19:05:30.749949 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:30.749863    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7596f649d-4rxdz_61212374-cc10-4872-8148-0f5353824115/kube-auth-proxy/0.log"
Jul 20 19:05:30.879967 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:30.879938    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6569bb95cd-22j2r_7a86a34c-77fd-4f28-ba1a-a62e9c2c604a/router/0.log"
Jul 20 19:05:32.067517 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:32.067489    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hlfwq_d39a6b5f-cebb-47b8-89e7-0e91ae1fdd7e/istio-proxy/0.log"
Jul 20 19:05:32.200317 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:32.200235    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7596f649d-4rxdz_61212374-cc10-4872-8148-0f5353824115/kube-auth-proxy/0.log"
Jul 20 19:05:32.330303 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:32.330275    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6569bb95cd-22j2r_7a86a34c-77fd-4f28-ba1a-a62e9c2c604a/router/0.log"
Jul 20 19:05:35.644012 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:35.643984    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-x9t5q_c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d/kube-storage-version-migrator-operator/1.log"
Jul 20 19:05:35.645645 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:35.645622    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-x9t5q_c00f08a4-aa26-4f5f-abd7-68d4c90dfc6d/kube-storage-version-migrator-operator/0.log"
Jul 20 19:05:36.831644 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:36.831617    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n522l_5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5/kube-multus-additional-cni-plugins/0.log"
Jul 20 19:05:36.851610 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:36.851585    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n522l_5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5/egress-router-binary-copy/0.log"
Jul 20 19:05:36.872172 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:36.872144    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n522l_5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5/cni-plugins/0.log"
Jul 20 19:05:36.891898 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:36.891873    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n522l_5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5/bond-cni-plugin/0.log"
Jul 20 19:05:36.914581 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:36.914554    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n522l_5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5/routeoverride-cni/0.log"
Jul 20 19:05:36.935538 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:36.935507    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n522l_5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5/whereabouts-cni-bincopy/0.log"
Jul 20 19:05:36.957534 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:36.957509    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n522l_5b3abdcb-8a3e-445c-a0fe-6c361eeb6bd5/whereabouts-cni/0.log"
Jul 20 19:05:37.171067 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:37.171035    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ghzr4_8c7932b2-8e1c-4ff4-a64e-c78b003647f6/kube-multus/0.log"
Jul 20 19:05:37.271393 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:37.271358    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f5q8s_90c88a42-35a8-411d-9d5e-f0be7b9dacf4/network-metrics-daemon/0.log"
Jul 20 19:05:37.286781 ip-10-0-138-45 kubenswrapper[2560]: I0720 19:05:37.286754    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f5q8s_90c88a42-35a8-411d-9d5e-f0be7b9dacf4/kube-rbac-proxy/0.log"