Jul 24 16:41:14.794304 ip-10-0-140-49 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 16:41:14.794318 ip-10-0-140-49 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 16:41:14.794326 ip-10-0-140-49 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 16:41:14.794625 ip-10-0-140-49 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 16:41:24.799957 ip-10-0-140-49 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 16:41:24.799978 ip-10-0-140-49 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b1e267122e45473f86df39e32ea58c22 --
Jul 24 16:42:58.646924 ip-10-0-140-49 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 16:42:59.065623 ip-10-0-140-49 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:42:59.065623 ip-10-0-140-49 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 16:42:59.065623 ip-10-0-140-49 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:42:59.065623 ip-10-0-140-49 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 16:42:59.065623 ip-10-0-140-49 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:42:59.067614 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.067523    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 16:42:59.074470 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074452    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:42:59.074470 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074469    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:42:59.074470 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074472    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074477    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074481    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074484    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074487    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074490    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074493    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074497    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074501    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074504    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074508    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074520    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074524    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074527    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074531    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074534    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074537    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074541    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:42:59.074591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074545    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074547    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074550    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074553    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074555    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074558    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074561    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074563    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074566    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074568    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074571    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074573    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074577    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074581    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074583    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074587    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074591    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074594    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074597    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:42:59.075006 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074600    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074603    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074606    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074609    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074612    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074615    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074618    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074620    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074623    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074626    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074629    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074631    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074634    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074637    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074639    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074642    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074645    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074647    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074650    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074653    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:42:59.075456 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074655    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074658    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074660    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074664    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074666    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074669    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074672    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074675    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074677    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074681    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074683    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074686    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074688    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074691    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074693    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074696    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074698    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074701    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074703    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074706    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:42:59.075939 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074708    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074711    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074714    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074717    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074719    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074721    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074724    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074727    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074729    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074732    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074735    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074737    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074739    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074742    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074745    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074747    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074750    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074752    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074755    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:42:59.076412 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.074758    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076485    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076492    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076496    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076499    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076503    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076506    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076508    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076528    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076531    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076534    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076537    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076540    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076543    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076546    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076549    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076551    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076555    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076558    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:42:59.076864 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076560    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076563    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076566    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076568    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076570    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076573    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076575    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076578    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076580    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076583    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076585    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076588    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076591    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076595    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076597    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076601    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076604    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076607    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076609    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:42:59.077326 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076612    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076615    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076617    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076620    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076622    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076625    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076627    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076630    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076632    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076635    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076637    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076640    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076643    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076646    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076648    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076651    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076653    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076656    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076658    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076661    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:42:59.077788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076663    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076666    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076668    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076671    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076673    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076676    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076679    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076681    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076684    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076687    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076690    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076692    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076694    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076697    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076700    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076702    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076705    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076707    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076710    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076712    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:42:59.078277 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076715    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076718    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076720    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076722    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076725    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076729    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076731    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076734    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076736    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076739    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076741    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076743    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076746    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076748    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076751    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076753    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076756    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076758    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076761    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076764    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:42:59.079160 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076767    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.076772    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077189    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077195    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077198    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077201    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077204    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077207    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077210    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077212    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077215    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077218    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077220    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077223    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077226    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077229    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077233    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077237    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077240    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:42:59.079873 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077242    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077245    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077247    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077250    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077252    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077256    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077259    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077262    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077265    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077267    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077270    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077272    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077276    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077280    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077284    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077287    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077289    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077292    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077295    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:42:59.080332 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077298    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077301    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077303    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077306    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077309    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077312    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077314    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077317    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077320    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077323    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077326    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077328    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077331    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077334    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077336    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077340    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077342    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077345    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077347    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:42:59.080806 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077350    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077352    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077354    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077357    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077360    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077362    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077365    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077368    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077370    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077373    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077375    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077378    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077380    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077383    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077385    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077388    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077391    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077393    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077395    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077398    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:42:59.081311 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077400    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077403    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077405    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077408    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077410    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077412    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077415    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077418    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077420    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077423    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077426    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077428    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077431    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077433    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077436    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077439    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077441    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077444    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077446    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077449    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:42:59.081801 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077452    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077454    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077457    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.077460    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077547    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077554    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077560    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077565    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077570    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077573    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077577    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077582    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077585    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077588    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077592    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077595    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077598    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077601    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077604    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077608    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077611    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077614    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077618    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077621    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 16:42:59.082280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077624    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077627    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077631    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077634    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077637    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077641    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077644    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077651    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077654    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077657    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077660    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077664    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077668    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077671    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077675    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077678    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077681    2578 flags.go:64] FLAG: --enable-server="true"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077684    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077688    2578 flags.go:64] FLAG: --event-burst="100"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077691    2578 flags.go:64] FLAG: --event-qps="50"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077694    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077697    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077700    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077704    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 16:42:59.082896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077707    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077710    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077713    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077716    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077720    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077723    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077727    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077730    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077733    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077739    2578 flags.go:64] FLAG: --feature-gates=""
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077743    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077746    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077749    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077752    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077755    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077760    2578 flags.go:64] FLAG: --help="false"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077763    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077766    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077769    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077772    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077776    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077780    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077782    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 16:42:59.083463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077785    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077789    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077792    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077795    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077798    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077802    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077805    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077808    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077811    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077813    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077816    2578 flags.go:64] FLAG: --lock-file=""
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077819    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077822    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077825    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077831    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077834    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077837    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077840    2578 flags.go:64] FLAG: --logging-format="text"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077844    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077848    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077851    2578 flags.go:64] FLAG: --manifest-url=""
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077854    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077858    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077861    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077866    2578 flags.go:64] FLAG: --max-pods="110"
Jul 24 16:42:59.084062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077869    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077872    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077874    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077877    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077880    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077883    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077887    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077893    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077897    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077900    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077903    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077906    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077911    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077914    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077917    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077921    2578 flags.go:64] FLAG: --port="10250"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077924    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077927    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-049bdd476ba9fdb65"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077930    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077933    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077936    2578 flags.go:64] FLAG: --register-node="true"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077939    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077943    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077946    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 24 16:42:59.084669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077949    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077952    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077957    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077960    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077963    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077966    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077969    2578 flags.go:64] FLAG: --runonce="false"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077973    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077976    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077979    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077982    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077985    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077988    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077991    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077995    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.077998    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078001    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078004    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078007    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078010    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078013    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078016    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078021    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078024    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078027    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 16:42:59.085262 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078030    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078033    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078036    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078039    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078042    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078045    2578 flags.go:64] FLAG: --v="2"
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078050    2578 flags.go:64] FLAG: --version="false"
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078054    2578 flags.go:64] FLAG: --vmodule=""
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078057    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.078062    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078466    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078489    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078494    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078499    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078506    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078523    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078529    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078533    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078538    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078548    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078554    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:42:59.085918 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078560    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078566    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078571    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078575    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078580    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078584    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078588    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078593    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078597    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078602    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078611    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078615    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078619    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078623    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078628    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078632    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078636    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078641    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078646    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078651    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:42:59.086495 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078660    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078667    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078677    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078682    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078687    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078695    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078700    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078704    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078708    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078713    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078717    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078722    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078726    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078730    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078734    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078743    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078747    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078752    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078756    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078760    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:42:59.087341 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078764    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078768    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078772    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078776    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078780    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078785    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078789    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078798    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078802    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078806    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078811    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078816    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078821    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078825    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078829    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078833    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078839    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078846    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078851    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078856    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:42:59.088199 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078865    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078870    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078876    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078880    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078885    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078889    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078893    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078897    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078902    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078906    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078910    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078915    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078923    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078928    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078932    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078936    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078940    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078945    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078949    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078953    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:42:59.088930 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078957    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078961    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078966    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078970    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.078976    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.079018    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.079024    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.079029    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.080650    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.088655    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 16:42:59.089416 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.088675    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.089663    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.089679    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089766    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089774    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089779    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089784    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089789    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089796    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089802    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089807    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089812    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089817    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089821    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089827    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089833    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089837    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089842    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089846    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:42:59.089944 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089851    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089855    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089860    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089867    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089873    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089878    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089882    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089887    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089891    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089895    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089900    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089904    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089908    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089913    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089917    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089922    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089927    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089931    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089935    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089939    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:42:59.090763 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089944    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089948    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089952    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089956    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089961    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089965    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089970    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089974    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089979    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089983    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089987    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089992    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.089996    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090000    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090005    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090009    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090013    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090018    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090022    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090026    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:42:59.091424 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090031    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090035    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090039    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090043    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090048    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090053    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090058    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090063    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090067    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090071    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090076    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090080    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090084    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090088    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090092    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090096    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090101    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090105    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090109    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:42:59.091998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090114    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090118    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090123    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090127    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090132    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090136    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090140    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090146    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090150    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090155    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090159    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090163    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090167    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090172    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090177    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090182    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090186    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090190    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090194    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090199    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:42:59.092779 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090206    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090212    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090216    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090222    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.090230    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090413    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090423    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090428    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090432    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090437    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090442    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090446    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090451    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090455    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090460    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:42:59.093688 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090464    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090468    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090472    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090476    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090480    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090485    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090490    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090494    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090498    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090503    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090507    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090527    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090532    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090536    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090540    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090544    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090549    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090554    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090558    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090562    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:42:59.094107 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090566    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090571    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090575    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090579    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090585    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090592    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090597    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090601    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090605    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090610    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090614    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090619    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090623    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090627    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090632    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090636    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090640    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090644    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090649    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:42:59.094686 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090653    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090658    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090662    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090666    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090670    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090674    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090679    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090683    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090687    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090693    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090697    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090701    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090706    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090710    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090714    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090719    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090723    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090727    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090732    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090736    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:42:59.095166 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090740    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090744    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090749    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090753    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090757    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090761    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090765    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090769    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090773    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090777    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090781    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090788    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090794    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090800    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090805    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090810    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090814    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090819    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090823    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:42:59.095671 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090827    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090831    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090836    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090840    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090845    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090849    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090853    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090858    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090862    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090868    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:42:59.090873    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.090882    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.091056    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.094108    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 16:42:59.096181 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.095878    2578 server.go:1019] "Starting client certificate rotation"
Jul 24 16:42:59.096552 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.095985    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 16:42:59.096920 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.096900    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 16:42:59.098979 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.098963    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 16:42:59.100216 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.100197    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 16:42:59.114321 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.114303    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 24 16:42:59.117117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.117009    2578 log.go:25] "Validated CRI v1 image API"
Jul 24 16:42:59.118450 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.118435    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 16:42:59.120988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.120963    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8839f384-c91f-4d0b-ba7b-82ba45272b99:/dev/nvme0n1p3 cec145ae-12e9-473f-9771-a81fad0a132e:/dev/nvme0n1p4]
Jul 24 16:42:59.121072 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.120982    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 16:42:59.127086 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.127066    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 16:42:59.128444 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.128330    2578 manager.go:216] Machine: {Timestamp:2026-07-24 16:42:59.126745825 +0000 UTC m=+0.357493264 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098872 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21b3f3ecd7ebf06ca13de47cf3b08a SystemUUID:ec21b3f3-ecd7-ebf0-6ca1-3de47cf3b08a BootID:b1e26712-2e45-473f-86df-39e32ea58c22 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6d:01:97:88:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6d:01:97:88:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:51:34:99:84:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 16:42:59.128444 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.128443    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 16:42:59.128578 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.128552    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 16:42:59.131747 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.131721    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 16:42:59.131883 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.131749    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 16:42:59.132603 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.132593    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 16:42:59.132636 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.132606    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 16:42:59.132636 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.132613    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 16:42:59.133366 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.133356    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 16:42:59.134464 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.134453    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 16:42:59.136578 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.136568    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 16:42:59.136688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.136679    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 16:42:59.136720 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.136709    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 16:42:59.136720 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.136719    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 16:42:59.136775 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.136730    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 16:42:59.136775 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.136740    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 24 16:42:59.136775 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.136749    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 16:42:59.137161 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.137149    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 16:42:59.137196 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.137171    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 16:42:59.139610 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.139596    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 16:42:59.142007 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.141993    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 16:42:59.142068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.142025    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 16:42:59.143916 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143904    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 16:42:59.143962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143922    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 16:42:59.143962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143931    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 16:42:59.143962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143940    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 16:42:59.143962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143951    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 16:42:59.143962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143957    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 16:42:59.144105 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143966    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 16:42:59.144105 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143971    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 16:42:59.144105 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143978    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 16:42:59.144105 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.143983    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 16:42:59.144105 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.144001    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 16:42:59.144105 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.144008    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 16:42:59.144902 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.144889    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 16:42:59.144950 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.144903    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 16:42:59.145850 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.145826    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 16:42:59.147071 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.147050    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rjlmf"
Jul 24 16:42:59.148208 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.148196    2578 server.go:1268] "Started kubelet"
Jul 24 16:42:59.148326 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.148277    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 16:42:59.148383 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.148346    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 16:42:59.148432 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.148300    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 16:42:59.149105 ip-10-0-140-49 systemd[1]: Started Kubernetes Kubelet.
Jul 24 16:42:59.150648 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.150629    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 16:42:59.152329 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.152303    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 16:42:59.154052 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.154031    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rjlmf"
Jul 24 16:42:59.154706 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.154688    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 16:42:59.155968 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.155950    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 16:42:59.156040 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.156007    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 16:42:59.156939 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.155904    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-49.ec2.internal.18c5477145ade4b9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-49.ec2.internal,UID:ip-10-0-140-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-49.ec2.internal,},FirstTimestamp:2026-07-24 16:42:59.148170425 +0000 UTC m=+0.378917844,LastTimestamp:2026-07-24 16:42:59.148170425 +0000 UTC m=+0.378917844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-49.ec2.internal,}"
Jul 24 16:42:59.163630 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.163610    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 16:42:59.163719 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.163625    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 16:42:59.163719 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.163690    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.164358 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164341    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 16:42:59.164358 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164344    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 16:42:59.164487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164368    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 16:42:59.164548 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164488    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 16:42:59.164548 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164496    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 16:42:59.164680 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164665    2578 factory.go:153] Registering CRI-O factory
Jul 24 16:42:59.164742 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164685    2578 factory.go:223] Registration of the crio container factory successfully
Jul 24 16:42:59.164742 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164739    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 16:42:59.164840 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164750    2578 factory.go:55] Registering systemd factory
Jul 24 16:42:59.164840 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164758    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 24 16:42:59.164840 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164777    2578 factory.go:103] Registering Raw factory
Jul 24 16:42:59.164840 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.164790    2578 manager.go:1196] Started watching for new ooms in manager
Jul 24 16:42:59.165259 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.165236    2578 manager.go:349] Starting recovery of all containers
Jul 24 16:42:59.165566 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.165504    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 16:42:59.165724 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.165702    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 16:42:59.177264 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.177243    2578 manager.go:354] Recovery completed
Jul 24 16:42:59.181389 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.181376    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:42:59.183245 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.183230    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:42:59.183303 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.183258    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:42:59.183303 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.183272    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:42:59.183952 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.183939    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 16:42:59.183952 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.183952    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 16:42:59.184068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.183954    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:42:59.184068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.183970    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 16:42:59.184746 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.184730    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:42:59.184826 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.184761    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:42:59.184826 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.184777    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:42:59.185742 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.185729    2578 policy_none.go:49] "None policy: Start"
Jul 24 16:42:59.185803 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.185745    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 16:42:59.185803 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.185755    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 16:42:59.186847 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.186834    2578 policy_none.go:47] "Start"
Jul 24 16:42:59.225864 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.225850    2578 manager.go:337] "Starting Device Plugin manager"
Jul 24 16:42:59.225953 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.225882    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 16:42:59.225953 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.225892    2578 server.go:87] "Starting device plugin registration server"
Jul 24 16:42:59.226174 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.226160    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 16:42:59.226258 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.226174    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 16:42:59.226311 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.226273    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 16:42:59.226379 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.226361    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 16:42:59.226379 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.226374    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 16:42:59.227052 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.227035    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 16:42:59.227145 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.227085    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.303146 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.302943    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 16:42:59.304358 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.304327    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 16:42:59.304448 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.304381    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 16:42:59.304448 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.304412    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 16:42:59.304543 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.304456    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 16:42:59.306672 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.306655    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:42:59.327320 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.327265    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:42:59.328129 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.328113    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:42:59.328224 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.328142    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:42:59.328224 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.328152    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:42:59.328224 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.328185    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.336418 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.336397    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.336477 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.336424    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-49.ec2.internal\": node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.348986 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.348967    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.404862 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.404827    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal"]
Jul 24 16:42:59.404964 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.404902    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:42:59.406462 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.406444    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:42:59.406563 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.406473    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:42:59.406563 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.406483    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:42:59.407891 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.407879    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:42:59.408018 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.408001    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.408075 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.408037    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:42:59.408584 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.408569    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:42:59.408656 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.408600    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:42:59.408656 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.408610    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:42:59.408656 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.408571    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:42:59.408791 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.408682    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:42:59.408791 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.408699    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:42:59.409680 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.409664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.409743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.409687    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:42:59.410472 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.410451    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:42:59.410579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.410481    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:42:59.410579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.410494    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:42:59.429123 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.429102    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-49.ec2.internal\" not found" node="ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.433502 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.433481    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-49.ec2.internal\" not found" node="ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.449568 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.449542    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.465878 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.465852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/418f3e7bd9d510356b8c098e327d965d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"418f3e7bd9d510356b8c098e327d965d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.465949 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.465884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/418f3e7bd9d510356b8c098e327d965d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"418f3e7bd9d510356b8c098e327d965d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.465949 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.465902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b004fc47afd78b18f63d790c34fead7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-49.ec2.internal\" (UID: \"8b004fc47afd78b18f63d790c34fead7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.550316 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.550282    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.566659 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.566633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/418f3e7bd9d510356b8c098e327d965d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"418f3e7bd9d510356b8c098e327d965d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.566760 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.566665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/418f3e7bd9d510356b8c098e327d965d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"418f3e7bd9d510356b8c098e327d965d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.566760 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.566684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b004fc47afd78b18f63d790c34fead7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-49.ec2.internal\" (UID: \"8b004fc47afd78b18f63d790c34fead7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.566760 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.566736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/418f3e7bd9d510356b8c098e327d965d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"418f3e7bd9d510356b8c098e327d965d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.566873 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.566758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/418f3e7bd9d510356b8c098e327d965d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"418f3e7bd9d510356b8c098e327d965d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.566873 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.566805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b004fc47afd78b18f63d790c34fead7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-49.ec2.internal\" (UID: \"8b004fc47afd78b18f63d790c34fead7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.651096 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.651020    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.731611 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.731580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.737359 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:42:59.737335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal"
Jul 24 16:42:59.751300 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.751278    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.851812 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.851774    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:42:59.952370 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:42:59.952308    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:43:00.052913 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:00.052877    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:43:00.095434 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.095402    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 16:43:00.095877 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.095611    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 16:43:00.153888 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:00.153853    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:43:00.161671 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.161626    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 16:37:59 +0000 UTC" deadline="2028-01-29 11:08:34.722821612 +0000 UTC"
Jul 24 16:43:00.161671 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.161667    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13290h25m34.561156846s"
Jul 24 16:43:00.235845 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.235780    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:43:00.254068 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:00.254035    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found"
Jul 24 16:43:00.334595 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.334563    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:43:00.362144 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:00.362103    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418f3e7bd9d510356b8c098e327d965d.slice/crio-ee29299c4d1851d6c7da522db49fd3766af0d60257bd3e9233a575b7198eefd6 WatchSource:0}: Error finding container ee29299c4d1851d6c7da522db49fd3766af0d60257bd3e9233a575b7198eefd6: Status 404 returned error can't find the container with id ee29299c4d1851d6c7da522db49fd3766af0d60257bd3e9233a575b7198eefd6
Jul 24 16:43:00.362640 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:00.362619    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b004fc47afd78b18f63d790c34fead7.slice/crio-9f04d2d3b6f7e29f9d6da346da5bdb487810db184fab230987404e4d4196d601 WatchSource:0}: Error finding container 9f04d2d3b6f7e29f9d6da346da5bdb487810db184fab230987404e4d4196d601: Status 404 returned error can't find the container with id 9f04d2d3b6f7e29f9d6da346da5bdb487810db184fab230987404e4d4196d601
Jul 24 16:43:00.364830 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.364807    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal"
Jul 24 16:43:00.367148 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.367131    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:43:00.376484 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.376465    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 16:43:00.377548 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.377530    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal"
Jul 24 16:43:00.386380 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.386361    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 16:43:00.426948 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.426891    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:43:00.916320 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:00.916166    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:43:01.138564 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.138513    2578 apiserver.go:52] "Watching apiserver"
Jul 24 16:43:01.146362 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.146334    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 16:43:01.146851 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.146824    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-w89jr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7","openshift-cluster-node-tuning-operator/tuned-bdmjd","openshift-dns/node-resolver-tggvf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal","openshift-network-diagnostics/network-check-target-s5dl4","openshift-ovn-kubernetes/ovnkube-node-ts428","kube-system/konnectivity-agent-f2p82","kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal","openshift-image-registry/node-ca-rhnfd","openshift-multus/multus-9xgkp","openshift-multus/multus-additional-cni-plugins-k2b7k","openshift-multus/network-metrics-daemon-7hnmb","openshift-network-operator/iptables-alerter-l5mjr"]
Jul 24 16:43:01.148524 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.148502    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.150113 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.150091    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.151477 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.151455    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 16:43:01.151580 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.151483    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 16:43:01.151580 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.151542    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 16:43:01.151775 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.151486    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 16:43:01.151870 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.151849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.151927 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.151901    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cxqsg\""
Jul 24 16:43:01.153193 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.152473    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 16:43:01.153193 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.152491    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 16:43:01.153193 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.152724    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 16:43:01.153193 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.152765    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w9gzx\""
Jul 24 16:43:01.153193 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.152845    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 16:43:01.153193 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.152934    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 16:43:01.153193 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.153012    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 16:43:01.153664 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.153648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.153845 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.153824    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:43:01.155511 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.155488    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7sk2c\""
Jul 24 16:43:01.155887 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.155869    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 16:43:01.157213 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.156873    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 16:43:01.157213 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.157089    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 16:43:01.157213 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.157145    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.157434 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.157214    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v4j7c\""
Jul 24 16:43:01.158469 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.157864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:01.158469 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.158055    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:01.159960 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.159936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 16:43:01.160088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.159987    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:43:01.160088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.160021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:01.160204 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.160188    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 16:43:01.160358 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.160336    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wcpjh\""
Jul 24 16:43:01.161951 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.161931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:01.162033 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.161999    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:01.163111 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.163087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.163204 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.163150    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 16:43:01.163516 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.163487    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2s7z6\""
Jul 24 16:43:01.163658 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.163540    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 16:43:01.164008 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.163989    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 16:43:01.164323 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.164306    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.165481 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.165459    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 16:43:01.165759 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.165742    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 16:43:01.166043 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.166026    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jshsg\""
Jul 24 16:43:01.166194 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.166172    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 16:43:01.166386 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.166336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.166570 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.166549    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 16:43:01.166673 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.166567    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:01.166742 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.166717    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 16:43:01.166844 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.166803    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 16:43:01.166919 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.166905    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dp5dv\""
Jul 24 16:43:01.168205 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.168187    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.170351 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.170333    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 16:43:01.170448 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.170357    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 16:43:01.170657 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.170637    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7nlsp\""
Jul 24 16:43:01.177808 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.177782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-slash\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.178013 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.177825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-node-log\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.178013 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.177852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.178013 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.177876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-cni-multus\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.178013 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.177930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.178013 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.177969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-device-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.178013 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-etc-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysctl-d\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-866mx\" (UniqueName: \"kubernetes.io/projected/de21ceda-8e95-4e2a-b1f9-d65644d446b3-kube-api-access-866mx\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-var-lib-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-cni-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-k8s-cni-cncf-io\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-modprobe-d\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-run\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-host\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmcd4\" (UniqueName: \"kubernetes.io/projected/75731df3-1454-4bf7-9d07-c723e254ab2a-kube-api-access-xmcd4\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15c1cac3-bcf8-425d-ab0f-73f44a36a086-konnectivity-ca\") pod \"konnectivity-agent-f2p82\" (UID: \"15c1cac3-bcf8-425d-ab0f-73f44a36a086\") " pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-systemd-units\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-system-cni-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.178365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-conf-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-var-lib-kubelet\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/786817fb-0587-4df5-8701-70739b2cdeb8-etc-tuned\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxjck\" (UniqueName: \"kubernetes.io/projected/7a9f9dea-473a-4c3d-9770-674126db8b69-kube-api-access-dxjck\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdr44\" (UniqueName: \"kubernetes.io/projected/8c25af09-e3b9-483c-b930-8debec737c4f-kube-api-access-gdr44\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-run-netns\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-kubelet\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysctl-conf\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75731df3-1454-4bf7-9d07-c723e254ab2a-hosts-file\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-multus-certs\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/de21ceda-8e95-4e2a-b1f9-d65644d446b3-iptables-alerter-script\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65spr\" (UniqueName: \"kubernetes.io/projected/ac8cc553-3f45-462c-9184-acdb379cca65-kube-api-access-65spr\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-socket-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-cnibin\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.178974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786817fb-0587-4df5-8701-70739b2cdeb8-tmp\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.179251 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-sys-fs\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f0358d9b-a9df-4167-9e29-ee86088fde7f-dbus\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-cni-bin\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-os-release\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-netns\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-daemon-config\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-etc-selinux\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-kubelet\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-cni-netd\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-kubernetes\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f0358d9b-a9df-4167-9e29-ee86088fde7f-kubelet-config\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-hostroot\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-systemd\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-ovn\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-ovnkube-config\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac8cc553-3f45-462c-9184-acdb379cca65-ovn-node-metrics-cert\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.180117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-ovnkube-script-lib\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mmd\" (UniqueName: \"kubernetes.io/projected/6eb17e8b-69ba-457f-b91d-d4167f7833e4-kube-api-access-42mmd\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75731df3-1454-4bf7-9d07-c723e254ab2a-tmp-dir\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de21ceda-8e95-4e2a-b1f9-d65644d446b3-host-slash\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-run-ovn-kubernetes\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-etc-kubernetes\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-lib-modules\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hhx2\" (UniqueName: \"kubernetes.io/projected/786817fb-0587-4df5-8701-70739b2cdeb8-kube-api-access-2hhx2\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjtrr\" (UniqueName: \"kubernetes.io/projected/11d172de-f697-437c-bde7-fe358237ca92-kube-api-access-xjtrr\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-log-socket\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-env-overrides\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.179997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-cni-bin\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180022    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-systemd\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11d172de-f697-437c-bde7-fe358237ca92-host\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-socket-dir-parent\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-sys\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.181122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-registration-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.182209 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:01.182209 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11d172de-f697-437c-bde7-fe358237ca92-serviceca\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.182209 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6eb17e8b-69ba-457f-b91d-d4167f7833e4-cni-binary-copy\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.182209 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysconfig\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.182209 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.180357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15c1cac3-bcf8-425d-ab0f-73f44a36a086-agent-certs\") pod \"konnectivity-agent-f2p82\" (UID: \"15c1cac3-bcf8-425d-ab0f-73f44a36a086\") " pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:01.182209 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.181269    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 16:43:01.202475 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.202431    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fnz7v"
Jul 24 16:43:01.211617 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.211075    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fnz7v"
Jul 24 16:43:01.265095 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.265068    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 16:43:01.280815 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.280783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6eb17e8b-69ba-457f-b91d-d4167f7833e4-cni-binary-copy\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.280988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.280824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysconfig\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.280988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.280848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15c1cac3-bcf8-425d-ab0f-73f44a36a086-agent-certs\") pod \"konnectivity-agent-f2p82\" (UID: \"15c1cac3-bcf8-425d-ab0f-73f44a36a086\") " pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:01.280988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.280876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-os-release\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.280988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.280903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.280988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.280928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-slash\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.280988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.280951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-node-log\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.280988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.280978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-cni-multus\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-node-log\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysconfig\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-slash\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-cni-multus\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-device-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-etc-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysctl-d\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281196    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-etc-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-866mx\" (UniqueName: \"kubernetes.io/projected/de21ceda-8e95-4e2a-b1f9-d65644d446b3-kube-api-access-866mx\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-device-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-var-lib-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-var-lib-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.281341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-cni-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-k8s-cni-cncf-io\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysctl-d\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-k8s-cni-cncf-io\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-modprobe-d\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281452    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-run\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-host\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6eb17e8b-69ba-457f-b91d-d4167f7833e4-cni-binary-copy\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmcd4\" (UniqueName: \"kubernetes.io/projected/75731df3-1454-4bf7-9d07-c723e254ab2a-kube-api-access-xmcd4\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-cni-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-modprobe-d\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-run\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15c1cac3-bcf8-425d-ab0f-73f44a36a086-konnectivity-ca\") pod \"konnectivity-agent-f2p82\" (UID: \"15c1cac3-bcf8-425d-ab0f-73f44a36a086\") " pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-systemd-units\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-system-cni-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-conf-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-var-lib-kubelet\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/786817fb-0587-4df5-8701-70739b2cdeb8-etc-tuned\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281792    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-systemd-units\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281806    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-conf-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-system-cni-dir\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxjck\" (UniqueName: \"kubernetes.io/projected/7a9f9dea-473a-4c3d-9770-674126db8b69-kube-api-access-dxjck\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-host\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281955    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-var-lib-kubelet\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.281986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdr44\" (UniqueName: \"kubernetes.io/projected/8c25af09-e3b9-483c-b930-8debec737c4f-kube-api-access-gdr44\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-run-netns\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-kubelet\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-run-netns\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-openvswitch\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-kubelet\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysctl-conf\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75731df3-1454-4bf7-9d07-c723e254ab2a-hosts-file\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.282930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-multus-certs\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/de21ceda-8e95-4e2a-b1f9-d65644d446b3-iptables-alerter-script\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75731df3-1454-4bf7-9d07-c723e254ab2a-hosts-file\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65spr\" (UniqueName: \"kubernetes.io/projected/ac8cc553-3f45-462c-9184-acdb379cca65-kube-api-access-65spr\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15c1cac3-bcf8-425d-ab0f-73f44a36a086-konnectivity-ca\") pod \"konnectivity-agent-f2p82\" (UID: \"15c1cac3-bcf8-425d-ab0f-73f44a36a086\") " pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-multus-certs\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-sysctl-conf\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-socket-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-cnibin\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786817fb-0587-4df5-8701-70739b2cdeb8-tmp\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-sys-fs\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btjxb\" (UniqueName: \"kubernetes.io/projected/adf8e722-11a5-401d-903d-7e96260a2dc3-kube-api-access-btjxb\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-socket-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f0358d9b-a9df-4167-9e29-ee86088fde7f-dbus\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-cnibin\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.283848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-cni-bin\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-sys-fs\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-os-release\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-netns\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f0358d9b-a9df-4167-9e29-ee86088fde7f-dbus\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-daemon-config\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-etc-selinux\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-kubelet\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-cni-netd\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-kubernetes\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f0358d9b-a9df-4167-9e29-ee86088fde7f-kubelet-config\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.282824    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-hostroot\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-systemd\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-ovn\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/de21ceda-8e95-4e2a-b1f9-d65644d446b3-iptables-alerter-script\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.282945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-ovnkube-config\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-cni-bin\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.284743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-cni-netd\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-kubelet\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-run-netns\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-kubernetes\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-etc-selinux\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.283285    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:01.783260012 +0000 UTC m=+3.014007433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac8cc553-3f45-462c-9184-acdb379cca65-ovn-node-metrics-cert\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-ovnkube-script-lib\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42mmd\" (UniqueName: \"kubernetes.io/projected/6eb17e8b-69ba-457f-b91d-d4167f7833e4-kube-api-access-42mmd\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75731df3-1454-4bf7-9d07-c723e254ab2a-tmp-dir\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de21ceda-8e95-4e2a-b1f9-d65644d446b3-host-slash\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-run-ovn-kubernetes\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-etc-kubernetes\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-lib-modules\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hhx2\" (UniqueName: \"kubernetes.io/projected/786817fb-0587-4df5-8701-70739b2cdeb8-kube-api-access-2hhx2\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-cnibin\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-daemon-config\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.286149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjtrr\" (UniqueName: \"kubernetes.io/projected/11d172de-f697-437c-bde7-fe358237ca92-kube-api-access-xjtrr\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f0358d9b-a9df-4167-9e29-ee86088fde7f-kubelet-config\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283653    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-ovn\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-os-release\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-log-socket\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-run-systemd\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-env-overrides\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-cni-bin\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-systemd\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-host-var-lib-cni-bin\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11d172de-f697-437c-bde7-fe358237ca92-host\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11d172de-f697-437c-bde7-fe358237ca92-host\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-socket-dir-parent\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283988    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-etc-systemd\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-sys\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.283836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-ovnkube-config\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.287346 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-registration-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-log-socket\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-system-cni-dir\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-hostroot\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11d172de-f697-437c-bde7-fe358237ca92-serviceca\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-sys\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-env-overrides\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.284220    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-multus-socket-dir-parent\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8cc553-3f45-462c-9184-acdb379cca65-host-run-ovn-kubernetes\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.284284    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret podName:f0358d9b-a9df-4167-9e29-ee86088fde7f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:01.78426628 +0000 UTC m=+3.015013695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret") pod "global-pull-secret-syncer-w89jr" (UID: "f0358d9b-a9df-4167-9e29-ee86088fde7f") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75731df3-1454-4bf7-9d07-c723e254ab2a-tmp-dir\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11d172de-f697-437c-bde7-fe358237ca92-serviceca\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a9f9dea-473a-4c3d-9770-674126db8b69-registration-dir\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac8cc553-3f45-462c-9184-acdb379cca65-ovnkube-script-lib\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de21ceda-8e95-4e2a-b1f9-d65644d446b3-host-slash\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.289138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.284966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6eb17e8b-69ba-457f-b91d-d4167f7833e4-etc-kubernetes\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.290688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.285050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786817fb-0587-4df5-8701-70739b2cdeb8-lib-modules\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.290688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.286034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/786817fb-0587-4df5-8701-70739b2cdeb8-etc-tuned\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.290688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.286269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac8cc553-3f45-462c-9184-acdb379cca65-ovn-node-metrics-cert\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.290688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.286999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786817fb-0587-4df5-8701-70739b2cdeb8-tmp\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.290688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.287900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15c1cac3-bcf8-425d-ab0f-73f44a36a086-agent-certs\") pod \"konnectivity-agent-f2p82\" (UID: \"15c1cac3-bcf8-425d-ab0f-73f44a36a086\") " pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:01.296473 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.296446    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:43:01.296613 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.296478    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:43:01.296613 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.296492    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7pf6z for pod openshift-network-diagnostics/network-check-target-s5dl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:01.296613 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.296552    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z podName:77b687ab-5a67-489f-9d90-ef5726e75c35 nodeName:}" failed. No retries permitted until 2026-07-24 16:43:01.796533813 +0000 UTC m=+3.027281238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7pf6z" (UniqueName: "kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z") pod "network-check-target-s5dl4" (UID: "77b687ab-5a67-489f-9d90-ef5726e75c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:01.298541 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.298405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdr44\" (UniqueName: \"kubernetes.io/projected/8c25af09-e3b9-483c-b930-8debec737c4f-kube-api-access-gdr44\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:01.298541 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.298418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-866mx\" (UniqueName: \"kubernetes.io/projected/de21ceda-8e95-4e2a-b1f9-d65644d446b3-kube-api-access-866mx\") pod \"iptables-alerter-l5mjr\" (UID: \"de21ceda-8e95-4e2a-b1f9-d65644d446b3\") " pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.299796 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.299699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxjck\" (UniqueName: \"kubernetes.io/projected/7a9f9dea-473a-4c3d-9770-674126db8b69-kube-api-access-dxjck\") pod \"aws-ebs-csi-driver-node-v68p7\" (UID: \"7a9f9dea-473a-4c3d-9770-674126db8b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.300003 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.299959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmcd4\" (UniqueName: \"kubernetes.io/projected/75731df3-1454-4bf7-9d07-c723e254ab2a-kube-api-access-xmcd4\") pod \"node-resolver-tggvf\" (UID: \"75731df3-1454-4bf7-9d07-c723e254ab2a\") " pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.300149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.300131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65spr\" (UniqueName: \"kubernetes.io/projected/ac8cc553-3f45-462c-9184-acdb379cca65-kube-api-access-65spr\") pod \"ovnkube-node-ts428\" (UID: \"ac8cc553-3f45-462c-9184-acdb379cca65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.300657 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.300618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjtrr\" (UniqueName: \"kubernetes.io/projected/11d172de-f697-437c-bde7-fe358237ca92-kube-api-access-xjtrr\") pod \"node-ca-rhnfd\" (UID: \"11d172de-f697-437c-bde7-fe358237ca92\") " pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.301031 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.300984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mmd\" (UniqueName: \"kubernetes.io/projected/6eb17e8b-69ba-457f-b91d-d4167f7833e4-kube-api-access-42mmd\") pod \"multus-9xgkp\" (UID: \"6eb17e8b-69ba-457f-b91d-d4167f7833e4\") " pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.301879 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.301856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hhx2\" (UniqueName: \"kubernetes.io/projected/786817fb-0587-4df5-8701-70739b2cdeb8-kube-api-access-2hhx2\") pod \"tuned-bdmjd\" (UID: \"786817fb-0587-4df5-8701-70739b2cdeb8\") " pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.311692 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.311624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" event={"ID":"418f3e7bd9d510356b8c098e327d965d","Type":"ContainerStarted","Data":"ee29299c4d1851d6c7da522db49fd3766af0d60257bd3e9233a575b7198eefd6"}
Jul 24 16:43:01.313200 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.313170    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" event={"ID":"8b004fc47afd78b18f63d790c34fead7","Type":"ContainerStarted","Data":"9f04d2d3b6f7e29f9d6da346da5bdb487810db184fab230987404e4d4196d601"}
Jul 24 16:43:01.385169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385169 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btjxb\" (UniqueName: \"kubernetes.io/projected/adf8e722-11a5-401d-903d-7e96260a2dc3-kube-api-access-btjxb\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385402 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-cnibin\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385402 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385402 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-cnibin\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-system-cni-dir\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-system-cni-dir\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-os-release\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385897 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf8e722-11a5-401d-903d-7e96260a2dc3-os-release\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.385897 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.385695    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.386123 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.386101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.386234 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.386209    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf8e722-11a5-401d-903d-7e96260a2dc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.394522 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.394496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btjxb\" (UniqueName: \"kubernetes.io/projected/adf8e722-11a5-401d-903d-7e96260a2dc3-kube-api-access-btjxb\") pod \"multus-additional-cni-plugins-k2b7k\" (UID: \"adf8e722-11a5-401d-903d-7e96260a2dc3\") " pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.467735 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.467636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:01.475532 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.475502    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9xgkp"
Jul 24 16:43:01.485623 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.485592    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bdmjd"
Jul 24 16:43:01.493482 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.493453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tggvf"
Jul 24 16:43:01.502478 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.502451    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5mjr"
Jul 24 16:43:01.510339 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.510316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:01.520313 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.520289    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7"
Jul 24 16:43:01.528219 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.528195    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhnfd"
Jul 24 16:43:01.534851 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.534828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2b7k"
Jul 24 16:43:01.789115 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.789027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:01.789272 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.789122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:01.789272 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.789209    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:01.789272 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.789237    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:01.789410 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.789275    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret podName:f0358d9b-a9df-4167-9e29-ee86088fde7f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:02.789258305 +0000 UTC m=+4.020005712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret") pod "global-pull-secret-syncer-w89jr" (UID: "f0358d9b-a9df-4167-9e29-ee86088fde7f") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:01.789410 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.789292    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:02.789283977 +0000 UTC m=+4.020031384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:01.890069 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:01.890033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:01.890265 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.890206    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:43:01.890265 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.890229    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:43:01.890265 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.890245    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7pf6z for pod openshift-network-diagnostics/network-check-target-s5dl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:01.890443 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:01.890298    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z podName:77b687ab-5a67-489f-9d90-ef5726e75c35 nodeName:}" failed. No retries permitted until 2026-07-24 16:43:02.890282341 +0000 UTC m=+4.121029751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pf6z" (UniqueName: "kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z") pod "network-check-target-s5dl4" (UID: "77b687ab-5a67-489f-9d90-ef5726e75c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:02.214554 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:02.214437    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:38:01 +0000 UTC" deadline="2028-02-27 08:29:50.512036167 +0000 UTC"
Jul 24 16:43:02.214554 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:02.214491    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13983h46m48.297549962s"
Jul 24 16:43:02.394054 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.394027    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75731df3_1454_4bf7_9d07_c723e254ab2a.slice/crio-f7427d8023f4615b7c030e49c59fbbdcbac3b227bef12d9adff73026b8781665 WatchSource:0}: Error finding container f7427d8023f4615b7c030e49c59fbbdcbac3b227bef12d9adff73026b8781665: Status 404 returned error can't find the container with id f7427d8023f4615b7c030e49c59fbbdcbac3b227bef12d9adff73026b8781665
Jul 24 16:43:02.413258 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.413226    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde21ceda_8e95_4e2a_b1f9_d65644d446b3.slice/crio-5b2999b078845d5dfa48e5cb0cca95e2efb76e64949e1541487f17972ebc749d WatchSource:0}: Error finding container 5b2999b078845d5dfa48e5cb0cca95e2efb76e64949e1541487f17972ebc749d: Status 404 returned error can't find the container with id 5b2999b078845d5dfa48e5cb0cca95e2efb76e64949e1541487f17972ebc749d
Jul 24 16:43:02.414273 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.414244    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9f9dea_473a_4c3d_9770_674126db8b69.slice/crio-e0db001c2102a8f4a2bc6f36c825fe275951d8b88eeec8cb1db7386982a0d412 WatchSource:0}: Error finding container e0db001c2102a8f4a2bc6f36c825fe275951d8b88eeec8cb1db7386982a0d412: Status 404 returned error can't find the container with id e0db001c2102a8f4a2bc6f36c825fe275951d8b88eeec8cb1db7386982a0d412
Jul 24 16:43:02.414957 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.414835    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d172de_f697_437c_bde7_fe358237ca92.slice/crio-49c5f46d792cff8d254fb50a004f6dea44d8a6c25d58485c8db1dd5c6ba769dc WatchSource:0}: Error finding container 49c5f46d792cff8d254fb50a004f6dea44d8a6c25d58485c8db1dd5c6ba769dc: Status 404 returned error can't find the container with id 49c5f46d792cff8d254fb50a004f6dea44d8a6c25d58485c8db1dd5c6ba769dc
Jul 24 16:43:02.415659 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.415614    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786817fb_0587_4df5_8701_70739b2cdeb8.slice/crio-b1a156f2f4ecfd86df2ebc573bd5d0ef01e93e5360694f40d6045f117b7934ac WatchSource:0}: Error finding container b1a156f2f4ecfd86df2ebc573bd5d0ef01e93e5360694f40d6045f117b7934ac: Status 404 returned error can't find the container with id b1a156f2f4ecfd86df2ebc573bd5d0ef01e93e5360694f40d6045f117b7934ac
Jul 24 16:43:02.417198 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.417166    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb17e8b_69ba_457f_b91d_d4167f7833e4.slice/crio-1b0a324b96ba227b0b23cf01ebbb54a2b7921b2aebfa22bced316b2c8d9dd408 WatchSource:0}: Error finding container 1b0a324b96ba227b0b23cf01ebbb54a2b7921b2aebfa22bced316b2c8d9dd408: Status 404 returned error can't find the container with id 1b0a324b96ba227b0b23cf01ebbb54a2b7921b2aebfa22bced316b2c8d9dd408
Jul 24 16:43:02.417825 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.417742    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8cc553_3f45_462c_9184_acdb379cca65.slice/crio-c15f772ff1fd333fcd0b0628539eb74f137a9f2530ccee8dbc7c1ac2d2d243b7 WatchSource:0}: Error finding container c15f772ff1fd333fcd0b0628539eb74f137a9f2530ccee8dbc7c1ac2d2d243b7: Status 404 returned error can't find the container with id c15f772ff1fd333fcd0b0628539eb74f137a9f2530ccee8dbc7c1ac2d2d243b7
Jul 24 16:43:02.419998 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.419972    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c1cac3_bcf8_425d_ab0f_73f44a36a086.slice/crio-f7fc39ca41e80a735d5b0d497802026e4458b254dc283124dff7cbfc5b9521aa WatchSource:0}: Error finding container f7fc39ca41e80a735d5b0d497802026e4458b254dc283124dff7cbfc5b9521aa: Status 404 returned error can't find the container with id f7fc39ca41e80a735d5b0d497802026e4458b254dc283124dff7cbfc5b9521aa
Jul 24 16:43:02.420793 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:02.420769    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf8e722_11a5_401d_903d_7e96260a2dc3.slice/crio-51abca4a6de53717672cc260357ffc76523c867bd6b5874faf46f7e9e358a464 WatchSource:0}: Error finding container 51abca4a6de53717672cc260357ffc76523c867bd6b5874faf46f7e9e358a464: Status 404 returned error can't find the container with id 51abca4a6de53717672cc260357ffc76523c867bd6b5874faf46f7e9e358a464
Jul 24 16:43:02.797716 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:02.797355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:02.797716 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:02.797564    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:02.797944 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:02.797789    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:04.797763767 +0000 UTC m=+6.028511178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:02.797944 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:02.797697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:02.797944 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:02.797788    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:02.797944 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:02.797909    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret podName:f0358d9b-a9df-4167-9e29-ee86088fde7f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:04.7978924 +0000 UTC m=+6.028639809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret") pod "global-pull-secret-syncer-w89jr" (UID: "f0358d9b-a9df-4167-9e29-ee86088fde7f") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:02.899899 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:02.899192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:02.899899 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:02.899395    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:43:02.899899 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:02.899417    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:43:02.899899 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:02.899431    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7pf6z for pod openshift-network-diagnostics/network-check-target-s5dl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:02.899899 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:02.899498    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z podName:77b687ab-5a67-489f-9d90-ef5726e75c35 nodeName:}" failed. No retries permitted until 2026-07-24 16:43:04.899475489 +0000 UTC m=+6.130222901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pf6z" (UniqueName: "kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z") pod "network-check-target-s5dl4" (UID: "77b687ab-5a67-489f-9d90-ef5726e75c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:03.215832 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.215701    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:38:01 +0000 UTC" deadline="2027-12-24 21:12:28.413001976 +0000 UTC"
Jul 24 16:43:03.215832 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.215742    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12436h29m25.197265606s"
Jul 24 16:43:03.311872 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.311839    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:03.312095 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:03.312006    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:03.312864 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.312839    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:03.312997 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:03.312960    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:03.313069 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.313037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:03.313159 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:03.313121    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:03.349465 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.349420    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bdmjd" event={"ID":"786817fb-0587-4df5-8701-70739b2cdeb8","Type":"ContainerStarted","Data":"b1a156f2f4ecfd86df2ebc573bd5d0ef01e93e5360694f40d6045f117b7934ac"}
Jul 24 16:43:03.360523 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.360375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhnfd" event={"ID":"11d172de-f697-437c-bde7-fe358237ca92","Type":"ContainerStarted","Data":"49c5f46d792cff8d254fb50a004f6dea44d8a6c25d58485c8db1dd5c6ba769dc"}
Jul 24 16:43:03.394358 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.394311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tggvf" event={"ID":"75731df3-1454-4bf7-9d07-c723e254ab2a","Type":"ContainerStarted","Data":"f7427d8023f4615b7c030e49c59fbbdcbac3b227bef12d9adff73026b8781665"}
Jul 24 16:43:03.408312 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.408271    2578 generic.go:356] "Generic (PLEG): container finished" podID="418f3e7bd9d510356b8c098e327d965d" containerID="8215936efc336b4c674644ea2142bc04fc02306587d7f134db38ffa9fab706c0" exitCode=0
Jul 24 16:43:03.408508 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.408377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" event={"ID":"418f3e7bd9d510356b8c098e327d965d","Type":"ContainerDied","Data":"8215936efc336b4c674644ea2142bc04fc02306587d7f134db38ffa9fab706c0"}
Jul 24 16:43:03.437198 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.437162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" event={"ID":"8b004fc47afd78b18f63d790c34fead7","Type":"ContainerStarted","Data":"c2041a645d2662edb80304817f790af13e31eef05db9a59389264f9c3d5f0857"}
Jul 24 16:43:03.451743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.451523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7" event={"ID":"7a9f9dea-473a-4c3d-9770-674126db8b69","Type":"ContainerStarted","Data":"e0db001c2102a8f4a2bc6f36c825fe275951d8b88eeec8cb1db7386982a0d412"}
Jul 24 16:43:03.457582 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.457542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9xgkp" event={"ID":"6eb17e8b-69ba-457f-b91d-d4167f7833e4","Type":"ContainerStarted","Data":"1b0a324b96ba227b0b23cf01ebbb54a2b7921b2aebfa22bced316b2c8d9dd408"}
Jul 24 16:43:03.472826 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.472749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5mjr" event={"ID":"de21ceda-8e95-4e2a-b1f9-d65644d446b3","Type":"ContainerStarted","Data":"5b2999b078845d5dfa48e5cb0cca95e2efb76e64949e1541487f17972ebc749d"}
Jul 24 16:43:03.480474 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.480404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerStarted","Data":"51abca4a6de53717672cc260357ffc76523c867bd6b5874faf46f7e9e358a464"}
Jul 24 16:43:03.498852 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.498706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f2p82" event={"ID":"15c1cac3-bcf8-425d-ab0f-73f44a36a086","Type":"ContainerStarted","Data":"f7fc39ca41e80a735d5b0d497802026e4458b254dc283124dff7cbfc5b9521aa"}
Jul 24 16:43:03.509083 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:03.509048    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"c15f772ff1fd333fcd0b0628539eb74f137a9f2530ccee8dbc7c1ac2d2d243b7"}
Jul 24 16:43:04.532556 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:04.532520    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" event={"ID":"418f3e7bd9d510356b8c098e327d965d","Type":"ContainerStarted","Data":"61a2a898564dd2799d9a525146e034cf8da3270f2f52ca66f89e1b560b628e05"}
Jul 24 16:43:04.549059 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:04.548995    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" podStartSLOduration=3.548969068 podStartE2EDuration="3.548969068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:03.454076195 +0000 UTC m=+4.684823626" watchObservedRunningTime="2026-07-24 16:43:04.548969068 +0000 UTC m=+5.779716501"
Jul 24 16:43:04.825744 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:04.825655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:04.825744 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:04.825731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:04.825983 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:04.825892    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:04.825983 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:04.825962    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret podName:f0358d9b-a9df-4167-9e29-ee86088fde7f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:08.825940248 +0000 UTC m=+10.056687657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret") pod "global-pull-secret-syncer-w89jr" (UID: "f0358d9b-a9df-4167-9e29-ee86088fde7f") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:04.829543 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:04.826357    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:04.829543 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:04.826415    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:08.826397929 +0000 UTC m=+10.057145354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:04.926818 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:04.926778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:04.927003 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:04.926975    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:43:04.927003 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:04.927001    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:43:04.927110 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:04.927015    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7pf6z for pod openshift-network-diagnostics/network-check-target-s5dl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:04.927110 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:04.927082    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z podName:77b687ab-5a67-489f-9d90-ef5726e75c35 nodeName:}" failed. No retries permitted until 2026-07-24 16:43:08.927062346 +0000 UTC m=+10.157809769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pf6z" (UniqueName: "kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z") pod "network-check-target-s5dl4" (UID: "77b687ab-5a67-489f-9d90-ef5726e75c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:05.308812 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:05.305341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:05.308812 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:05.305489    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:05.308812 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:05.305913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:05.308812 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:05.306002    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:05.308812 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:05.306064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:05.308812 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:05.306151    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:07.306422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:07.305679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:07.306422 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:07.305818    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:07.306422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:07.306259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:07.306422 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:07.306371    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:07.307557 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:07.307176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:07.307557 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:07.307282    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:08.862074 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:08.862034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:08.862602 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:08.862115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:08.862602 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:08.862239    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:08.862602 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:08.862302    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:08.862602 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:08.862325    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:16.862299644 +0000 UTC m=+18.093047073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:08.862602 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:08.862370    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret podName:f0358d9b-a9df-4167-9e29-ee86088fde7f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:16.862349904 +0000 UTC m=+18.093097313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret") pod "global-pull-secret-syncer-w89jr" (UID: "f0358d9b-a9df-4167-9e29-ee86088fde7f") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:08.963023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:08.962896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:08.963268 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:08.963076    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:43:08.963268 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:08.963097    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:43:08.963268 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:08.963110    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7pf6z for pod openshift-network-diagnostics/network-check-target-s5dl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:08.963268 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:08.963174    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z podName:77b687ab-5a67-489f-9d90-ef5726e75c35 nodeName:}" failed. No retries permitted until 2026-07-24 16:43:16.963155182 +0000 UTC m=+18.193902595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pf6z" (UniqueName: "kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z") pod "network-check-target-s5dl4" (UID: "77b687ab-5a67-489f-9d90-ef5726e75c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:09.306113 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:09.306027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:09.306336 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:09.306157    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:09.306526 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:09.306473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:09.306659 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:09.306600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:09.306659 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:09.306616    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:09.306787 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:09.306698    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:11.305368 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:11.305334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:11.305368 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:11.305360    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:11.305899 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:11.305469    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:11.305899 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:11.305568    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:11.305899 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:11.305629    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:11.305899 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:11.305693    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:13.305528 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:13.305490    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:13.306036 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:13.305493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:13.306036 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:13.305609    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:13.306036 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:13.305689    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:13.306036 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:13.305494    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:13.306036 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:13.305786    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:15.305529 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:15.305480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:15.305529 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:15.305480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:15.306047 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:15.305493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:15.306047 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:15.305630    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:15.306047 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:15.305746    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:15.306047 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:15.305845    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:16.928641 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:16.928605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:16.929161 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:16.928666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:16.929161 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:16.928786    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:16.929161 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:16.928789    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:16.929161 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:16.928856    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret podName:f0358d9b-a9df-4167-9e29-ee86088fde7f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:32.928837879 +0000 UTC m=+34.159585286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret") pod "global-pull-secret-syncer-w89jr" (UID: "f0358d9b-a9df-4167-9e29-ee86088fde7f") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:16.929161 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:16.928876    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:43:32.928866185 +0000 UTC m=+34.159613591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:17.029347 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:17.029309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:17.029537 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:17.029498    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:43:17.029627 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:17.029539    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:43:17.029627 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:17.029553    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7pf6z for pod openshift-network-diagnostics/network-check-target-s5dl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:17.029627 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:17.029619    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z podName:77b687ab-5a67-489f-9d90-ef5726e75c35 nodeName:}" failed. No retries permitted until 2026-07-24 16:43:33.029599268 +0000 UTC m=+34.260346709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pf6z" (UniqueName: "kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z") pod "network-check-target-s5dl4" (UID: "77b687ab-5a67-489f-9d90-ef5726e75c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:17.304667 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:17.304639    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:17.304846 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:17.304639    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:17.304846 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:17.304765    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:17.304846 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:17.304647    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:17.304981 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:17.304864    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:17.304981 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:17.304938    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:19.307909 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:19.306626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:19.307909 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:19.307796    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:19.308775 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:19.308738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:19.309026 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:19.308957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:19.309356 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:19.309325    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:19.309489 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:19.309449    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:21.304984 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:21.304951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:21.305447 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:21.304958    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:21.305447 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:21.305079    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:21.305447 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:21.305198    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:21.305447 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:21.305205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:21.305447 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:21.305290    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:22.583682 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.583270    2578 generic.go:356] "Generic (PLEG): container finished" podID="adf8e722-11a5-401d-903d-7e96260a2dc3" containerID="86aa44ec1f821e473003a2e96d6088d4630544851cddb2d6628e5a777761b223" exitCode=0
Jul 24 16:43:22.584704 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.583319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerDied","Data":"86aa44ec1f821e473003a2e96d6088d4630544851cddb2d6628e5a777761b223"}
Jul 24 16:43:22.585712 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.585665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f2p82" event={"ID":"15c1cac3-bcf8-425d-ab0f-73f44a36a086","Type":"ContainerStarted","Data":"d4ae4528022b354258e65788ec7d0303cb860a0060285266f2511cf60219e530"}
Jul 24 16:43:22.589667 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.589637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"84201ad32bc562ab0d606a974d402397784dfd07df86c4baa010d6baca6bea43"}
Jul 24 16:43:22.589784 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.589699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"357199d4f3762823a1e1dddc2235508f5f90279e787b19835cccc9a18d145d39"}
Jul 24 16:43:22.589784 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.589741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"9d14b64fab1880e5a7f3bd21440e80114eadf25e422f72abb4f6eb2b32c79893"}
Jul 24 16:43:22.589880 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.589790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"870475720ed327457bc04267331be86bd4e33c4af90c0215639e1f0a28372521"}
Jul 24 16:43:22.589880 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.589831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"05e19ff406c2983d545b1562747503fe79efe41eb218c69cb754c040aa2558ac"}
Jul 24 16:43:22.589880 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.589864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"021d9b5cdecb9340c61276e72e2b6ff293c11e2be8d6fee7900750cad05170e1"}
Jul 24 16:43:22.591246 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.591221    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bdmjd" event={"ID":"786817fb-0587-4df5-8701-70739b2cdeb8","Type":"ContainerStarted","Data":"a26e1ea2d28e275e52079eeffe72518e7d1762111fc041fe72babfdcc46882c7"}
Jul 24 16:43:22.592862 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.592802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhnfd" event={"ID":"11d172de-f697-437c-bde7-fe358237ca92","Type":"ContainerStarted","Data":"694e9c5cdbedfcd07b270479e03927113681f425ae11b845a8434fe8329d7952"}
Jul 24 16:43:22.594229 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.594204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tggvf" event={"ID":"75731df3-1454-4bf7-9d07-c723e254ab2a","Type":"ContainerStarted","Data":"4e04affd12bcc365b639abf349db789f613f1107a750b306f4f9c34a5e20b6ea"}
Jul 24 16:43:22.595757 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.595734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7" event={"ID":"7a9f9dea-473a-4c3d-9770-674126db8b69","Type":"ContainerStarted","Data":"aea37adb435203591d4762bbc4821b6a9bcb42e1b785a5f2666ae0bf68dc1f0a"}
Jul 24 16:43:22.597385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.597360    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9xgkp" event={"ID":"6eb17e8b-69ba-457f-b91d-d4167f7833e4","Type":"ContainerStarted","Data":"f0df9f890794d8551fe549dec2fe485628148a007307912fe92445318dede5b7"}
Jul 24 16:43:22.604577 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.604503    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" podStartSLOduration=21.60447565 podStartE2EDuration="21.60447565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:04.549762287 +0000 UTC m=+5.780509740" watchObservedRunningTime="2026-07-24 16:43:22.60447565 +0000 UTC m=+23.835223080"
Jul 24 16:43:22.632910 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.632851    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f2p82" podStartSLOduration=11.045911634 podStartE2EDuration="22.632830288s" totalImagesPullingTime="11.586918654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:22.620112518 +0000 UTC m=+23.850859944" watchObservedRunningTime="2026-07-24 16:43:22.632830288 +0000 UTC m=+23.863577716"
Jul 24 16:43:22.633263 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.632957    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rhnfd" podStartSLOduration=3.224851578 podStartE2EDuration="22.632950195s" totalImagesPullingTime="19.408098617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:22.632779635 +0000 UTC m=+23.863527062" watchObservedRunningTime="2026-07-24 16:43:22.632950195 +0000 UTC m=+23.863697622"
Jul 24 16:43:22.663185 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.663139    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9xgkp" podStartSLOduration=3.191393671 podStartE2EDuration="22.663125027s" totalImagesPullingTime="19.471731356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:22.648061913 +0000 UTC m=+23.878809364" watchObservedRunningTime="2026-07-24 16:43:22.663125027 +0000 UTC m=+23.893872454"
Jul 24 16:43:22.675418 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:22.675374    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bdmjd" podStartSLOduration=3.2662194319999998 podStartE2EDuration="22.675358617s" totalImagesPullingTime="19.409139185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:22.662993547 +0000 UTC m=+23.893740975" watchObservedRunningTime="2026-07-24 16:43:22.675358617 +0000 UTC m=+23.906106034"
Jul 24 16:43:23.165993 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.165912    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:23.166666 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.166646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:23.180503 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.180453    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tggvf" podStartSLOduration=3.761951717 podStartE2EDuration="23.180432295s" totalImagesPullingTime="19.418480578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:22.67565602 +0000 UTC m=+23.906403575" watchObservedRunningTime="2026-07-24 16:43:23.180432295 +0000 UTC m=+24.411179713"
Jul 24 16:43:23.304707 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.304680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:23.304851 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.304685    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:23.304851 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:23.304782    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:23.304964 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.304694    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:23.304964 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:23.304896    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:23.305051 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:23.305023    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:23.382935 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.382905    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 16:43:23.602213 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.602183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7" event={"ID":"7a9f9dea-473a-4c3d-9770-674126db8b69","Type":"ContainerStarted","Data":"4d6384438523d6463a7bb2856e63816ef718d0feb2af16019d4830b80b7e076e"}
Jul 24 16:43:23.603812 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.603732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5mjr" event={"ID":"de21ceda-8e95-4e2a-b1f9-d65644d446b3","Type":"ContainerStarted","Data":"eca78a2e14b00e959dc077eb68a9e4b568c990bb801411f468919eb19b6f5fbb"}
Jul 24 16:43:23.604199 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.604116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:23.604696 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.604671    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f2p82"
Jul 24 16:43:23.618279 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:23.618231    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l5mjr" podStartSLOduration=4.208384007 podStartE2EDuration="23.618218462s" totalImagesPullingTime="19.409834455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:23.61783203 +0000 UTC m=+24.848579463" watchObservedRunningTime="2026-07-24 16:43:23.618218462 +0000 UTC m=+24.848965888"
Jul 24 16:43:24.241069 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:24.240892    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T16:43:23.382928954Z","UUID":"b5f9a881-558d-4dc7-9c9a-f50b701ffe36","Handler":null,"Name":"","Endpoint":""}
Jul 24 16:43:24.242506 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:24.242480    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 16:43:24.242637 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:24.242541    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 16:43:24.611055 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:24.611003    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"a0f62c15e23a4c5f609dbce5987ce8d02d7a0fe4d5c0616f4565732a805d62df"}
Jul 24 16:43:25.305668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:25.305402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:25.305850 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:25.305439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:25.305850 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:25.305775    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:25.305948 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:25.305849    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:25.305948 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:25.305478    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:25.305948 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:25.305940    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:25.616040 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:25.615947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7" event={"ID":"7a9f9dea-473a-4c3d-9770-674126db8b69","Type":"ContainerStarted","Data":"a0a7a9cefecbd11fcdb2ccbf6212033331becdc50df51c37f182b4beb3a0c3c2"}
Jul 24 16:43:25.635566 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:25.635496    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v68p7" podStartSLOduration=3.932728352 podStartE2EDuration="25.63548183s" totalImagesPullingTime="21.702753478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:25.63509596 +0000 UTC m=+26.865843388" watchObservedRunningTime="2026-07-24 16:43:25.63548183 +0000 UTC m=+26.866229256"
Jul 24 16:43:27.305680 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.305472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:27.306535 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.305485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:27.306535 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:27.305757    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:27.306535 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.305491    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:27.306535 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:27.305836    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:27.306535 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:27.306158    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:27.624921 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.624825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" event={"ID":"ac8cc553-3f45-462c-9184-acdb379cca65","Type":"ContainerStarted","Data":"bb3aa81c8adb3c59b0e9185b28bcdb3a31c68513e4b552011c666146bab4e03a"}
Jul 24 16:43:27.625149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.625092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:27.625281 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.625166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:27.626841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.626804    2578 generic.go:356] "Generic (PLEG): container finished" podID="adf8e722-11a5-401d-903d-7e96260a2dc3" containerID="62da078880c84897bfbfc1ce2b74dd66a00321ac3ad63edc5407a721c4b76c21" exitCode=0
Jul 24 16:43:27.626937 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.626848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerDied","Data":"62da078880c84897bfbfc1ce2b74dd66a00321ac3ad63edc5407a721c4b76c21"}
Jul 24 16:43:27.641785 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.641760    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:27.652229 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:27.652184    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ts428" podStartSLOduration=8.182025491 podStartE2EDuration="27.652171177s" totalImagesPullingTime="19.470145686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:27.651828418 +0000 UTC m=+28.882575844" watchObservedRunningTime="2026-07-24 16:43:27.652171177 +0000 UTC m=+28.882918603"
Jul 24 16:43:28.630441 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:28.630408    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:28.648719 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:28.648690    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:43:28.871372 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:28.871168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w89jr"]
Jul 24 16:43:28.871372 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:28.871347    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:28.871620 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:28.871457    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:28.871971 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:28.871951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s5dl4"]
Jul 24 16:43:28.872049 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:28.872039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:28.872130 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:28.872114    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:28.873577 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:28.873552    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7hnmb"]
Jul 24 16:43:28.873686 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:28.873666    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:28.873786 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:28.873766    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:29.634257 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:29.634071    2578 generic.go:356] "Generic (PLEG): container finished" podID="adf8e722-11a5-401d-903d-7e96260a2dc3" containerID="cbcac6618f193e781c1f156ee676e5d09fc80dced5bc3a40db96a47b48d27be8" exitCode=0
Jul 24 16:43:29.634771 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:29.634162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerDied","Data":"cbcac6618f193e781c1f156ee676e5d09fc80dced5bc3a40db96a47b48d27be8"}
Jul 24 16:43:30.305170 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:30.305133    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:30.305170 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:30.305164    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:30.305342 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:30.305287    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:30.305403 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:30.305378    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:31.304910 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:31.304872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:31.305466 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:31.304992    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:31.640600 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:31.640561    2578 generic.go:356] "Generic (PLEG): container finished" podID="adf8e722-11a5-401d-903d-7e96260a2dc3" containerID="fd7323504fa4954a7de245cec9a75339f480fa7a6df23bef6dd6fd8e31271eee" exitCode=0
Jul 24 16:43:31.640808 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:31.640613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerDied","Data":"fd7323504fa4954a7de245cec9a75339f480fa7a6df23bef6dd6fd8e31271eee"}
Jul 24 16:43:32.305567 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:32.305533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:32.306009 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:32.305585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:32.306009 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:32.305660    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:32.306009 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:32.305775    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:32.945128 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:32.945045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:32.945128 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:32.945108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:32.945328 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:32.945218    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:32.945328 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:32.945220    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:32.945423 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:32.945344    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:44:04.945301321 +0000 UTC m=+66.176048740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:43:32.945423 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:32.945365    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret podName:f0358d9b-a9df-4167-9e29-ee86088fde7f nodeName:}" failed. No retries permitted until 2026-07-24 16:44:04.945356517 +0000 UTC m=+66.176103922 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret") pod "global-pull-secret-syncer-w89jr" (UID: "f0358d9b-a9df-4167-9e29-ee86088fde7f") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:43:33.046374 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:33.046337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:33.046555 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:33.046540    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:43:33.046603 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:33.046567    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:43:33.046603 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:33.046580    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7pf6z for pod openshift-network-diagnostics/network-check-target-s5dl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:33.046675 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:33.046646    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z podName:77b687ab-5a67-489f-9d90-ef5726e75c35 nodeName:}" failed. No retries permitted until 2026-07-24 16:44:05.046625579 +0000 UTC m=+66.277373014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pf6z" (UniqueName: "kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z") pod "network-check-target-s5dl4" (UID: "77b687ab-5a67-489f-9d90-ef5726e75c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:43:33.305149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:33.305114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:33.305320 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:33.305238    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w89jr" podUID="f0358d9b-a9df-4167-9e29-ee86088fde7f"
Jul 24 16:43:34.304728 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.304695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:34.305316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.304744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:34.305316 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:34.304871    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:43:34.305316 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:34.304941    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5dl4" podUID="77b687ab-5a67-489f-9d90-ef5726e75c35"
Jul 24 16:43:34.571569 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.571481    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeReady"
Jul 24 16:43:34.571725 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.571648    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 16:43:34.612734 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.612695    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s4xzf"]
Jul 24 16:43:34.617189 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.617158    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s487s"]
Jul 24 16:43:34.617341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.617291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.620120 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.620098    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s487s"
Jul 24 16:43:34.620465 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.620305    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 16:43:34.620676 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.620550    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 16:43:34.620676 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.620590    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6r7g7\""
Jul 24 16:43:34.622072 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.622053    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 16:43:34.622264 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.622226    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 16:43:34.622264 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.622249    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 16:43:34.622398 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.622349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nk7wj\""
Jul 24 16:43:34.624803 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.624783    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s4xzf"]
Jul 24 16:43:34.629264 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.629242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s487s"]
Jul 24 16:43:34.759664 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.759629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkcjg\" (UniqueName: \"kubernetes.io/projected/384c97d3-e478-4a95-b865-70989b216cbe-kube-api-access-fkcjg\") pod \"ingress-canary-s487s\" (UID: \"384c97d3-e478-4a95-b865-70989b216cbe\") " pod="openshift-ingress-canary/ingress-canary-s487s"
Jul 24 16:43:34.759848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.759717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.759848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.759753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/384c97d3-e478-4a95-b865-70989b216cbe-cert\") pod \"ingress-canary-s487s\" (UID: \"384c97d3-e478-4a95-b865-70989b216cbe\") " pod="openshift-ingress-canary/ingress-canary-s487s"
Jul 24 16:43:34.759848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.759776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d86ce818-35e6-4488-b011-30a6fea70fbf-config-volume\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.759990 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.759859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d86ce818-35e6-4488-b011-30a6fea70fbf-tmp-dir\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.759990 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.759889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvx8k\" (UniqueName: \"kubernetes.io/projected/d86ce818-35e6-4488-b011-30a6fea70fbf-kube-api-access-tvx8k\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.860480 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.860390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcjg\" (UniqueName: \"kubernetes.io/projected/384c97d3-e478-4a95-b865-70989b216cbe-kube-api-access-fkcjg\") pod \"ingress-canary-s487s\" (UID: \"384c97d3-e478-4a95-b865-70989b216cbe\") " pod="openshift-ingress-canary/ingress-canary-s487s"
Jul 24 16:43:34.860480 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.860458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.860729 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.860487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/384c97d3-e478-4a95-b865-70989b216cbe-cert\") pod \"ingress-canary-s487s\" (UID: \"384c97d3-e478-4a95-b865-70989b216cbe\") " pod="openshift-ingress-canary/ingress-canary-s487s"
Jul 24 16:43:34.860729 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.860527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d86ce818-35e6-4488-b011-30a6fea70fbf-config-volume\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.860729 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.860566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d86ce818-35e6-4488-b011-30a6fea70fbf-tmp-dir\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.860729 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.860590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvx8k\" (UniqueName: \"kubernetes.io/projected/d86ce818-35e6-4488-b011-30a6fea70fbf-kube-api-access-tvx8k\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.860729 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:34.860642    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:43:34.860729 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:34.860716    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:43:35.360692194 +0000 UTC m=+36.591439602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:43:34.861102 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.861080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d86ce818-35e6-4488-b011-30a6fea70fbf-tmp-dir\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.861310 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.861292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d86ce818-35e6-4488-b011-30a6fea70fbf-config-volume\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.865813 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.865782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/384c97d3-e478-4a95-b865-70989b216cbe-cert\") pod \"ingress-canary-s487s\" (UID: \"384c97d3-e478-4a95-b865-70989b216cbe\") " pod="openshift-ingress-canary/ingress-canary-s487s"
Jul 24 16:43:34.871538 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.871496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvx8k\" (UniqueName: \"kubernetes.io/projected/d86ce818-35e6-4488-b011-30a6fea70fbf-kube-api-access-tvx8k\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:34.871675 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.871564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkcjg\" (UniqueName: \"kubernetes.io/projected/384c97d3-e478-4a95-b865-70989b216cbe-kube-api-access-fkcjg\") pod \"ingress-canary-s487s\" (UID: \"384c97d3-e478-4a95-b865-70989b216cbe\") " pod="openshift-ingress-canary/ingress-canary-s487s"
Jul 24 16:43:34.937034 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:34.937002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s487s"
Jul 24 16:43:35.305066 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:35.305032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:43:35.307435 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:35.307409    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 16:43:35.364887 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:35.364857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:35.365043 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:35.364982    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:43:35.365103 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:35.365056    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:43:36.365041354 +0000 UTC m=+37.595788781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:43:35.565378 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:35.565352    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s487s"]
Jul 24 16:43:35.569379 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:43:35.569354    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384c97d3_e478_4a95_b865_70989b216cbe.slice/crio-c725d88cd0e76dee92600de6313dff79884b538febe226e03120cb4f3d8a2577 WatchSource:0}: Error finding container c725d88cd0e76dee92600de6313dff79884b538febe226e03120cb4f3d8a2577: Status 404 returned error can't find the container with id c725d88cd0e76dee92600de6313dff79884b538febe226e03120cb4f3d8a2577
Jul 24 16:43:35.654154 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:35.654126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerStarted","Data":"9c152aa3e88d8d107cab3adc3a96713fb6233c2bf7272e9f3acaabe4832dbe88"}
Jul 24 16:43:35.655372 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:35.655343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s487s" event={"ID":"384c97d3-e478-4a95-b865-70989b216cbe","Type":"ContainerStarted","Data":"c725d88cd0e76dee92600de6313dff79884b538febe226e03120cb4f3d8a2577"}
Jul 24 16:43:36.305536 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.305475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:43:36.305536 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.305509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:43:36.310138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.309968    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 16:43:36.310138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.310001    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6gtf2\""
Jul 24 16:43:36.310138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.310058    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 16:43:36.310138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.310002    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 16:43:36.310138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.310061    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nn52b\""
Jul 24 16:43:36.372126 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.372091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:36.372265 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:36.372220    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:43:36.372357 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:36.372280    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:43:38.372261888 +0000 UTC m=+39.603009295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:43:36.661271 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.661184    2578 generic.go:356] "Generic (PLEG): container finished" podID="adf8e722-11a5-401d-903d-7e96260a2dc3" containerID="9c152aa3e88d8d107cab3adc3a96713fb6233c2bf7272e9f3acaabe4832dbe88" exitCode=0
Jul 24 16:43:36.661435 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:36.661273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerDied","Data":"9c152aa3e88d8d107cab3adc3a96713fb6233c2bf7272e9f3acaabe4832dbe88"}
Jul 24 16:43:37.667026 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:37.666996    2578 generic.go:356] "Generic (PLEG): container finished" podID="adf8e722-11a5-401d-903d-7e96260a2dc3" containerID="fb5714e73a7aec53fc49f2042642cc718cc57fab043ce9be885eceae08bcef8b" exitCode=0
Jul 24 16:43:37.667441 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:37.667057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerDied","Data":"fb5714e73a7aec53fc49f2042642cc718cc57fab043ce9be885eceae08bcef8b"}
Jul 24 16:43:38.386216 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:38.386031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:38.386374 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:38.386224    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:43:38.386374 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:38.386308    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:43:42.386286479 +0000 UTC m=+43.617033898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:43:38.670739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:38.670702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s487s" event={"ID":"384c97d3-e478-4a95-b865-70989b216cbe","Type":"ContainerStarted","Data":"58e60dcdf97e5d21294e5c3fca7ea43f0282c15109805b088a77efdbe11c878c"}
Jul 24 16:43:38.673987 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:38.673955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" event={"ID":"adf8e722-11a5-401d-903d-7e96260a2dc3","Type":"ContainerStarted","Data":"e279850019d078d8c418b50347f52021e0a824dd7abb6204f4691feedc17e440"}
Jul 24 16:43:38.685500 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:38.685454    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s487s" podStartSLOduration=2.083373086 podStartE2EDuration="4.685438893s" totalImagesPullingTime="2.602065807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:38.685040507 +0000 UTC m=+39.915787955" watchObservedRunningTime="2026-07-24 16:43:38.685438893 +0000 UTC m=+39.916186320"
Jul 24 16:43:38.707073 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:38.705811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k2b7k" podStartSLOduration=8.964071984 podStartE2EDuration="38.705785572s" totalImagesPullingTime="29.741713588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:38.704587857 +0000 UTC m=+39.935335283" watchObservedRunningTime="2026-07-24 16:43:38.705785572 +0000 UTC m=+39.936533000"
Jul 24 16:43:42.415271 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:42.415230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:42.415760 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:42.415386    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:43:42.415760 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:42.415454    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:43:50.415436253 +0000 UTC m=+51.646183659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:43:50.474753 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:43:50.474711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:43:50.475247 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:50.474898    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:43:50.475247 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:43:50.474980    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:44:06.474963652 +0000 UTC m=+67.705711057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:44:00.663669 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:00.663635    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ts428"
Jul 24 16:44:04.981084 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:04.981028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:44:04.981084 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:04.981095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:44:04.986299 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:04.986275    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 16:44:04.986299 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:04.986294    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 16:44:04.992228 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:44:04.992210    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 16:44:04.992291 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:44:04.992280    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:45:08.992264662 +0000 UTC m=+130.223012067 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : secret "metrics-daemon-secret" not found
Jul 24 16:44:04.996205 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:04.996180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f0358d9b-a9df-4167-9e29-ee86088fde7f-original-pull-secret\") pod \"global-pull-secret-syncer-w89jr\" (UID: \"f0358d9b-a9df-4167-9e29-ee86088fde7f\") " pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:44:05.015155 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.015130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w89jr"
Jul 24 16:44:05.081670 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.081570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:44:05.084546 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.084500    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 16:44:05.106243 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.106207    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 16:44:05.115804 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.115774    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pf6z\" (UniqueName: \"kubernetes.io/projected/77b687ab-5a67-489f-9d90-ef5726e75c35-kube-api-access-7pf6z\") pod \"network-check-target-s5dl4\" (UID: \"77b687ab-5a67-489f-9d90-ef5726e75c35\") " pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:44:05.122838 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.122816    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nn52b\""
Jul 24 16:44:05.130658 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.130635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:44:05.136252 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.136220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w89jr"]
Jul 24 16:44:05.139985 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:44:05.139960    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0358d9b_a9df_4167_9e29_ee86088fde7f.slice/crio-520d85715ac9295ae5571810f7acc4e58b2bde513de46167e3cb609f9f7f0127 WatchSource:0}: Error finding container 520d85715ac9295ae5571810f7acc4e58b2bde513de46167e3cb609f9f7f0127: Status 404 returned error can't find the container with id 520d85715ac9295ae5571810f7acc4e58b2bde513de46167e3cb609f9f7f0127
Jul 24 16:44:05.255794 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.255710    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s5dl4"]
Jul 24 16:44:05.258820 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:44:05.258786    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b687ab_5a67_489f_9d90_ef5726e75c35.slice/crio-b8fcac3fe68338f18e8014913775fe2f0b990a021ebe2c71b5c6afb9ce977949 WatchSource:0}: Error finding container b8fcac3fe68338f18e8014913775fe2f0b990a021ebe2c71b5c6afb9ce977949: Status 404 returned error can't find the container with id b8fcac3fe68338f18e8014913775fe2f0b990a021ebe2c71b5c6afb9ce977949
Jul 24 16:44:05.736928 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.736856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w89jr" event={"ID":"f0358d9b-a9df-4167-9e29-ee86088fde7f","Type":"ContainerStarted","Data":"520d85715ac9295ae5571810f7acc4e58b2bde513de46167e3cb609f9f7f0127"}
Jul 24 16:44:05.738394 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:05.738351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s5dl4" event={"ID":"77b687ab-5a67-489f-9d90-ef5726e75c35","Type":"ContainerStarted","Data":"b8fcac3fe68338f18e8014913775fe2f0b990a021ebe2c71b5c6afb9ce977949"}
Jul 24 16:44:06.493165 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:06.493127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:44:06.493847 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:44:06.493314    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:44:06.493847 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:44:06.493407    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:44:38.493381864 +0000 UTC m=+99.724129269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:44:09.751572 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:09.751537    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s5dl4" event={"ID":"77b687ab-5a67-489f-9d90-ef5726e75c35","Type":"ContainerStarted","Data":"1e57ee0e9ae4adec54b233f1eecbf87c7c82c217dbce2e1ed64dbd80b138a61c"}
Jul 24 16:44:09.752030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:09.751646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:44:09.753022 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:09.752990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w89jr" event={"ID":"f0358d9b-a9df-4167-9e29-ee86088fde7f","Type":"ContainerStarted","Data":"52903ba4dc692a7488ac200a4726baa618153a6f5e37e485712a92bcd42d815d"}
Jul 24 16:44:09.767996 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:09.767944    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s5dl4" podStartSLOduration=65.40824632 podStartE2EDuration="1m9.767928701s" totalImagesPullingTime="4.359682381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:44:09.767356408 +0000 UTC m=+70.998103835" watchObservedRunningTime="2026-07-24 16:44:09.767928701 +0000 UTC m=+70.998676127"
Jul 24 16:44:09.781077 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:09.781023    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w89jr" podStartSLOduration=65.299271815 podStartE2EDuration="1m9.781006599s" totalImagesPullingTime="4.481734784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:44:09.780272304 +0000 UTC m=+71.011019730" watchObservedRunningTime="2026-07-24 16:44:09.781006599 +0000 UTC m=+71.011754025"
Jul 24 16:44:31.030774 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.030645    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"]
Jul 24 16:44:31.032901 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.032884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"
Jul 24 16:44:31.036679 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.036657    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 16:44:31.036802 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.036740    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 16:44:31.036802 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.036748    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 16:44:31.037042 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.037028    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jlrlj\""
Jul 24 16:44:31.037089 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.037056    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 24 16:44:31.043720 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.043697    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"]
Jul 24 16:44:31.072946 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.072921    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"]
Jul 24 16:44:31.074752 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.074736    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.077311 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.077288    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 24 16:44:31.077423 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.077289    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 24 16:44:31.077423 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.077288    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 24 16:44:31.077423 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.077288    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 24 16:44:31.086857 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.086833    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"]
Jul 24 16:44:31.166175 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.166141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg57q\" (UniqueName: \"kubernetes.io/projected/262c083b-d3da-4968-93d9-a510d9701dec-kube-api-access-pg57q\") pod \"managed-serviceaccount-addon-agent-55db889bb6-dwxr8\" (UID: \"262c083b-d3da-4968-93d9-a510d9701dec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"
Jul 24 16:44:31.166175 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.166182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-hub\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.166411 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.166200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/262c083b-d3da-4968-93d9-a510d9701dec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55db889bb6-dwxr8\" (UID: \"262c083b-d3da-4968-93d9-a510d9701dec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"
Jul 24 16:44:31.166411 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.166221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.166411 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.166314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/458d26cd-4a4d-489d-ae94-f808a9d1be93-additional-service-ca\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.166411 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.166355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.166411 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.166374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqgw\" (UniqueName: \"kubernetes.io/projected/458d26cd-4a4d-489d-ae94-f808a9d1be93-kube-api-access-6lqgw\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.166411 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.166409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-ca\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.267110 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.267074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.267110 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.267111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqgw\" (UniqueName: \"kubernetes.io/projected/458d26cd-4a4d-489d-ae94-f808a9d1be93-kube-api-access-6lqgw\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.267335 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.267129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-ca\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.267335 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.267262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg57q\" (UniqueName: \"kubernetes.io/projected/262c083b-d3da-4968-93d9-a510d9701dec-kube-api-access-pg57q\") pod \"managed-serviceaccount-addon-agent-55db889bb6-dwxr8\" (UID: \"262c083b-d3da-4968-93d9-a510d9701dec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"
Jul 24 16:44:31.267335 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.267310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-hub\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.267464 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.267339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/262c083b-d3da-4968-93d9-a510d9701dec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55db889bb6-dwxr8\" (UID: \"262c083b-d3da-4968-93d9-a510d9701dec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"
Jul 24 16:44:31.267464 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.267370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.267464 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.267427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/458d26cd-4a4d-489d-ae94-f808a9d1be93-additional-service-ca\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.268506 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.268478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/458d26cd-4a4d-489d-ae94-f808a9d1be93-additional-service-ca\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.270128 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.270099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.270237 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.270187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-ca\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.270304 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.270239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-hub\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.270365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.270338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/262c083b-d3da-4968-93d9-a510d9701dec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55db889bb6-dwxr8\" (UID: \"262c083b-d3da-4968-93d9-a510d9701dec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"
Jul 24 16:44:31.270478 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.270457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/458d26cd-4a4d-489d-ae94-f808a9d1be93-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.275552 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.275528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg57q\" (UniqueName: \"kubernetes.io/projected/262c083b-d3da-4968-93d9-a510d9701dec-kube-api-access-pg57q\") pod \"managed-serviceaccount-addon-agent-55db889bb6-dwxr8\" (UID: \"262c083b-d3da-4968-93d9-a510d9701dec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"
Jul 24 16:44:31.275638 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.275539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqgw\" (UniqueName: \"kubernetes.io/projected/458d26cd-4a4d-489d-ae94-f808a9d1be93-kube-api-access-6lqgw\") pod \"cluster-proxy-proxy-agent-686998d6bb-nd6m9\" (UID: \"458d26cd-4a4d-489d-ae94-f808a9d1be93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.351890 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.351808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"
Jul 24 16:44:31.383661 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.383628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:44:31.476627 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.476598    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8"]
Jul 24 16:44:31.479698 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:44:31.479674    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod262c083b_d3da_4968_93d9_a510d9701dec.slice/crio-eb4f1ecc39c1d7a43b3739d7888714b07b5d08b7264d404fe6e7cf4f3aae19c7 WatchSource:0}: Error finding container eb4f1ecc39c1d7a43b3739d7888714b07b5d08b7264d404fe6e7cf4f3aae19c7: Status 404 returned error can't find the container with id eb4f1ecc39c1d7a43b3739d7888714b07b5d08b7264d404fe6e7cf4f3aae19c7
Jul 24 16:44:31.521958 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.521926    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"]
Jul 24 16:44:31.526212 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:44:31.526190    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod458d26cd_4a4d_489d_ae94_f808a9d1be93.slice/crio-d8454d46a78c161bef53d97a2f5c88773af4c99b5a36f9b14bae628ddc966806 WatchSource:0}: Error finding container d8454d46a78c161bef53d97a2f5c88773af4c99b5a36f9b14bae628ddc966806: Status 404 returned error can't find the container with id d8454d46a78c161bef53d97a2f5c88773af4c99b5a36f9b14bae628ddc966806
Jul 24 16:44:31.804338 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.804298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" event={"ID":"458d26cd-4a4d-489d-ae94-f808a9d1be93","Type":"ContainerStarted","Data":"d8454d46a78c161bef53d97a2f5c88773af4c99b5a36f9b14bae628ddc966806"}
Jul 24 16:44:31.805419 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:31.805380    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8" event={"ID":"262c083b-d3da-4968-93d9-a510d9701dec","Type":"ContainerStarted","Data":"eb4f1ecc39c1d7a43b3739d7888714b07b5d08b7264d404fe6e7cf4f3aae19c7"}
Jul 24 16:44:35.819414 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:35.819369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" event={"ID":"458d26cd-4a4d-489d-ae94-f808a9d1be93","Type":"ContainerStarted","Data":"d0c25083d458fd70049510c42285a20cf22c2f13d70e422c407031ffafce3914"}
Jul 24 16:44:35.819858 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:35.819431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" event={"ID":"458d26cd-4a4d-489d-ae94-f808a9d1be93","Type":"ContainerStarted","Data":"b962000a723f814a87df855c89c0fe0b98e65f5128b97bb25937c01b7c78b52c"}
Jul 24 16:44:35.819858 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:35.819452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" event={"ID":"458d26cd-4a4d-489d-ae94-f808a9d1be93","Type":"ContainerStarted","Data":"8d08035ee6fa6ba5dd0dbe9a12975ddd901a46d78526502126991dc05848a13d"}
Jul 24 16:44:35.820741 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:35.820714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8" event={"ID":"262c083b-d3da-4968-93d9-a510d9701dec","Type":"ContainerStarted","Data":"38bc56801b6ef291dd55c9ff348ecc5b411e52caad0c076708966156c3204634"}
Jul 24 16:44:35.837889 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:35.837838    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" podStartSLOduration=1.070838761 podStartE2EDuration="4.837826554s" totalImagesPullingTime="3.766987793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:44:35.836257585 +0000 UTC m=+97.067005012" watchObservedRunningTime="2026-07-24 16:44:35.837826554 +0000 UTC m=+97.068573980"
Jul 24 16:44:35.849951 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:35.849777    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8" podStartSLOduration=1.049244229 podStartE2EDuration="4.849764462s" totalImagesPullingTime="3.800520233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:44:35.849346521 +0000 UTC m=+97.080093948" watchObservedRunningTime="2026-07-24 16:44:35.849764462 +0000 UTC m=+97.080511888"
Jul 24 16:44:38.522756 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:38.522713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:44:38.523241 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:44:38.522898    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:44:38.523241 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:44:38.522997    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:45:42.522974393 +0000 UTC m=+163.753721822 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:44:40.758692 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:44:40.758655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s5dl4"
Jul 24 16:45:09.044696 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:45:09.044651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:45:09.045095 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:45:09.044789    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 16:45:09.045095 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:45:09.044852    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:47:11.044834039 +0000 UTC m=+252.275581445 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : secret "metrics-daemon-secret" not found
Jul 24 16:45:37.630308 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:45:37.630255    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s4xzf" podUID="d86ce818-35e6-4488-b011-30a6fea70fbf"
Jul 24 16:45:37.993285 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:45:37.993258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:45:39.326615 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:45:39.326561    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:45:42.575320 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:45:42.575281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:45:42.575732 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:45:42.575400    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:45:42.575732 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:45:42.575469    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls podName:d86ce818-35e6-4488-b011-30a6fea70fbf nodeName:}" failed. No retries permitted until 2026-07-24 16:47:44.575450653 +0000 UTC m=+285.806198057 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls") pod "dns-default-s4xzf" (UID: "d86ce818-35e6-4488-b011-30a6fea70fbf") : secret "dns-default-metrics-tls" not found
Jul 24 16:45:54.305435 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:45:54.305356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:46:36.159146 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:46:36.159113    2578 generic.go:356] "Generic (PLEG): container finished" podID="262c083b-d3da-4968-93d9-a510d9701dec" containerID="38bc56801b6ef291dd55c9ff348ecc5b411e52caad0c076708966156c3204634" exitCode=255
Jul 24 16:46:36.159581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:46:36.159181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8" event={"ID":"262c083b-d3da-4968-93d9-a510d9701dec","Type":"ContainerDied","Data":"38bc56801b6ef291dd55c9ff348ecc5b411e52caad0c076708966156c3204634"}
Jul 24 16:46:36.159581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:46:36.159450    2578 scope.go:117] "RemoveContainer" containerID="38bc56801b6ef291dd55c9ff348ecc5b411e52caad0c076708966156c3204634"
Jul 24 16:46:37.163977 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:46:37.163945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55db889bb6-dwxr8" event={"ID":"262c083b-d3da-4968-93d9-a510d9701dec","Type":"ContainerStarted","Data":"d35a0e94d2f46868da5fcb6801e9eaa0db1d6c53c6b89397ad65b33807babc56"}
Jul 24 16:47:11.072456 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:11.072403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:47:11.072970 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:11.072576    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 16:47:11.072970 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:11.072650    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs podName:8c25af09-e3b9-483c-b930-8debec737c4f nodeName:}" failed. No retries permitted until 2026-07-24 16:49:13.07263357 +0000 UTC m=+374.303380979 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs") pod "network-metrics-daemon-7hnmb" (UID: "8c25af09-e3b9-483c-b930-8debec737c4f") : secret "metrics-daemon-secret" not found
Jul 24 16:47:30.027950 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.027868    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-696lt"]
Jul 24 16:47:30.029954 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.029938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.032177 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.032150    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 16:47:30.032293 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.032173    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k88vr\""
Jul 24 16:47:30.032293 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.032154    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 16:47:30.032837 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.032822    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 16:47:30.032906 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.032841    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 16:47:30.043204 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.043179    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-696lt"]
Jul 24 16:47:30.099045 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.099009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hqwd\" (UniqueName: \"kubernetes.io/projected/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-api-access-2hqwd\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.099219 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.099071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.099219 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.099113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.099219 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.099147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/569ac2dd-e38a-46d7-9f43-da07b6291446-crio-socket\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.099219 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.099184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/569ac2dd-e38a-46d7-9f43-da07b6291446-data-volume\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.200179 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.200124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.200179 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.200192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/569ac2dd-e38a-46d7-9f43-da07b6291446-crio-socket\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.200412 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.200210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/569ac2dd-e38a-46d7-9f43-da07b6291446-data-volume\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.200412 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.200236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hqwd\" (UniqueName: \"kubernetes.io/projected/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-api-access-2hqwd\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.200412 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:30.200260    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:47:30.200412 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.200275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/569ac2dd-e38a-46d7-9f43-da07b6291446-crio-socket\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.200412 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:30.200332    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:30.200412 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:30.200342    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:30.700324668 +0000 UTC m=+271.931072073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : configmap "kube-rbac-proxy" not found
Jul 24 16:47:30.200412 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.200264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.200412 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:30.200383    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:30.700371145 +0000 UTC m=+271.931118550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:30.200772 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.200607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/569ac2dd-e38a-46d7-9f43-da07b6291446-data-volume\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.217603 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.217580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hqwd\" (UniqueName: \"kubernetes.io/projected/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-api-access-2hqwd\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.703560 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.703503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.703763 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:30.703602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:30.703763 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:30.703643    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:47:30.703763 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:30.703693    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:30.703763 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:30.703727    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:31.703704067 +0000 UTC m=+272.934451487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : configmap "kube-rbac-proxy" not found
Jul 24 16:47:30.703763 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:30.703746    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:31.703736086 +0000 UTC m=+272.934483496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:31.710880 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:31.710843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:31.710880 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:31.710893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:31.711310 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:31.710977    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:47:31.711310 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:31.711005    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:31.711310 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:31.711030    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:33.711017054 +0000 UTC m=+274.941764462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : configmap "kube-rbac-proxy" not found
Jul 24 16:47:31.711310 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:31.711066    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:33.711051799 +0000 UTC m=+274.941799209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:32.170437 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:32.170361    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tggvf_75731df3-1454-4bf7-9d07-c723e254ab2a/dns-node-resolver/0.log"
Jul 24 16:47:32.969415 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:32.969386    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhnfd_11d172de-f697-437c-bde7-fe358237ca92/node-ca/0.log"
Jul 24 16:47:33.723721 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:33.723669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:33.723721 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:33.723731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:33.723995 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:33.723817    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:47:33.723995 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:33.723834    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:33.723995 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:33.723880    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:37.723865213 +0000 UTC m=+278.954612618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : configmap "kube-rbac-proxy" not found
Jul 24 16:47:33.723995 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:33.723916    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:37.72389738 +0000 UTC m=+278.954644797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:33.969494 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:33.969461    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s487s_384c97d3-e478-4a95-b865-70989b216cbe/serve-healthcheck-canary/0.log"
Jul 24 16:47:37.752841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:37.752795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:37.752841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:37.752850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:37.753280 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:37.752956    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:37.753280 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:37.752978    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:47:37.753280 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:37.753023    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:45.753007146 +0000 UTC m=+286.983754551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:47:37.753280 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:37.753037    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm podName:569ac2dd-e38a-46d7-9f43-da07b6291446 nodeName:}" failed. No retries permitted until 2026-07-24 16:47:45.753030787 +0000 UTC m=+286.983778192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm") pod "insights-runtime-extractor-696lt" (UID: "569ac2dd-e38a-46d7-9f43-da07b6291446") : configmap "kube-rbac-proxy" not found
Jul 24 16:47:40.993841 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:40.993800    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s4xzf" podUID="d86ce818-35e6-4488-b011-30a6fea70fbf"
Jul 24 16:47:41.346966 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:41.346885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:47:44.606745 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:44.606702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:47:44.609028 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:44.609002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d86ce818-35e6-4488-b011-30a6fea70fbf-metrics-tls\") pod \"dns-default-s4xzf\" (UID: \"d86ce818-35e6-4488-b011-30a6fea70fbf\") " pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:47:44.649994 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:44.649965    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6r7g7\""
Jul 24 16:47:44.657845 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:44.657826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:47:44.779807 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:44.779775    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s4xzf"]
Jul 24 16:47:44.783188 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:47:44.783159    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86ce818_35e6_4488_b011_30a6fea70fbf.slice/crio-821753e10278725ca8759c457f722d14fb8e982fe8ca3ad3ae1b024e0dc87d99 WatchSource:0}: Error finding container 821753e10278725ca8759c457f722d14fb8e982fe8ca3ad3ae1b024e0dc87d99: Status 404 returned error can't find the container with id 821753e10278725ca8759c457f722d14fb8e982fe8ca3ad3ae1b024e0dc87d99
Jul 24 16:47:45.359983 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:45.359941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4xzf" event={"ID":"d86ce818-35e6-4488-b011-30a6fea70fbf","Type":"ContainerStarted","Data":"821753e10278725ca8759c457f722d14fb8e982fe8ca3ad3ae1b024e0dc87d99"}
Jul 24 16:47:45.815971 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:45.815927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:45.815971 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:45.815981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:45.816605 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:45.816584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/569ac2dd-e38a-46d7-9f43-da07b6291446-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:45.818597 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:45.818566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/569ac2dd-e38a-46d7-9f43-da07b6291446-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-696lt\" (UID: \"569ac2dd-e38a-46d7-9f43-da07b6291446\") " pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:45.938558 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:45.938503    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-696lt"
Jul 24 16:47:46.324715 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:46.324681    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-696lt"]
Jul 24 16:47:46.328591 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:47:46.328566    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569ac2dd_e38a_46d7_9f43_da07b6291446.slice/crio-f3f8319d38fd64e89af6532d568bf50a4f3869f6ee704e82adf9e6d8737d8734 WatchSource:0}: Error finding container f3f8319d38fd64e89af6532d568bf50a4f3869f6ee704e82adf9e6d8737d8734: Status 404 returned error can't find the container with id f3f8319d38fd64e89af6532d568bf50a4f3869f6ee704e82adf9e6d8737d8734
Jul 24 16:47:46.365852 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:46.365772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4xzf" event={"ID":"d86ce818-35e6-4488-b011-30a6fea70fbf","Type":"ContainerStarted","Data":"053353e74b829d106abed47ae0f66519e39d1d3dfa76938a63897a38bda7e303"}
Jul 24 16:47:46.367531 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:46.367475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-696lt" event={"ID":"569ac2dd-e38a-46d7-9f43-da07b6291446","Type":"ContainerStarted","Data":"f3f8319d38fd64e89af6532d568bf50a4f3869f6ee704e82adf9e6d8737d8734"}
Jul 24 16:47:47.373823 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:47.373779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4xzf" event={"ID":"d86ce818-35e6-4488-b011-30a6fea70fbf","Type":"ContainerStarted","Data":"d76b0915f9e50d9538c5716e8d4219b17eb3f8895d63005d1102e32a1aca6ea0"}
Jul 24 16:47:47.374258 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:47.373910    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:47:47.393131 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:47.392904    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s4xzf" podStartSLOduration=251.955114349 podStartE2EDuration="4m13.392885273s" totalImagesPullingTime="1.437770924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:47:47.3923109 +0000 UTC m=+288.623058328" watchObservedRunningTime="2026-07-24 16:47:47.392885273 +0000 UTC m=+288.623632702"
Jul 24 16:47:50.537463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.537423    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-6mltl"]
Jul 24 16:47:50.544488 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.544464    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-6mltl"
Jul 24 16:47:50.547398 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.547376    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 16:47:50.547529 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.547381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h4xjl\""
Jul 24 16:47:50.547688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.547671    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 16:47:50.557170 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.557147    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-6mltl"]
Jul 24 16:47:50.653343 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.653306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n22qw\" (UniqueName: \"kubernetes.io/projected/710a05c1-943f-4c3d-9e0d-f558f8a5d6b5-kube-api-access-n22qw\") pod \"downloads-7c97dc4555-6mltl\" (UID: \"710a05c1-943f-4c3d-9e0d-f558f8a5d6b5\") " pod="openshift-console/downloads-7c97dc4555-6mltl"
Jul 24 16:47:50.754731 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.754690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n22qw\" (UniqueName: \"kubernetes.io/projected/710a05c1-943f-4c3d-9e0d-f558f8a5d6b5-kube-api-access-n22qw\") pod \"downloads-7c97dc4555-6mltl\" (UID: \"710a05c1-943f-4c3d-9e0d-f558f8a5d6b5\") " pod="openshift-console/downloads-7c97dc4555-6mltl"
Jul 24 16:47:50.766435 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.766405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n22qw\" (UniqueName: \"kubernetes.io/projected/710a05c1-943f-4c3d-9e0d-f558f8a5d6b5-kube-api-access-n22qw\") pod \"downloads-7c97dc4555-6mltl\" (UID: \"710a05c1-943f-4c3d-9e0d-f558f8a5d6b5\") " pod="openshift-console/downloads-7c97dc4555-6mltl"
Jul 24 16:47:50.855568 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:50.855468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-6mltl"
Jul 24 16:47:51.199145 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:51.199119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-6mltl"]
Jul 24 16:47:51.202070 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:47:51.202043    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710a05c1_943f_4c3d_9e0d_f558f8a5d6b5.slice/crio-6bda028f5f15822268c330a28029c41c5f31cae0aaf83a6a811f4dec25ca5753 WatchSource:0}: Error finding container 6bda028f5f15822268c330a28029c41c5f31cae0aaf83a6a811f4dec25ca5753: Status 404 returned error can't find the container with id 6bda028f5f15822268c330a28029c41c5f31cae0aaf83a6a811f4dec25ca5753
Jul 24 16:47:51.389894 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:51.389802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-696lt" event={"ID":"569ac2dd-e38a-46d7-9f43-da07b6291446","Type":"ContainerStarted","Data":"5167d3ddf2298dd049b511dbae55d5f56722c6a01375a9b5111502e58a6f92a6"}
Jul 24 16:47:51.390859 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:51.390834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-6mltl" event={"ID":"710a05c1-943f-4c3d-9e0d-f558f8a5d6b5","Type":"ContainerStarted","Data":"6bda028f5f15822268c330a28029c41c5f31cae0aaf83a6a811f4dec25ca5753"}
Jul 24 16:47:55.408324 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:55.408275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-696lt" event={"ID":"569ac2dd-e38a-46d7-9f43-da07b6291446","Type":"ContainerStarted","Data":"15e7ffc9a15866137921421a815d4aa39a450a79c7b8acaf1dfcb2fe27ff892e"}
Jul 24 16:47:57.306101 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:57.306050    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7hnmb" podUID="8c25af09-e3b9-483c-b930-8debec737c4f"
Jul 24 16:47:57.381359 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:57.381326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s4xzf"
Jul 24 16:47:59.059819 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.059779    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n8mqw"]
Jul 24 16:47:59.083778 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.083743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.087314 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.087077    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 16:47:59.087314 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.087139    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 16:47:59.087314 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.087154    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9scxg\""
Jul 24 16:47:59.087314 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.087190    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 16:47:59.087314 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.087222    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 16:47:59.087314 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.087144    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 16:47:59.087726 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.087424    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 16:47:59.178867 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.178833    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 16:47:59.225504 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-sys\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.225504 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.225747 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-wtmp\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.225747 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.225747 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fng6l\" (UniqueName: \"kubernetes.io/projected/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-kube-api-access-fng6l\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.225747 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-textfile\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.225747 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-tls\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.225747 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-root\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.225747 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.225742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-metrics-client-ca\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.326316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-root\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.326316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-metrics-client-ca\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.326316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-sys\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.326316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.326316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-wtmp\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.326316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-root\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.326316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.326316 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-sys\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fng6l\" (UniqueName: \"kubernetes.io/projected/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-kube-api-access-fng6l\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-textfile\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-wtmp\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-tls\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.326750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-textfile\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.328592    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.328645    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.328868    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.328938    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.334082    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:59.336732    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:47:59.336807    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-tls podName:c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c nodeName:}" failed. No retries permitted until 2026-07-24 16:47:59.836787175 +0000 UTC m=+301.067534595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-tls") pod "node-exporter-n8mqw" (UID: "c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c") : secret "node-exporter-tls" not found
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.337201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-metrics-client-ca\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.337232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.342385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.339163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.344588 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.344571    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 16:47:59.356258 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.356232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fng6l\" (UniqueName: \"kubernetes.io/projected/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-kube-api-access-fng6l\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.424230 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.424190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-696lt" event={"ID":"569ac2dd-e38a-46d7-9f43-da07b6291446","Type":"ContainerStarted","Data":"5d87a34c5ebcd218ec74209d215ae897973af4f0da130d787e489339f8a55ffe"}
Jul 24 16:47:59.441731 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.441675    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-696lt" podStartSLOduration=17.760542892 podStartE2EDuration="30.44165453s" totalImagesPullingTime="12.681111638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:47:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:47:59.440872656 +0000 UTC m=+300.671620083" watchObservedRunningTime="2026-07-24 16:47:59.44165453 +0000 UTC m=+300.672401958"
Jul 24 16:47:59.931611 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.931566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-tls\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.934347 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.934296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c-node-exporter-tls\") pod \"node-exporter-n8mqw\" (UID: \"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c\") " pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:47:59.997951 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:47:59.997921    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9scxg\""
Jul 24 16:48:00.006860 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.006832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n8mqw"
Jul 24 16:48:00.018539 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:48:00.018493    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6350df8_9f54_4ad0_aa24_72c1cb1d2f9c.slice/crio-f9218415a7f3ff44f33535ebcbe0c51f188ec37b428c3346a0e196cc1d3ae73f WatchSource:0}: Error finding container f9218415a7f3ff44f33535ebcbe0c51f188ec37b428c3346a0e196cc1d3ae73f: Status 404 returned error can't find the container with id f9218415a7f3ff44f33535ebcbe0c51f188ec37b428c3346a0e196cc1d3ae73f
Jul 24 16:48:00.088031 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.087996    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:48:00.093178 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.093151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.095609 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.095490    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 16:48:00.095609 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.095591    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 16:48:00.095848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.095499    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 16:48:00.095848 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.095639    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 16:48:00.096014 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.095983    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 16:48:00.096014 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.096013    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 16:48:00.096181 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.096012    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 16:48:00.096181 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.096091    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 16:48:00.096385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.096358    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 16:48:00.096484 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.096436    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ldpxf\""
Jul 24 16:48:00.107597 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.107576    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:48:00.234624 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.234624 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.234873 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.234873 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.234873 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-out\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.234873 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.234873 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w8pc\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-kube-api-access-2w8pc\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.234873 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.235137 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-web-config\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.235137 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.235137 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.235137 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.234950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.235137 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.235009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.335893 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.335853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-out\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.335909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.335940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w8pc\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-kube-api-access-2w8pc\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.335961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.335984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-web-config\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336088 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336387    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.336880 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.336804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.337184 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:48:00.337147    2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 24 16:48:00.337287 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:48:00.337211    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls podName:cdfb8a2d-d90e-42c7-995e-329b5b438a79 nodeName:}" failed. No retries permitted until 2026-07-24 16:48:00.837191931 +0000 UTC m=+302.067939337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79") : secret "alertmanager-main-tls" not found
Jul 24 16:48:00.337996 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.337969    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.339212 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.339184    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.339847 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.339751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-out\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.339847 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.339756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.340611 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.340589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.340704 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.340625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.340704 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.340659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-web-config\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.341151 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.341084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.341447 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.341417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.345437 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.345412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w8pc\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-kube-api-access-2w8pc\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.408418 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.408385    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64d765d79f-xtf29"]
Jul 24 16:48:00.412811 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.412785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.415155 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.415134    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q6qvj\""
Jul 24 16:48:00.415294 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.415272    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 16:48:00.415409 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.415382    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 16:48:00.415532 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.415431    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 16:48:00.415743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.415727    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 16:48:00.415840 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.415824    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 16:48:00.421869 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.421695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d765d79f-xtf29"]
Jul 24 16:48:00.429115 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.429087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n8mqw" event={"ID":"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c","Type":"ContainerStarted","Data":"f9218415a7f3ff44f33535ebcbe0c51f188ec37b428c3346a0e196cc1d3ae73f"}
Jul 24 16:48:00.538110 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.538027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv9dv\" (UniqueName: \"kubernetes.io/projected/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-kube-api-access-cv9dv\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.538291 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.538129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-config\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.538291 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.538182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-oauth-config\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.538291 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.538254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-serving-cert\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.538449 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.538340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-service-ca\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.538449 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.538385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-oauth-serving-cert\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.638982 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.638941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-service-ca\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.639165 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.639000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-oauth-serving-cert\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.639165 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.639047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv9dv\" (UniqueName: \"kubernetes.io/projected/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-kube-api-access-cv9dv\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.639165 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.639104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-config\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.639165 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.639138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-oauth-config\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.639958 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.639931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-config\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.640087 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.639959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-serving-cert\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.640087 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.639931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-oauth-serving-cert\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.640526 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.640485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-service-ca\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.642637 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.642617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-serving-cert\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.642918 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.642893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-oauth-config\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.649957 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.649935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv9dv\" (UniqueName: \"kubernetes.io/projected/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-kube-api-access-cv9dv\") pod \"console-64d765d79f-xtf29\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") " pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.724396 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.724348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:00.842824 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.842492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.845713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.845671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:00.882104 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:00.882069    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d765d79f-xtf29"]
Jul 24 16:48:01.005376 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:01.005339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:48:01.117888 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:48:01.117818    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3978b279_17ba_44ef_9175_cc4d0f0f6cf4.slice/crio-50dd65c57e3d76354e338dcc938f51de2149271208b46915b462fb91cd5bc671 WatchSource:0}: Error finding container 50dd65c57e3d76354e338dcc938f51de2149271208b46915b462fb91cd5bc671: Status 404 returned error can't find the container with id 50dd65c57e3d76354e338dcc938f51de2149271208b46915b462fb91cd5bc671
Jul 24 16:48:01.119910 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:01.119889    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:48:01.433937 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:01.433834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d765d79f-xtf29" event={"ID":"3978b279-17ba-44ef-9175-cc4d0f0f6cf4","Type":"ContainerStarted","Data":"50dd65c57e3d76354e338dcc938f51de2149271208b46915b462fb91cd5bc671"}
Jul 24 16:48:03.438476 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.438435    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-696948f58-pk28v"]
Jul 24 16:48:03.442089 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.442066    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.445175 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.445154    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 16:48:03.445290 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.445161    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-llwtw\""
Jul 24 16:48:03.445290 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.445222    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 16:48:03.445290 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.445260    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 16:48:03.445290 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.445277    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9ctiie9v7237n\""
Jul 24 16:48:03.445563 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.445541    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 16:48:03.453225 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.453195    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-696948f58-pk28v"]
Jul 24 16:48:03.567104 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.567056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-secret-metrics-server-tls\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.567301 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.567182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-audit-log\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.567301 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.567245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-client-ca-bundle\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.567301 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.567288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-metrics-server-audit-profiles\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.567460 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.567321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkglt\" (UniqueName: \"kubernetes.io/projected/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-kube-api-access-qkglt\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.567460 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.567350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.567460 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.567379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-secret-metrics-server-client-certs\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.668333 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.668296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-secret-metrics-server-tls\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.668504 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.668365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-audit-log\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.668504 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.668402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-client-ca-bundle\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.668504 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.668442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-metrics-server-audit-profiles\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.668504 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.668476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkglt\" (UniqueName: \"kubernetes.io/projected/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-kube-api-access-qkglt\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.668504 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.668503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.668800 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.668544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-secret-metrics-server-client-certs\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.668915 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.668888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-audit-log\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.669353 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.669324    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.669564 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.669541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-metrics-server-audit-profiles\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.671239 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.671188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-secret-metrics-server-tls\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.671340 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.671282    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-client-ca-bundle\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.671401 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.671377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-secret-metrics-server-client-certs\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.676443 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.676419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkglt\" (UniqueName: \"kubernetes.io/projected/eb1d10e2-8059-413c-b007-d84ac4a5a3d4-kube-api-access-qkglt\") pod \"metrics-server-696948f58-pk28v\" (UID: \"eb1d10e2-8059-413c-b007-d84ac4a5a3d4\") " pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:03.753608 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:03.753573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:08.300445 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.300306    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:48:08.303957 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.303883    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-696948f58-pk28v"]
Jul 24 16:48:08.307130 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:48:08.307103    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdfb8a2d_d90e_42c7_995e_329b5b438a79.slice/crio-c18076c56a5f1194fdf71e19bf506b28df17cd7872d99018f6f83784d609907a WatchSource:0}: Error finding container c18076c56a5f1194fdf71e19bf506b28df17cd7872d99018f6f83784d609907a: Status 404 returned error can't find the container with id c18076c56a5f1194fdf71e19bf506b28df17cd7872d99018f6f83784d609907a
Jul 24 16:48:08.310661 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:48:08.310632    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1d10e2_8059_413c_b007_d84ac4a5a3d4.slice/crio-7f7d5a269b62a6a67af0f5ca968b9533e2a6f5c1bf465fcbea35e93517b920a4 WatchSource:0}: Error finding container 7f7d5a269b62a6a67af0f5ca968b9533e2a6f5c1bf465fcbea35e93517b920a4: Status 404 returned error can't find the container with id 7f7d5a269b62a6a67af0f5ca968b9533e2a6f5c1bf465fcbea35e93517b920a4
Jul 24 16:48:08.460906 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.460860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-696948f58-pk28v" event={"ID":"eb1d10e2-8059-413c-b007-d84ac4a5a3d4","Type":"ContainerStarted","Data":"7f7d5a269b62a6a67af0f5ca968b9533e2a6f5c1bf465fcbea35e93517b920a4"}
Jul 24 16:48:08.462797 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.462755    2578 generic.go:356] "Generic (PLEG): container finished" podID="c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c" containerID="3b415c1486973792b20ad399fce6cb39d58a1b9c95031103c31e5180aab9ce6f" exitCode=0
Jul 24 16:48:08.462931 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.462842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n8mqw" event={"ID":"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c","Type":"ContainerDied","Data":"3b415c1486973792b20ad399fce6cb39d58a1b9c95031103c31e5180aab9ce6f"}
Jul 24 16:48:08.464424 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.464391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerStarted","Data":"c18076c56a5f1194fdf71e19bf506b28df17cd7872d99018f6f83784d609907a"}
Jul 24 16:48:08.466139 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.466115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-6mltl" event={"ID":"710a05c1-943f-4c3d-9e0d-f558f8a5d6b5","Type":"ContainerStarted","Data":"fc068cec2f58e469b77c330ff428dd553c4386f8f49cf8ad6396778e6177d0f1"}
Jul 24 16:48:08.466425 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.466402    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-6mltl"
Jul 24 16:48:08.475394 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.475325    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-6mltl"
Jul 24 16:48:08.502134 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:08.502075    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-6mltl" podStartSLOduration=1.5005131710000001 podStartE2EDuration="18.502050628s" totalImagesPullingTime="17.001537457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:48:08.500962777 +0000 UTC m=+309.731710236" watchObservedRunningTime="2026-07-24 16:48:08.502050628 +0000 UTC m=+309.732798055"
Jul 24 16:48:09.477544 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:09.477072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n8mqw" event={"ID":"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c","Type":"ContainerStarted","Data":"4a8a76a76c5fc1d8ed29e7d450c81f1663ab000cf228ec9a7ad104512e7ce133"}
Jul 24 16:48:09.477544 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:09.477137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n8mqw" event={"ID":"c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c","Type":"ContainerStarted","Data":"eba07e404376907738ed748d778f53844431e4674de0314192d3381513dece30"}
Jul 24 16:48:09.498126 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:09.497876    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n8mqw" podStartSLOduration=2.288517792 podStartE2EDuration="10.497855223s" totalImagesPullingTime="8.125962439s" totalInitContainerRuntime="83.374992ms" isStatefulPod=true podCreationTimestamp="2026-07-24 16:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:48:09.495494478 +0000 UTC m=+310.726241927" watchObservedRunningTime="2026-07-24 16:48:09.497855223 +0000 UTC m=+310.728602652"
Jul 24 16:48:12.305232 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:12.305187    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:48:13.496847 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:13.496806    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerID="c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7" exitCode=0
Jul 24 16:48:13.497330 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:13.496890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerDied","Data":"c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7"}
Jul 24 16:48:13.498896 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:13.498871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-696948f58-pk28v" event={"ID":"eb1d10e2-8059-413c-b007-d84ac4a5a3d4","Type":"ContainerStarted","Data":"9503626cef392eaeafd7f206ff8b5e59cfd2a5800fbc92c6d7fc25d941729216"}
Jul 24 16:48:13.500720 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:13.500685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d765d79f-xtf29" event={"ID":"3978b279-17ba-44ef-9175-cc4d0f0f6cf4","Type":"ContainerStarted","Data":"7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e"}
Jul 24 16:48:13.544711 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:13.544657    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64d765d79f-xtf29" podStartSLOduration=2.258991653 podStartE2EDuration="13.54463798s" totalImagesPullingTime="11.285646327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:48:13.543346993 +0000 UTC m=+314.774094441" watchObservedRunningTime="2026-07-24 16:48:13.54463798 +0000 UTC m=+314.775385409"
Jul 24 16:48:13.558753 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:13.558702    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-696948f58-pk28v" podStartSLOduration=6.474164829 podStartE2EDuration="10.558679713s" totalImagesPullingTime="4.084514884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:48:13.558466804 +0000 UTC m=+314.789214236" watchObservedRunningTime="2026-07-24 16:48:13.558679713 +0000 UTC m=+314.789427145"
Jul 24 16:48:16.518412 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:16.518381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerStarted","Data":"15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7"}
Jul 24 16:48:16.518819 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:16.518504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerStarted","Data":"ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0"}
Jul 24 16:48:16.518819 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:16.518574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerStarted","Data":"252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09"}
Jul 24 16:48:16.518819 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:16.518612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerStarted","Data":"2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d"}
Jul 24 16:48:16.518819 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:16.518650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerStarted","Data":"33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d"}
Jul 24 16:48:18.530041 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:18.530009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerStarted","Data":"f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4"}
Jul 24 16:48:18.556818 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:18.556765    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.463515454 podStartE2EDuration="18.556746933s" totalImagesPullingTime="8.05367833s" totalInitContainerRuntime="39.553149ms" isStatefulPod=false podCreationTimestamp="2026-07-24 16:48:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:48:18.555495346 +0000 UTC m=+319.786242772" watchObservedRunningTime="2026-07-24 16:48:18.556746933 +0000 UTC m=+319.787494360"
Jul 24 16:48:20.724606 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:20.724555    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:20.724990 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:20.724632    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:20.729492 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:20.729469    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:21.105794 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:21.105718    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d765d79f-xtf29"]
Jul 24 16:48:21.384646 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:21.384563    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" podUID="458d26cd-4a4d-489d-ae94-f808a9d1be93" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 16:48:21.544081 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:21.544053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:23.754624 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:23.754583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:23.755083 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:23.754647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:31.385589 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:31.385552    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" podUID="458d26cd-4a4d-489d-ae94-f808a9d1be93" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 16:48:41.384868 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:41.384825    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" podUID="458d26cd-4a4d-489d-ae94-f808a9d1be93" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 16:48:41.385338 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:41.384906    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9"
Jul 24 16:48:41.385554 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:41.385499    2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d0c25083d458fd70049510c42285a20cf22c2f13d70e422c407031ffafce3914"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 24 16:48:41.385639 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:41.385581    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" podUID="458d26cd-4a4d-489d-ae94-f808a9d1be93" containerName="service-proxy" containerID="cri-o://d0c25083d458fd70049510c42285a20cf22c2f13d70e422c407031ffafce3914" gracePeriod=30
Jul 24 16:48:41.608841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:41.608807    2578 generic.go:356] "Generic (PLEG): container finished" podID="458d26cd-4a4d-489d-ae94-f808a9d1be93" containerID="d0c25083d458fd70049510c42285a20cf22c2f13d70e422c407031ffafce3914" exitCode=2
Jul 24 16:48:41.608932 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:41.608850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" event={"ID":"458d26cd-4a4d-489d-ae94-f808a9d1be93","Type":"ContainerDied","Data":"d0c25083d458fd70049510c42285a20cf22c2f13d70e422c407031ffafce3914"}
Jul 24 16:48:42.614915 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:42.614873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-686998d6bb-nd6m9" event={"ID":"458d26cd-4a4d-489d-ae94-f808a9d1be93","Type":"ContainerStarted","Data":"2374c71277850af5fc758f8506161a1f6a9b1898cda969e561528bf15ece592c"}
Jul 24 16:48:43.759086 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:43.759058    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:43.762815 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:43.762790    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-696948f58-pk28v"
Jul 24 16:48:47.562599 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.562529    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64d765d79f-xtf29" podUID="3978b279-17ba-44ef-9175-cc4d0f0f6cf4" containerName="console" containerID="cri-o://7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e" gracePeriod=15
Jul 24 16:48:47.836585 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.836502    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:47.965540 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.965483    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-oauth-config\") pod \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") "
Jul 24 16:48:47.965540 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.965544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-service-ca\") pod \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") "
Jul 24 16:48:47.965792 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.965577    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv9dv\" (UniqueName: \"kubernetes.io/projected/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-kube-api-access-cv9dv\") pod \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") "
Jul 24 16:48:47.965792 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.965614    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-oauth-serving-cert\") pod \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") "
Jul 24 16:48:47.965792 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.965637    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-config\") pod \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") "
Jul 24 16:48:47.965792 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.965685    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-serving-cert\") pod \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\" (UID: \"3978b279-17ba-44ef-9175-cc4d0f0f6cf4\") "
Jul 24 16:48:47.966044 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.966012    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-service-ca" (OuterVolumeSpecName: "service-ca") pod "3978b279-17ba-44ef-9175-cc4d0f0f6cf4" (UID: "3978b279-17ba-44ef-9175-cc4d0f0f6cf4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:48:47.966103 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.966038    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3978b279-17ba-44ef-9175-cc4d0f0f6cf4" (UID: "3978b279-17ba-44ef-9175-cc4d0f0f6cf4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:48:47.966103 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.966055    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-config" (OuterVolumeSpecName: "console-config") pod "3978b279-17ba-44ef-9175-cc4d0f0f6cf4" (UID: "3978b279-17ba-44ef-9175-cc4d0f0f6cf4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:48:47.967901 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.967873    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3978b279-17ba-44ef-9175-cc4d0f0f6cf4" (UID: "3978b279-17ba-44ef-9175-cc4d0f0f6cf4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:48:47.967901 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.967890    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3978b279-17ba-44ef-9175-cc4d0f0f6cf4" (UID: "3978b279-17ba-44ef-9175-cc4d0f0f6cf4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:48:47.968048 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:47.967986    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-kube-api-access-cv9dv" (OuterVolumeSpecName: "kube-api-access-cv9dv") pod "3978b279-17ba-44ef-9175-cc4d0f0f6cf4" (UID: "3978b279-17ba-44ef-9175-cc4d0f0f6cf4"). InnerVolumeSpecName "kube-api-access-cv9dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:48:48.066841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.066795    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-oauth-config\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:48:48.066841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.066824    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-service-ca\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:48:48.066841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.066834    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv9dv\" (UniqueName: \"kubernetes.io/projected/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-kube-api-access-cv9dv\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:48:48.066841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.066843    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-oauth-serving-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:48:48.066841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.066851    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-config\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:48:48.067118 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.066860    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3978b279-17ba-44ef-9175-cc4d0f0f6cf4-console-serving-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:48:48.638552 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.638497    2578 generic.go:356] "Generic (PLEG): container finished" podID="3978b279-17ba-44ef-9175-cc4d0f0f6cf4" containerID="7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e" exitCode=0
Jul 24 16:48:48.638552 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.638551    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d765d79f-xtf29"
Jul 24 16:48:48.639050 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.638579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d765d79f-xtf29" event={"ID":"3978b279-17ba-44ef-9175-cc4d0f0f6cf4","Type":"ContainerDied","Data":"7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e"}
Jul 24 16:48:48.639050 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.638643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d765d79f-xtf29" event={"ID":"3978b279-17ba-44ef-9175-cc4d0f0f6cf4","Type":"ContainerDied","Data":"50dd65c57e3d76354e338dcc938f51de2149271208b46915b462fb91cd5bc671"}
Jul 24 16:48:48.639050 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.638675    2578 scope.go:117] "RemoveContainer" containerID="7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e"
Jul 24 16:48:48.647480 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.647464    2578 scope.go:117] "RemoveContainer" containerID="7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e"
Jul 24 16:48:48.647809 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:48:48.647785    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e\": container with ID starting with 7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e not found: ID does not exist" containerID="7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e"
Jul 24 16:48:48.647880 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.647820    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e"} err="failed to get container status \"7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e\": rpc error: code = NotFound desc = could not find container \"7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e\": container with ID starting with 7a94aaa89d274f60700970440c5b62b2ca29170e08c28ff32144b1f280880e2e not found: ID does not exist"
Jul 24 16:48:48.658141 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.658118    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d765d79f-xtf29"]
Jul 24 16:48:48.663277 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:48.663256    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64d765d79f-xtf29"]
Jul 24 16:48:49.309426 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:48:49.309397    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3978b279-17ba-44ef-9175-cc4d0f0f6cf4" path="/var/lib/kubelet/pods/3978b279-17ba-44ef-9175-cc4d0f0f6cf4/volumes"
Jul 24 16:49:13.169924 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:13.169882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:49:13.172128 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:13.172103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c25af09-e3b9-483c-b930-8debec737c4f-metrics-certs\") pod \"network-metrics-daemon-7hnmb\" (UID: \"8c25af09-e3b9-483c-b930-8debec737c4f\") " pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:49:13.209124 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:13.208889    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6gtf2\""
Jul 24 16:49:13.217186 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:13.217162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnmb"
Jul 24 16:49:13.377798 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:13.377764    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7hnmb"]
Jul 24 16:49:13.383130 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:49:13.383100    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c25af09_e3b9_483c_b930_8debec737c4f.slice/crio-50f3e6bd2b2b67974b32e0298df04381219b1640705bc9df322f9682a591bcc8 WatchSource:0}: Error finding container 50f3e6bd2b2b67974b32e0298df04381219b1640705bc9df322f9682a591bcc8: Status 404 returned error can't find the container with id 50f3e6bd2b2b67974b32e0298df04381219b1640705bc9df322f9682a591bcc8
Jul 24 16:49:13.731023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:13.730986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hnmb" event={"ID":"8c25af09-e3b9-483c-b930-8debec737c4f","Type":"ContainerStarted","Data":"50f3e6bd2b2b67974b32e0298df04381219b1640705bc9df322f9682a591bcc8"}
Jul 24 16:49:14.736379 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:14.736338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hnmb" event={"ID":"8c25af09-e3b9-483c-b930-8debec737c4f","Type":"ContainerStarted","Data":"9ee3ffd251c2187ab02f43eab64471c93878275b18e25adb3f7fff8a6b950a33"}
Jul 24 16:49:14.736843 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:14.736404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hnmb" event={"ID":"8c25af09-e3b9-483c-b930-8debec737c4f","Type":"ContainerStarted","Data":"851993c534273658d6b74926cd61754113a04ce3114a25e300f3ad576cceb59c"}
Jul 24 16:49:14.753271 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:14.753223    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7hnmb" podStartSLOduration=373.792341945 podStartE2EDuration="6m14.75320752s" totalImagesPullingTime="960.865575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:49:14.751800375 +0000 UTC m=+375.982547813" watchObservedRunningTime="2026-07-24 16:49:14.75320752 +0000 UTC m=+375.983954947"
Jul 24 16:49:19.284457 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.284420    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:49:19.284997 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.284715    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="alertmanager" containerID="cri-o://33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d" gracePeriod=120
Jul 24 16:49:19.284997 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.284751    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy" containerID="cri-o://ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0" gracePeriod=120
Jul 24 16:49:19.284997 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.284763    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="prom-label-proxy" containerID="cri-o://f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4" gracePeriod=120
Jul 24 16:49:19.284997 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.284791    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy-web" containerID="cri-o://252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09" gracePeriod=120
Jul 24 16:49:19.284997 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.284816    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy-metric" containerID="cri-o://15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7" gracePeriod=120
Jul 24 16:49:19.284997 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.284854    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="config-reloader" containerID="cri-o://2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d" gracePeriod=120
Jul 24 16:49:19.761962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.761928    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerID="f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4" exitCode=0
Jul 24 16:49:19.761962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.761953    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerID="15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7" exitCode=0
Jul 24 16:49:19.761962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.761960    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerID="ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0" exitCode=0
Jul 24 16:49:19.761962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.761967    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerID="2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d" exitCode=0
Jul 24 16:49:19.761962 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.761972    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerID="33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d" exitCode=0
Jul 24 16:49:19.762245 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.761998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerDied","Data":"f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4"}
Jul 24 16:49:19.762245 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.762062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerDied","Data":"15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7"}
Jul 24 16:49:19.762245 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.762087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerDied","Data":"ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0"}
Jul 24 16:49:19.762245 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.762112    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerDied","Data":"2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d"}
Jul 24 16:49:19.762245 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:19.762137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerDied","Data":"33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d"}
Jul 24 16:49:20.527711 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.527686    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.637778 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.637684    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-cluster-tls-config\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.637778 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.637726    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-web-config\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.637778 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.637753    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-out\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.637778 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.637768    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-tls-assets\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.638124 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.637796    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w8pc\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-kube-api-access-2w8pc\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.638124 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.637818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.638124 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.637845    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-trusted-ca-bundle\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.638124 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.637883    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-web\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.639422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.638552    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:49:20.639422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.638622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-metrics-client-ca\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.639422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.638665    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-volume\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.639422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.638693    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-main-db\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.639422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.638757    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.639422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.638788    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\" (UID: \"cdfb8a2d-d90e-42c7-995e-329b5b438a79\") "
Jul 24 16:49:20.639422 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.638994    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.639871 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.639754    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:49:20.639921 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.639889    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:49:20.640532 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.640489    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-out" (OuterVolumeSpecName: "config-out") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:49:20.640921 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.640883    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:49:20.641239 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.641205    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:49:20.641239 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.641220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:49:20.641793 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.641758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-kube-api-access-2w8pc" (OuterVolumeSpecName: "kube-api-access-2w8pc") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "kube-api-access-2w8pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:49:20.642010 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.641987    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:49:20.642241 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.642220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:49:20.642382 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.642363    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-volume" (OuterVolumeSpecName: "config-volume") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:49:20.644596 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.644531    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:49:20.650213 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.650188    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-web-config" (OuterVolumeSpecName: "web-config") pod "cdfb8a2d-d90e-42c7-995e-329b5b438a79" (UID: "cdfb8a2d-d90e-42c7-995e-329b5b438a79"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:49:20.739463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739423    2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-cluster-tls-config\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739454    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-web-config\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739463    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-out\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739471    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-tls-assets\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739479    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w8pc\" (UniqueName: \"kubernetes.io/projected/cdfb8a2d-d90e-42c7-995e-329b5b438a79-kube-api-access-2w8pc\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739490    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-main-tls\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739499    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739507    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdfb8a2d-d90e-42c7-995e-329b5b438a79-metrics-client-ca\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739556    2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-config-volume\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739564    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdfb8a2d-d90e-42c7-995e-329b5b438a79-alertmanager-main-db\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739573    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.739739 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.739581    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdfb8a2d-d90e-42c7-995e-329b5b438a79-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:49:20.768060 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.768030    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerID="252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09" exitCode=0
Jul 24 16:49:20.768192 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.768090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerDied","Data":"252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09"}
Jul 24 16:49:20.768192 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.768101    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.768192 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.768148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdfb8a2d-d90e-42c7-995e-329b5b438a79","Type":"ContainerDied","Data":"c18076c56a5f1194fdf71e19bf506b28df17cd7872d99018f6f83784d609907a"}
Jul 24 16:49:20.768192 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.768181    2578 scope.go:117] "RemoveContainer" containerID="f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4"
Jul 24 16:49:20.775712 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.775576    2578 scope.go:117] "RemoveContainer" containerID="15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7"
Jul 24 16:49:20.782752 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.782733    2578 scope.go:117] "RemoveContainer" containerID="ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0"
Jul 24 16:49:20.788988 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.788965    2578 scope.go:117] "RemoveContainer" containerID="252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09"
Jul 24 16:49:20.791899 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.791877    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:49:20.796043 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.796017    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:49:20.796573 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.796554    2578 scope.go:117] "RemoveContainer" containerID="2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d"
Jul 24 16:49:20.803265 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.803246    2578 scope.go:117] "RemoveContainer" containerID="33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d"
Jul 24 16:49:20.809914 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.809896    2578 scope.go:117] "RemoveContainer" containerID="c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7"
Jul 24 16:49:20.816195 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.816180    2578 scope.go:117] "RemoveContainer" containerID="f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4"
Jul 24 16:49:20.816449 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:49:20.816431    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4\": container with ID starting with f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4 not found: ID does not exist" containerID="f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4"
Jul 24 16:49:20.816528 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.816462    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4"} err="failed to get container status \"f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4\": rpc error: code = NotFound desc = could not find container \"f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4\": container with ID starting with f5d45d6032b89f6322727e617c8f82b3225d636f41b52eae8436b1d0ae06bde4 not found: ID does not exist"
Jul 24 16:49:20.816528 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.816492    2578 scope.go:117] "RemoveContainer" containerID="15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7"
Jul 24 16:49:20.816766 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:49:20.816750    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7\": container with ID starting with 15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7 not found: ID does not exist" containerID="15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7"
Jul 24 16:49:20.816805 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.816772    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7"} err="failed to get container status \"15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7\": rpc error: code = NotFound desc = could not find container \"15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7\": container with ID starting with 15904b41e4a63bcf4c1e8c3d92fb6c34e78bd53b7ec2056525acdef7747456b7 not found: ID does not exist"
Jul 24 16:49:20.816805 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.816796    2578 scope.go:117] "RemoveContainer" containerID="ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0"
Jul 24 16:49:20.817011 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:49:20.816994    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0\": container with ID starting with ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0 not found: ID does not exist" containerID="ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0"
Jul 24 16:49:20.817058 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817018    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0"} err="failed to get container status \"ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0\": rpc error: code = NotFound desc = could not find container \"ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0\": container with ID starting with ac2908010d8254b8505c08e403239c4dde01d725e6da0539cbc883de29d570f0 not found: ID does not exist"
Jul 24 16:49:20.817058 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817035    2578 scope.go:117] "RemoveContainer" containerID="252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09"
Jul 24 16:49:20.817230 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:49:20.817215    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09\": container with ID starting with 252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09 not found: ID does not exist" containerID="252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09"
Jul 24 16:49:20.817271 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817235    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09"} err="failed to get container status \"252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09\": rpc error: code = NotFound desc = could not find container \"252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09\": container with ID starting with 252e6313fc9c1dd157971b81b0662a30b414762be291393a54383b58e0caae09 not found: ID does not exist"
Jul 24 16:49:20.817271 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817247    2578 scope.go:117] "RemoveContainer" containerID="2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d"
Jul 24 16:49:20.817430 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:49:20.817415    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d\": container with ID starting with 2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d not found: ID does not exist" containerID="2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d"
Jul 24 16:49:20.817469 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817433    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d"} err="failed to get container status \"2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d\": rpc error: code = NotFound desc = could not find container \"2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d\": container with ID starting with 2e3ba58e1d5d29b59b2277ee5363f282664c191f1458ff67df27acc7c7df414d not found: ID does not exist"
Jul 24 16:49:20.817469 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817448    2578 scope.go:117] "RemoveContainer" containerID="33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d"
Jul 24 16:49:20.817765 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:49:20.817751    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d\": container with ID starting with 33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d not found: ID does not exist" containerID="33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d"
Jul 24 16:49:20.817819 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817768    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d"} err="failed to get container status \"33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d\": rpc error: code = NotFound desc = could not find container \"33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d\": container with ID starting with 33e12d017f60edf508e4d5c3b975978a4bf06e0f9dc8ffb1706ad352efc2ba8d not found: ID does not exist"
Jul 24 16:49:20.817819 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817780    2578 scope.go:117] "RemoveContainer" containerID="c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7"
Jul 24 16:49:20.817981 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:49:20.817959    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7\": container with ID starting with c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7 not found: ID does not exist" containerID="c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7"
Jul 24 16:49:20.818072 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.817983    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7"} err="failed to get container status \"c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7\": rpc error: code = NotFound desc = could not find container \"c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7\": container with ID starting with c3e653db20e3f8665e0abaef532fac610bc6e61f8aa1c51c8dc8ccf8c218d1b7 not found: ID does not exist"
Jul 24 16:49:20.822974 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.822952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:49:20.823213 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823197    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="alertmanager"
Jul 24 16:49:20.823276 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823216    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="alertmanager"
Jul 24 16:49:20.823276 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823234    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3978b279-17ba-44ef-9175-cc4d0f0f6cf4" containerName="console"
Jul 24 16:49:20.823276 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823243    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3978b279-17ba-44ef-9175-cc4d0f0f6cf4" containerName="console"
Jul 24 16:49:20.823276 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823255    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="init-config-reloader"
Jul 24 16:49:20.823276 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823265    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="init-config-reloader"
Jul 24 16:49:20.823276 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823275    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="config-reloader"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823284    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="config-reloader"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823293    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823301    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823311    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy-metric"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823320    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy-metric"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823329    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="prom-label-proxy"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823337    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="prom-label-proxy"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823351    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy-web"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823360    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy-web"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823420    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3978b279-17ba-44ef-9175-cc4d0f0f6cf4" containerName="console"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823432    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="alertmanager"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823440    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823450    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="prom-label-proxy"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823459    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="config-reloader"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823468    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy-web"
Jul 24 16:49:20.823581 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.823476    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" containerName="kube-rbac-proxy-metric"
Jul 24 16:49:20.826609 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.826591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.829805 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.829754    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 16:49:20.829805 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.829786    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 16:49:20.829805 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.829795    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 16:49:20.830056 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.829792    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 16:49:20.830056 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.829786    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 16:49:20.830056 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.829952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 16:49:20.830247 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.830228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 16:49:20.830318 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.830256    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ldpxf\""
Jul 24 16:49:20.830318 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.830295    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 16:49:20.838446 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.838420    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 16:49:20.843326 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.843305    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:49:20.940468 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940468 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940468 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-web-config\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvzjx\" (UniqueName: \"kubernetes.io/projected/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-kube-api-access-hvzjx\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940906 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-config-out\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940906 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940906 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:20.940906 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:20.940779    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.041864 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.041821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.041864 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.041869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.041891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.041911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.041928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.041948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.041964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-web-config\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.041981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.042008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.042031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042053 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.042056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042459 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.042081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvzjx\" (UniqueName: \"kubernetes.io/projected/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-kube-api-access-hvzjx\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042459 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.042108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-config-out\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042993 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.042733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.042993 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.042796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045261 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-config-out\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045261 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045184    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-web-config\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045261 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045471 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045471 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045471 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045604 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045604 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.045671 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.045616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.046865 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.046843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.050468 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.050448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvzjx\" (UniqueName: \"kubernetes.io/projected/a14f8fd9-e5ef-4628-a884-9d0fcc9f132e-kube-api-access-hvzjx\") pod \"alertmanager-main-0\" (UID: \"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.139322 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.139287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 16:49:21.275859 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.275835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 16:49:21.278339 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:49:21.278315    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14f8fd9_e5ef_4628_a884_9d0fcc9f132e.slice/crio-2c5aa1947539cbf4d50a62f994922a1296272a4b1775ecb1165cb38bc4656b49 WatchSource:0}: Error finding container 2c5aa1947539cbf4d50a62f994922a1296272a4b1775ecb1165cb38bc4656b49: Status 404 returned error can't find the container with id 2c5aa1947539cbf4d50a62f994922a1296272a4b1775ecb1165cb38bc4656b49
Jul 24 16:49:21.309636 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.309611    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdfb8a2d-d90e-42c7-995e-329b5b438a79" path="/var/lib/kubelet/pods/cdfb8a2d-d90e-42c7-995e-329b5b438a79/volumes"
Jul 24 16:49:21.773658 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.773623    2578 generic.go:356] "Generic (PLEG): container finished" podID="a14f8fd9-e5ef-4628-a884-9d0fcc9f132e" containerID="af18b9598841197ea5d5c64f129ccb2b45203077f8de47703e8875a9db756e02" exitCode=0
Jul 24 16:49:21.774124 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.773694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e","Type":"ContainerDied","Data":"af18b9598841197ea5d5c64f129ccb2b45203077f8de47703e8875a9db756e02"}
Jul 24 16:49:21.774124 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:21.773749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e","Type":"ContainerStarted","Data":"2c5aa1947539cbf4d50a62f994922a1296272a4b1775ecb1165cb38bc4656b49"}
Jul 24 16:49:22.782417 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:22.782384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e","Type":"ContainerStarted","Data":"86840cb11c41b16f1ea7ac0363ef062adc8a11c23f2143f374caa9e70b206ac0"}
Jul 24 16:49:22.782801 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:22.782453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e","Type":"ContainerStarted","Data":"7fd13e2403513aca7ae290575150b0d50e1dc7fb91700527d1aa04bcae525cc4"}
Jul 24 16:49:22.782801 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:22.782487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e","Type":"ContainerStarted","Data":"04cef5f25887c1d8d0000a0adc44af827776eec20dc2a498eadd040b257af78f"}
Jul 24 16:49:22.782801 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:22.782535    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e","Type":"ContainerStarted","Data":"682b37980335e74744cdd01b80d355248cc75af23667eef0923d9497be88e641"}
Jul 24 16:49:22.782801 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:22.782571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e","Type":"ContainerStarted","Data":"e84459b804cfdc66f06a9896b59a86ebfb79d1666e01251f12149782a8acaf6e"}
Jul 24 16:49:22.782801 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:22.782597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a14f8fd9-e5ef-4628-a884-9d0fcc9f132e","Type":"ContainerStarted","Data":"adefe225dff6a355ef525cb0d29a7cbf9890403b2e8e1f0ee5d7da8bf5a6dba5"}
Jul 24 16:49:22.808616 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:22.808569    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.793258744 podStartE2EDuration="2.808553444s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.2947ms" isStatefulPod=false podCreationTimestamp="2026-07-24 16:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:49:22.808088518 +0000 UTC m=+384.038835958" watchObservedRunningTime="2026-07-24 16:49:22.808553444 +0000 UTC m=+384.039300871"
Jul 24 16:49:23.309487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.309457    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"]
Jul 24 16:49:23.311869 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.311853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.314075 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.314055    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 16:49:23.314333 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.314317    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 16:49:23.314404 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.314342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 16:49:23.314404 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.314351    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 16:49:23.314404 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.314346    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zkdh8\""
Jul 24 16:49:23.314659 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.314645    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 16:49:23.321539 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.321489    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 16:49:23.326237 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.326211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"]
Jul 24 16:49:23.369920 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.369877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-federate-client-tls\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.370112 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.369941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.370112 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.369970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-metrics-client-ca\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.370112 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.370001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-secret-telemeter-client\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.370112 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.370025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-telemeter-client-tls\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.370112 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.370068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9mn9\" (UniqueName: \"kubernetes.io/projected/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-kube-api-access-d9mn9\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.370112 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.370103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-serving-certs-ca-bundle\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.370393 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.370147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471103 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471103 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-metrics-client-ca\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471338 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-secret-telemeter-client\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471338 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-telemeter-client-tls\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471338 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9mn9\" (UniqueName: \"kubernetes.io/projected/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-kube-api-access-d9mn9\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-serving-certs-ca-bundle\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-federate-client-tls\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.471994 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.471970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-metrics-client-ca\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.472115 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.472099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-serving-certs-ca-bundle\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.472670 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.472647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.474007 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.473981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-federate-client-tls\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.474137 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.473981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-telemeter-client-tls\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.474211 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.474189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-secret-telemeter-client\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.474258 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.474227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.479858 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.479835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9mn9\" (UniqueName: \"kubernetes.io/projected/94bb3e7a-ac49-4df0-b5f4-b6db6e649168-kube-api-access-d9mn9\") pod \"telemeter-client-fc9f96ff9-wbxtl\" (UID: \"94bb3e7a-ac49-4df0-b5f4-b6db6e649168\") " pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.623218 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.623119    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"
Jul 24 16:49:23.761543 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.761494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl"]
Jul 24 16:49:23.764462 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:49:23.764433    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bb3e7a_ac49_4df0_b5f4_b6db6e649168.slice/crio-7beed5ed0f2e6a757628d0015d8f5745756426c9f9bb03b6036f94e198b85e6a WatchSource:0}: Error finding container 7beed5ed0f2e6a757628d0015d8f5745756426c9f9bb03b6036f94e198b85e6a: Status 404 returned error can't find the container with id 7beed5ed0f2e6a757628d0015d8f5745756426c9f9bb03b6036f94e198b85e6a
Jul 24 16:49:23.787571 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:23.787542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl" event={"ID":"94bb3e7a-ac49-4df0-b5f4-b6db6e649168","Type":"ContainerStarted","Data":"7beed5ed0f2e6a757628d0015d8f5745756426c9f9bb03b6036f94e198b85e6a"}
Jul 24 16:49:25.797654 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:25.797622    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl" event={"ID":"94bb3e7a-ac49-4df0-b5f4-b6db6e649168","Type":"ContainerStarted","Data":"b1861d28ee993bf1bde0011088e7acd5d5dee4da43963458984209594b0a931a"}
Jul 24 16:49:26.802829 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:26.802790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl" event={"ID":"94bb3e7a-ac49-4df0-b5f4-b6db6e649168","Type":"ContainerStarted","Data":"acb0ea69619f4b47a0da8e0855a95a3aaa7f8534b389784c77ce3c54e39cdbf3"}
Jul 24 16:49:26.803196 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:26.802849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl" event={"ID":"94bb3e7a-ac49-4df0-b5f4-b6db6e649168","Type":"ContainerStarted","Data":"f5920723b4e1ebb726cba8c194cb9183e30cdeb5abd31895a248498bcd065656"}
Jul 24 16:49:26.826276 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:49:26.826210    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fc9f96ff9-wbxtl" podStartSLOduration=1.867510711 podStartE2EDuration="3.826189145s" totalImagesPullingTime="1.958678434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:49:26.82533505 +0000 UTC m=+388.056082497" watchObservedRunningTime="2026-07-24 16:49:26.826189145 +0000 UTC m=+388.056936574"
Jul 24 16:52:02.455103 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.454986    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"]
Jul 24 16:52:02.458335 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.458313    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"
Jul 24 16:52:02.463784 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.463761    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fgn77\""
Jul 24 16:52:02.463784 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.463776    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:52:02.463972 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.463762    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 16:52:02.478681 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.478648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"]
Jul 24 16:52:02.569731 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.569694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgf7\" (UniqueName: \"kubernetes.io/projected/ffafa364-d20b-465c-87a2-c6e6c35f271b-kube-api-access-zrgf7\") pod \"cert-manager-operator-controller-manager-55c444bf86-rlsb2\" (UID: \"ffafa364-d20b-465c-87a2-c6e6c35f271b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"
Jul 24 16:52:02.569731 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.569736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffafa364-d20b-465c-87a2-c6e6c35f271b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rlsb2\" (UID: \"ffafa364-d20b-465c-87a2-c6e6c35f271b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"
Jul 24 16:52:02.670233 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.670194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgf7\" (UniqueName: \"kubernetes.io/projected/ffafa364-d20b-465c-87a2-c6e6c35f271b-kube-api-access-zrgf7\") pod \"cert-manager-operator-controller-manager-55c444bf86-rlsb2\" (UID: \"ffafa364-d20b-465c-87a2-c6e6c35f271b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"
Jul 24 16:52:02.670400 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.670242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffafa364-d20b-465c-87a2-c6e6c35f271b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rlsb2\" (UID: \"ffafa364-d20b-465c-87a2-c6e6c35f271b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"
Jul 24 16:52:02.670684 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.670662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffafa364-d20b-465c-87a2-c6e6c35f271b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rlsb2\" (UID: \"ffafa364-d20b-465c-87a2-c6e6c35f271b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"
Jul 24 16:52:02.679337 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.679314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgf7\" (UniqueName: \"kubernetes.io/projected/ffafa364-d20b-465c-87a2-c6e6c35f271b-kube-api-access-zrgf7\") pod \"cert-manager-operator-controller-manager-55c444bf86-rlsb2\" (UID: \"ffafa364-d20b-465c-87a2-c6e6c35f271b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"
Jul 24 16:52:02.766976 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.766941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"
Jul 24 16:52:02.917145 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:02.914407    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2"]
Jul 24 16:52:02.917628 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:52:02.917598    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffafa364_d20b_465c_87a2_c6e6c35f271b.slice/crio-fdbb3b0f591a9ffd6494146c93b1ccd0c8d54922769308a6d5cba6ec8ebd84dd WatchSource:0}: Error finding container fdbb3b0f591a9ffd6494146c93b1ccd0c8d54922769308a6d5cba6ec8ebd84dd: Status 404 returned error can't find the container with id fdbb3b0f591a9ffd6494146c93b1ccd0c8d54922769308a6d5cba6ec8ebd84dd
Jul 24 16:52:03.360984 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:03.360948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2" event={"ID":"ffafa364-d20b-465c-87a2-c6e6c35f271b","Type":"ContainerStarted","Data":"fdbb3b0f591a9ffd6494146c93b1ccd0c8d54922769308a6d5cba6ec8ebd84dd"}
Jul 24 16:52:06.375872 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:06.375834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2" event={"ID":"ffafa364-d20b-465c-87a2-c6e6c35f271b","Type":"ContainerStarted","Data":"437934a72e9cb00386157d24135dd8d6fd5fb55e55b2e2429f0098e47eaf66b8"}
Jul 24 16:52:06.417383 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:06.417326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rlsb2" podStartSLOduration=1.7481986809999999 podStartE2EDuration="4.417309536s" totalImagesPullingTime="2.669110855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:06.417178693 +0000 UTC m=+547.647926119" watchObservedRunningTime="2026-07-24 16:52:06.417309536 +0000 UTC m=+547.648056962"
Jul 24 16:52:07.051610 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.051570    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"]
Jul 24 16:52:07.054961 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.054943    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.058256 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.058233    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 16:52:07.058379 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.058335    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kmbf5\""
Jul 24 16:52:07.065880 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.065847    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 16:52:07.110009 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.109970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.110166 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.110024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxz5\" (UniqueName: \"kubernetes.io/projected/6761e036-aea6-48ad-bfe2-ff29bc09d364-kube-api-access-rpxz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.110166 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.110081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.134191 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.134158    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"]
Jul 24 16:52:07.210991 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.210952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxz5\" (UniqueName: \"kubernetes.io/projected/6761e036-aea6-48ad-bfe2-ff29bc09d364-kube-api-access-rpxz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.210991 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.210998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.211250 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.211049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.211379 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.211362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.211429 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.211398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.233843 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.233817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxz5\" (UniqueName: \"kubernetes.io/projected/6761e036-aea6-48ad-bfe2-ff29bc09d364-kube-api-access-rpxz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.364217 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.364123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:07.498554 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:07.498528    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"]
Jul 24 16:52:07.500461 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:52:07.500429    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6761e036_aea6_48ad_bfe2_ff29bc09d364.slice/crio-2d6c2a6fafffb23cea87d09abad104db9c3ee2a71267f98cec0758c47ab15257 WatchSource:0}: Error finding container 2d6c2a6fafffb23cea87d09abad104db9c3ee2a71267f98cec0758c47ab15257: Status 404 returned error can't find the container with id 2d6c2a6fafffb23cea87d09abad104db9c3ee2a71267f98cec0758c47ab15257
Jul 24 16:52:08.386028 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:08.385992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx" event={"ID":"6761e036-aea6-48ad-bfe2-ff29bc09d364","Type":"ContainerStarted","Data":"2d6c2a6fafffb23cea87d09abad104db9c3ee2a71267f98cec0758c47ab15257"}
Jul 24 16:52:14.415326 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:14.415293    2578 generic.go:356] "Generic (PLEG): container finished" podID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerID="7567c0453db46fd79a7ce3449771a7e7524fb1beb98da77cdfbf1c9f9250e405" exitCode=0
Jul 24 16:52:14.415748 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:14.415393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx" event={"ID":"6761e036-aea6-48ad-bfe2-ff29bc09d364","Type":"ContainerDied","Data":"7567c0453db46fd79a7ce3449771a7e7524fb1beb98da77cdfbf1c9f9250e405"}
Jul 24 16:52:17.231142 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.231105    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pprtq"]
Jul 24 16:52:17.234325 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.234307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pprtq"
Jul 24 16:52:17.236599 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.236561    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 16:52:17.236706 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.236660    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 16:52:17.237299 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.237283    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8q79d\""
Jul 24 16:52:17.243913 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.243890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pprtq"]
Jul 24 16:52:17.303078 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.303045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7665ec4e-1ebb-4ef6-a1ff-32022f239a71-bound-sa-token\") pod \"cert-manager-55b4d954d5-pprtq\" (UID: \"7665ec4e-1ebb-4ef6-a1ff-32022f239a71\") " pod="cert-manager/cert-manager-55b4d954d5-pprtq"
Jul 24 16:52:17.303220 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.303100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-688vg\" (UniqueName: \"kubernetes.io/projected/7665ec4e-1ebb-4ef6-a1ff-32022f239a71-kube-api-access-688vg\") pod \"cert-manager-55b4d954d5-pprtq\" (UID: \"7665ec4e-1ebb-4ef6-a1ff-32022f239a71\") " pod="cert-manager/cert-manager-55b4d954d5-pprtq"
Jul 24 16:52:17.404252 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.404211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7665ec4e-1ebb-4ef6-a1ff-32022f239a71-bound-sa-token\") pod \"cert-manager-55b4d954d5-pprtq\" (UID: \"7665ec4e-1ebb-4ef6-a1ff-32022f239a71\") " pod="cert-manager/cert-manager-55b4d954d5-pprtq"
Jul 24 16:52:17.404420 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.404269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-688vg\" (UniqueName: \"kubernetes.io/projected/7665ec4e-1ebb-4ef6-a1ff-32022f239a71-kube-api-access-688vg\") pod \"cert-manager-55b4d954d5-pprtq\" (UID: \"7665ec4e-1ebb-4ef6-a1ff-32022f239a71\") " pod="cert-manager/cert-manager-55b4d954d5-pprtq"
Jul 24 16:52:17.413038 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.413000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7665ec4e-1ebb-4ef6-a1ff-32022f239a71-bound-sa-token\") pod \"cert-manager-55b4d954d5-pprtq\" (UID: \"7665ec4e-1ebb-4ef6-a1ff-32022f239a71\") " pod="cert-manager/cert-manager-55b4d954d5-pprtq"
Jul 24 16:52:17.413153 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.413069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-688vg\" (UniqueName: \"kubernetes.io/projected/7665ec4e-1ebb-4ef6-a1ff-32022f239a71-kube-api-access-688vg\") pod \"cert-manager-55b4d954d5-pprtq\" (UID: \"7665ec4e-1ebb-4ef6-a1ff-32022f239a71\") " pod="cert-manager/cert-manager-55b4d954d5-pprtq"
Jul 24 16:52:17.429891 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.429848    2578 generic.go:356] "Generic (PLEG): container finished" podID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerID="c25e47cb8319d4660946e2d79b24a81b0f4747abf18d776627111aac5b4bcdef" exitCode=0
Jul 24 16:52:17.430023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.429898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx" event={"ID":"6761e036-aea6-48ad-bfe2-ff29bc09d364","Type":"ContainerDied","Data":"c25e47cb8319d4660946e2d79b24a81b0f4747abf18d776627111aac5b4bcdef"}
Jul 24 16:52:17.543232 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.543125    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pprtq"
Jul 24 16:52:17.672164 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:17.672138    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pprtq"]
Jul 24 16:52:17.674266 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:52:17.674236    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7665ec4e_1ebb_4ef6_a1ff_32022f239a71.slice/crio-5a922a15768145d0b8d81ba6165c5c9dc4a85cf7a975e5a61004160eb6e299b2 WatchSource:0}: Error finding container 5a922a15768145d0b8d81ba6165c5c9dc4a85cf7a975e5a61004160eb6e299b2: Status 404 returned error can't find the container with id 5a922a15768145d0b8d81ba6165c5c9dc4a85cf7a975e5a61004160eb6e299b2
Jul 24 16:52:18.434684 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:18.434646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pprtq" event={"ID":"7665ec4e-1ebb-4ef6-a1ff-32022f239a71","Type":"ContainerStarted","Data":"5a922a15768145d0b8d81ba6165c5c9dc4a85cf7a975e5a61004160eb6e299b2"}
Jul 24 16:52:21.456397 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:21.456355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pprtq" event={"ID":"7665ec4e-1ebb-4ef6-a1ff-32022f239a71","Type":"ContainerStarted","Data":"da0d771ea26566c895123f499addda3ca2a451d8dd896e63652e08851c27f9a3"}
Jul 24 16:52:21.474820 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:21.474755    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pprtq" podStartSLOduration=1.457273288 podStartE2EDuration="4.474734391s" totalImagesPullingTime="3.017461103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:21.473335228 +0000 UTC m=+562.704082659" watchObservedRunningTime="2026-07-24 16:52:21.474734391 +0000 UTC m=+562.705481817"
Jul 24 16:52:24.472641 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:24.472600    2578 generic.go:356] "Generic (PLEG): container finished" podID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerID="a6c47390434a86fececc50274788292c65eaaa375c2e1fab8e3e779d94511649" exitCode=0
Jul 24 16:52:24.473080 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:24.472663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx" event={"ID":"6761e036-aea6-48ad-bfe2-ff29bc09d364","Type":"ContainerDied","Data":"a6c47390434a86fececc50274788292c65eaaa375c2e1fab8e3e779d94511649"}
Jul 24 16:52:25.608985 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.608955    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:25.680580 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.680543    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-util\") pod \"6761e036-aea6-48ad-bfe2-ff29bc09d364\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") "
Jul 24 16:52:25.680580 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.680592    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-bundle\") pod \"6761e036-aea6-48ad-bfe2-ff29bc09d364\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") "
Jul 24 16:52:25.680815 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.680664    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpxz5\" (UniqueName: \"kubernetes.io/projected/6761e036-aea6-48ad-bfe2-ff29bc09d364-kube-api-access-rpxz5\") pod \"6761e036-aea6-48ad-bfe2-ff29bc09d364\" (UID: \"6761e036-aea6-48ad-bfe2-ff29bc09d364\") "
Jul 24 16:52:25.680992 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.680966    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-bundle" (OuterVolumeSpecName: "bundle") pod "6761e036-aea6-48ad-bfe2-ff29bc09d364" (UID: "6761e036-aea6-48ad-bfe2-ff29bc09d364"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:52:25.683056 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.683030    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6761e036-aea6-48ad-bfe2-ff29bc09d364-kube-api-access-rpxz5" (OuterVolumeSpecName: "kube-api-access-rpxz5") pod "6761e036-aea6-48ad-bfe2-ff29bc09d364" (UID: "6761e036-aea6-48ad-bfe2-ff29bc09d364"). InnerVolumeSpecName "kube-api-access-rpxz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:25.684562 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.684541    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-util" (OuterVolumeSpecName: "util") pod "6761e036-aea6-48ad-bfe2-ff29bc09d364" (UID: "6761e036-aea6-48ad-bfe2-ff29bc09d364"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:52:25.781863 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.781776    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpxz5\" (UniqueName: \"kubernetes.io/projected/6761e036-aea6-48ad-bfe2-ff29bc09d364-kube-api-access-rpxz5\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:52:25.781863 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.781807    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-util\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:52:25.781863 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:25.781818    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6761e036-aea6-48ad-bfe2-ff29bc09d364-bundle\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:52:26.482159 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:26.482122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx" event={"ID":"6761e036-aea6-48ad-bfe2-ff29bc09d364","Type":"ContainerDied","Data":"2d6c2a6fafffb23cea87d09abad104db9c3ee2a71267f98cec0758c47ab15257"}
Jul 24 16:52:26.482159 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:26.482148    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92bhx"
Jul 24 16:52:26.482159 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:26.482167    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d6c2a6fafffb23cea87d09abad104db9c3ee2a71267f98cec0758c47ab15257"
Jul 24 16:52:30.003266 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.003229    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"]
Jul 24 16:52:30.003665 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.003488    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerName="util"
Jul 24 16:52:30.003665 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.003500    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerName="util"
Jul 24 16:52:30.003665 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.003526    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerName="pull"
Jul 24 16:52:30.003665 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.003532    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerName="pull"
Jul 24 16:52:30.003665 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.003546    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerName="extract"
Jul 24 16:52:30.003665 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.003552    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerName="extract"
Jul 24 16:52:30.003665 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.003601    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6761e036-aea6-48ad-bfe2-ff29bc09d364" containerName="extract"
Jul 24 16:52:30.059117 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.059083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"]
Jul 24 16:52:30.059272 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.059183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"
Jul 24 16:52:30.061414 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.061391    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:52:30.062280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.062265    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 16:52:30.062387 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.062366    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cgkhm\""
Jul 24 16:52:30.216871 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.216829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmsf6\" (UniqueName: \"kubernetes.io/projected/899c5672-95d5-4a45-b5dd-d74edd65cf16-kube-api-access-bmsf6\") pod \"openshift-lws-operator-fd8ccff4c-f4sqk\" (UID: \"899c5672-95d5-4a45-b5dd-d74edd65cf16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"
Jul 24 16:52:30.216871 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.216878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899c5672-95d5-4a45-b5dd-d74edd65cf16-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f4sqk\" (UID: \"899c5672-95d5-4a45-b5dd-d74edd65cf16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"
Jul 24 16:52:30.318269 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.318176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmsf6\" (UniqueName: \"kubernetes.io/projected/899c5672-95d5-4a45-b5dd-d74edd65cf16-kube-api-access-bmsf6\") pod \"openshift-lws-operator-fd8ccff4c-f4sqk\" (UID: \"899c5672-95d5-4a45-b5dd-d74edd65cf16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"
Jul 24 16:52:30.318269 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.318227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899c5672-95d5-4a45-b5dd-d74edd65cf16-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f4sqk\" (UID: \"899c5672-95d5-4a45-b5dd-d74edd65cf16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"
Jul 24 16:52:30.318647 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.318629    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899c5672-95d5-4a45-b5dd-d74edd65cf16-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f4sqk\" (UID: \"899c5672-95d5-4a45-b5dd-d74edd65cf16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"
Jul 24 16:52:30.326409 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.326383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmsf6\" (UniqueName: \"kubernetes.io/projected/899c5672-95d5-4a45-b5dd-d74edd65cf16-kube-api-access-bmsf6\") pod \"openshift-lws-operator-fd8ccff4c-f4sqk\" (UID: \"899c5672-95d5-4a45-b5dd-d74edd65cf16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"
Jul 24 16:52:30.368388 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.368361    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"
Jul 24 16:52:30.516320 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:30.516289    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk"]
Jul 24 16:52:30.518935 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:52:30.518908    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod899c5672_95d5_4a45_b5dd_d74edd65cf16.slice/crio-c9de5859844355091ad377b024d47bad2f7245c225544cd5650c5596de751d78 WatchSource:0}: Error finding container c9de5859844355091ad377b024d47bad2f7245c225544cd5650c5596de751d78: Status 404 returned error can't find the container with id c9de5859844355091ad377b024d47bad2f7245c225544cd5650c5596de751d78
Jul 24 16:52:31.503963 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:31.503930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk" event={"ID":"899c5672-95d5-4a45-b5dd-d74edd65cf16","Type":"ContainerStarted","Data":"c9de5859844355091ad377b024d47bad2f7245c225544cd5650c5596de751d78"}
Jul 24 16:52:33.514771 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:33.514729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk" event={"ID":"899c5672-95d5-4a45-b5dd-d74edd65cf16","Type":"ContainerStarted","Data":"120a6d1ee3416ea9809a6d2fba602549066b73a097052bc37b9ed75cb3070dc2"}
Jul 24 16:52:33.532311 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:33.532259    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f4sqk" podStartSLOduration=2.333990895 podStartE2EDuration="4.532243696s" totalImagesPullingTime="2.198252801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:33.529996718 +0000 UTC m=+574.760744142" watchObservedRunningTime="2026-07-24 16:52:33.532243696 +0000 UTC m=+574.762991123"
Jul 24 16:52:36.009015 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.008978    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"]
Jul 24 16:52:36.025915 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.025868    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"]
Jul 24 16:52:36.026069 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.025998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.028425 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.028405    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 16:52:36.029238 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.029210    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kmbf5\""
Jul 24 16:52:36.029345 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.029264    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 16:52:36.167872 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.167827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.168042 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.167883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tknkx\" (UniqueName: \"kubernetes.io/projected/9b20b6b0-32a9-44d3-b25c-4403236837f8-kube-api-access-tknkx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.168042 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.167905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.269386 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.269298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.269386 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.269340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tknkx\" (UniqueName: \"kubernetes.io/projected/9b20b6b0-32a9-44d3-b25c-4403236837f8-kube-api-access-tknkx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.269386 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.269363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.269773 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.269747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.269811 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.269752    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.278378 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.278354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tknkx\" (UniqueName: \"kubernetes.io/projected/9b20b6b0-32a9-44d3-b25c-4403236837f8-kube-api-access-tknkx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.335328 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.335292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:36.487777 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.487753    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"]
Jul 24 16:52:36.490465 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:52:36.490438    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b20b6b0_32a9_44d3_b25c_4403236837f8.slice/crio-bec87542a1ca32e2048f072bef42328feffa1cc970dc4da165f0b888b1cf3ab9 WatchSource:0}: Error finding container bec87542a1ca32e2048f072bef42328feffa1cc970dc4da165f0b888b1cf3ab9: Status 404 returned error can't find the container with id bec87542a1ca32e2048f072bef42328feffa1cc970dc4da165f0b888b1cf3ab9
Jul 24 16:52:36.528743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:36.528713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x" event={"ID":"9b20b6b0-32a9-44d3-b25c-4403236837f8","Type":"ContainerStarted","Data":"bec87542a1ca32e2048f072bef42328feffa1cc970dc4da165f0b888b1cf3ab9"}
Jul 24 16:52:37.534838 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:37.534754    2578 generic.go:356] "Generic (PLEG): container finished" podID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerID="af6094e8476e75d86bc9c3473914ea8433151593fda4450d7472e2c4fd43c82b" exitCode=0
Jul 24 16:52:37.535176 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:37.534841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x" event={"ID":"9b20b6b0-32a9-44d3-b25c-4403236837f8","Type":"ContainerDied","Data":"af6094e8476e75d86bc9c3473914ea8433151593fda4450d7472e2c4fd43c82b"}
Jul 24 16:52:39.545389 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:39.545352    2578 generic.go:356] "Generic (PLEG): container finished" podID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerID="55af48529caf50436b3eb1ee8df860351e8925d9bcd33cece813f1edf52f2298" exitCode=0
Jul 24 16:52:39.545889 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:39.545407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x" event={"ID":"9b20b6b0-32a9-44d3-b25c-4403236837f8","Type":"ContainerDied","Data":"55af48529caf50436b3eb1ee8df860351e8925d9bcd33cece813f1edf52f2298"}
Jul 24 16:52:40.551691 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:40.551655    2578 generic.go:356] "Generic (PLEG): container finished" podID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerID="7759943deac1d520d9c3fea46f98da42cde8bc026de7d5826c65acd5ebc31520" exitCode=0
Jul 24 16:52:40.552122 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:40.551743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x" event={"ID":"9b20b6b0-32a9-44d3-b25c-4403236837f8","Type":"ContainerDied","Data":"7759943deac1d520d9c3fea46f98da42cde8bc026de7d5826c65acd5ebc31520"}
Jul 24 16:52:41.679009 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.678985    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:41.715191 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.715160    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tknkx\" (UniqueName: \"kubernetes.io/projected/9b20b6b0-32a9-44d3-b25c-4403236837f8-kube-api-access-tknkx\") pod \"9b20b6b0-32a9-44d3-b25c-4403236837f8\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") "
Jul 24 16:52:41.715352 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.715217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-util\") pod \"9b20b6b0-32a9-44d3-b25c-4403236837f8\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") "
Jul 24 16:52:41.715352 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.715234    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-bundle\") pod \"9b20b6b0-32a9-44d3-b25c-4403236837f8\" (UID: \"9b20b6b0-32a9-44d3-b25c-4403236837f8\") "
Jul 24 16:52:41.715970 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.715936    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-bundle" (OuterVolumeSpecName: "bundle") pod "9b20b6b0-32a9-44d3-b25c-4403236837f8" (UID: "9b20b6b0-32a9-44d3-b25c-4403236837f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:52:41.717349 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.717322    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b20b6b0-32a9-44d3-b25c-4403236837f8-kube-api-access-tknkx" (OuterVolumeSpecName: "kube-api-access-tknkx") pod "9b20b6b0-32a9-44d3-b25c-4403236837f8" (UID: "9b20b6b0-32a9-44d3-b25c-4403236837f8"). InnerVolumeSpecName "kube-api-access-tknkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:41.720724 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.720690    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-util" (OuterVolumeSpecName: "util") pod "9b20b6b0-32a9-44d3-b25c-4403236837f8" (UID: "9b20b6b0-32a9-44d3-b25c-4403236837f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:52:41.815797 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.815712    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tknkx\" (UniqueName: \"kubernetes.io/projected/9b20b6b0-32a9-44d3-b25c-4403236837f8-kube-api-access-tknkx\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:52:41.815797 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.815740    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-util\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:52:41.815797 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:41.815751    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b20b6b0-32a9-44d3-b25c-4403236837f8-bundle\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:52:42.560931 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:42.560902    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x"
Jul 24 16:52:42.561093 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:42.560903    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjj8x" event={"ID":"9b20b6b0-32a9-44d3-b25c-4403236837f8","Type":"ContainerDied","Data":"bec87542a1ca32e2048f072bef42328feffa1cc970dc4da165f0b888b1cf3ab9"}
Jul 24 16:52:42.561093 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:42.561013    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bec87542a1ca32e2048f072bef42328feffa1cc970dc4da165f0b888b1cf3ab9"
Jul 24 16:52:52.916379 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.916337    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"]
Jul 24 16:52:52.917030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.916744    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerName="util"
Jul 24 16:52:52.917030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.916762    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerName="util"
Jul 24 16:52:52.917030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.916777    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerName="extract"
Jul 24 16:52:52.917030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.916786    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerName="extract"
Jul 24 16:52:52.917030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.916810    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerName="pull"
Jul 24 16:52:52.917030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.916818    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerName="pull"
Jul 24 16:52:52.917030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.916905    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b20b6b0-32a9-44d3-b25c-4403236837f8" containerName="extract"
Jul 24 16:52:52.919155 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.919130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:52.922099 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.922078    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 16:52:52.922334 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.922313    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 16:52:52.922431 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.922389    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 16:52:52.922431 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.922406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 16:52:52.922536 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.922477    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pvp4m\""
Jul 24 16:52:52.937195 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:52.937158    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"]
Jul 24 16:52:53.010481 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.010444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c01803c-2d9b-4815-831b-8988789e570c-manifests\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.010481 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.010482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h9qk\" (UniqueName: \"kubernetes.io/projected/8c01803c-2d9b-4815-831b-8988789e570c-kube-api-access-7h9qk\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.010705 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.010503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c01803c-2d9b-4815-831b-8988789e570c-tmp\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.010705 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.010540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c01803c-2d9b-4815-831b-8988789e570c-webhook-cert\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.010705 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.010593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c01803c-2d9b-4815-831b-8988789e570c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.111077 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.111025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c01803c-2d9b-4815-831b-8988789e570c-manifests\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.111077 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.111078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h9qk\" (UniqueName: \"kubernetes.io/projected/8c01803c-2d9b-4815-831b-8988789e570c-kube-api-access-7h9qk\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.111295 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.111103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c01803c-2d9b-4815-831b-8988789e570c-tmp\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.111295 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.111125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c01803c-2d9b-4815-831b-8988789e570c-webhook-cert\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.111295 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.111168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c01803c-2d9b-4815-831b-8988789e570c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.111576 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.111505    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c01803c-2d9b-4815-831b-8988789e570c-manifests\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.113336 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.113312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c01803c-2d9b-4815-831b-8988789e570c-tmp\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.113643 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.113624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c01803c-2d9b-4815-831b-8988789e570c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.113689 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.113642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c01803c-2d9b-4815-831b-8988789e570c-webhook-cert\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.122594 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.122571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h9qk\" (UniqueName: \"kubernetes.io/projected/8c01803c-2d9b-4815-831b-8988789e570c-kube-api-access-7h9qk\") pod \"opendatahub-operator-controller-manager-769b58b787-drghp\" (UID: \"8c01803c-2d9b-4815-831b-8988789e570c\") " pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.229654 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.229624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:53.387663 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.387584    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"]
Jul 24 16:52:53.390751 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:52:53.390724    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c01803c_2d9b_4815_831b_8988789e570c.slice/crio-b4eda827823b364f8a076b7a383d446dd64fb6126832d13dd99b112be7bfd8c4 WatchSource:0}: Error finding container b4eda827823b364f8a076b7a383d446dd64fb6126832d13dd99b112be7bfd8c4: Status 404 returned error can't find the container with id b4eda827823b364f8a076b7a383d446dd64fb6126832d13dd99b112be7bfd8c4
Jul 24 16:52:53.613388 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:53.613301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp" event={"ID":"8c01803c-2d9b-4815-831b-8988789e570c","Type":"ContainerStarted","Data":"b4eda827823b364f8a076b7a383d446dd64fb6126832d13dd99b112be7bfd8c4"}
Jul 24 16:52:57.636392 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:57.636355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp" event={"ID":"8c01803c-2d9b-4815-831b-8988789e570c","Type":"ContainerStarted","Data":"5b2588bb3a4f26d5f12fa523f4a2080fd2e7f69c9ca25025e64e6c49bdd4dae2"}
Jul 24 16:52:58.643227 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:58.643188    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c01803c-2d9b-4815-831b-8988789e570c" containerID="5b2588bb3a4f26d5f12fa523f4a2080fd2e7f69c9ca25025e64e6c49bdd4dae2" exitCode=0
Jul 24 16:52:58.643618 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:58.643243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp" event={"ID":"8c01803c-2d9b-4815-831b-8988789e570c","Type":"ContainerDied","Data":"5b2588bb3a4f26d5f12fa523f4a2080fd2e7f69c9ca25025e64e6c49bdd4dae2"}
Jul 24 16:52:59.649075 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:59.649039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp" event={"ID":"8c01803c-2d9b-4815-831b-8988789e570c","Type":"ContainerStarted","Data":"34c45d21df92670d71ca964e02481ded615539265950c6ed35810561aefec9be"}
Jul 24 16:52:59.650626 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:59.649164    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:52:59.673423 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:52:59.673375    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp" podStartSLOduration=3.047193526 podStartE2EDuration="7.673360739s" totalImagesPullingTime="3.529981684s" totalInitContainerRuntime="1.096185529s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:59.672024586 +0000 UTC m=+600.902772012" watchObservedRunningTime="2026-07-24 16:52:59.673360739 +0000 UTC m=+600.904108160"
Jul 24 16:53:10.655556 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:10.655501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-769b58b787-drghp"
Jul 24 16:53:13.149224 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.149191    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"]
Jul 24 16:53:13.154404 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.154380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.157718 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.157695    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 16:53:13.157820 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.157745    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 16:53:13.158115 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.158091    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 16:53:13.159421 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.159402    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f9z7v\""
Jul 24 16:53:13.159798 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.159781    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 16:53:13.184026 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.184000    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"]
Jul 24 16:53:13.294221 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.294186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/463eac62-9a2d-43e5-86b3-979072b24091-tls-certs\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.294381 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.294223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz6tn\" (UniqueName: \"kubernetes.io/projected/463eac62-9a2d-43e5-86b3-979072b24091-kube-api-access-nz6tn\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.294381 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.294253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/463eac62-9a2d-43e5-86b3-979072b24091-tmp\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.395110 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.395063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/463eac62-9a2d-43e5-86b3-979072b24091-tls-certs\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.395310 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.395114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz6tn\" (UniqueName: \"kubernetes.io/projected/463eac62-9a2d-43e5-86b3-979072b24091-kube-api-access-nz6tn\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.395310 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.395164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/463eac62-9a2d-43e5-86b3-979072b24091-tmp\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.397419 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.397391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/463eac62-9a2d-43e5-86b3-979072b24091-tmp\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.397531 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.397429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/463eac62-9a2d-43e5-86b3-979072b24091-tls-certs\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.415470 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.415414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz6tn\" (UniqueName: \"kubernetes.io/projected/463eac62-9a2d-43e5-86b3-979072b24091-kube-api-access-nz6tn\") pod \"kube-auth-proxy-6cb5df4894-7xdl8\" (UID: \"463eac62-9a2d-43e5-86b3-979072b24091\") " pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.453702 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.453671    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tfl6s"]
Jul 24 16:53:13.456054 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.456037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:13.459035 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.459019    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jtw5l\""
Jul 24 16:53:13.459641 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.459626    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 24 16:53:13.463885 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.463866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"
Jul 24 16:53:13.480213 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.480158    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tfl6s"]
Jul 24 16:53:13.595708 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.595681    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8"]
Jul 24 16:53:13.597008 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.596976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20-cert\") pod \"odh-model-controller-7998c67dc4-tfl6s\" (UID: \"c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20\") " pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:13.597145 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.597051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r944\" (UniqueName: \"kubernetes.io/projected/c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20-kube-api-access-9r944\") pod \"odh-model-controller-7998c67dc4-tfl6s\" (UID: \"c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20\") " pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:13.598386 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:53:13.598359    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463eac62_9a2d_43e5_86b3_979072b24091.slice/crio-aaf82ab0b1d4ba3e0f329d45289b99fe5413f5b0fec398f52cf17afc457c7d48 WatchSource:0}: Error finding container aaf82ab0b1d4ba3e0f329d45289b99fe5413f5b0fec398f52cf17afc457c7d48: Status 404 returned error can't find the container with id aaf82ab0b1d4ba3e0f329d45289b99fe5413f5b0fec398f52cf17afc457c7d48
Jul 24 16:53:13.600190 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.600177    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:53:13.697802 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.697708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r944\" (UniqueName: \"kubernetes.io/projected/c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20-kube-api-access-9r944\") pod \"odh-model-controller-7998c67dc4-tfl6s\" (UID: \"c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20\") " pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:13.697957 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.697885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20-cert\") pod \"odh-model-controller-7998c67dc4-tfl6s\" (UID: \"c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20\") " pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:13.700252 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.700224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20-cert\") pod \"odh-model-controller-7998c67dc4-tfl6s\" (UID: \"c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20\") " pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:13.705102 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.705075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r944\" (UniqueName: \"kubernetes.io/projected/c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20-kube-api-access-9r944\") pod \"odh-model-controller-7998c67dc4-tfl6s\" (UID: \"c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20\") " pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:13.711900 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.711875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8" event={"ID":"463eac62-9a2d-43e5-86b3-979072b24091","Type":"ContainerStarted","Data":"aaf82ab0b1d4ba3e0f329d45289b99fe5413f5b0fec398f52cf17afc457c7d48"}
Jul 24 16:53:13.765323 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.765290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:13.903532 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:13.903479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tfl6s"]
Jul 24 16:53:13.906215 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:53:13.906186    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7af6b9f_fa28_4f7f_9e1d_10c71f27cc20.slice/crio-43d1e79566c0bf75e27f030087bbf624871579e4e0dcca95e2016df5f726c1eb WatchSource:0}: Error finding container 43d1e79566c0bf75e27f030087bbf624871579e4e0dcca95e2016df5f726c1eb: Status 404 returned error can't find the container with id 43d1e79566c0bf75e27f030087bbf624871579e4e0dcca95e2016df5f726c1eb
Jul 24 16:53:14.328700 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.328667    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wk2gn"]
Jul 24 16:53:14.331119 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.331099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:14.333337 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.333316    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 16:53:14.342017 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.341958    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wk2gn"]
Jul 24 16:53:14.467978 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.467940    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"]
Jul 24 16:53:14.470322 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.470297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.473233 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.473211    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5sh9k\""
Jul 24 16:53:14.473569 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.473544    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 16:53:14.473680 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.473587    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 16:53:14.473680 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.473600    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 16:53:14.473680 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.473591    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 16:53:14.484213 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.484192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"]
Jul 24 16:53:14.505389 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.505340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2vlz\" (UniqueName: \"kubernetes.io/projected/33c1aa64-4544-4eac-8c8a-719dfd10f516-kube-api-access-z2vlz\") pod \"model-serving-api-54d89bd5fc-wk2gn\" (UID: \"33c1aa64-4544-4eac-8c8a-719dfd10f516\") " pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:14.505582 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.505480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c1aa64-4544-4eac-8c8a-719dfd10f516-tls-certs\") pod \"model-serving-api-54d89bd5fc-wk2gn\" (UID: \"33c1aa64-4544-4eac-8c8a-719dfd10f516\") " pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:14.606426 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.606426 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.606656 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.606656 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2vlz\" (UniqueName: \"kubernetes.io/projected/33c1aa64-4544-4eac-8c8a-719dfd10f516-kube-api-access-z2vlz\") pod \"model-serving-api-54d89bd5fc-wk2gn\" (UID: \"33c1aa64-4544-4eac-8c8a-719dfd10f516\") " pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:14.606656 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.606796 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c1aa64-4544-4eac-8c8a-719dfd10f516-tls-certs\") pod \"model-serving-api-54d89bd5fc-wk2gn\" (UID: \"33c1aa64-4544-4eac-8c8a-719dfd10f516\") " pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:14.606796 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.606796 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mlsp\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-kube-api-access-8mlsp\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.606930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.606815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.606989 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:53:14.606973    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 24 16:53:14.607193 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:53:14.607167    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c1aa64-4544-4eac-8c8a-719dfd10f516-tls-certs podName:33c1aa64-4544-4eac-8c8a-719dfd10f516 nodeName:}" failed. No retries permitted until 2026-07-24 16:53:15.107145311 +0000 UTC m=+616.337892716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/33c1aa64-4544-4eac-8c8a-719dfd10f516-tls-certs") pod "model-serving-api-54d89bd5fc-wk2gn" (UID: "33c1aa64-4544-4eac-8c8a-719dfd10f516") : secret "model-serving-api-tls" not found
Jul 24 16:53:14.615802 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.615742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2vlz\" (UniqueName: \"kubernetes.io/projected/33c1aa64-4544-4eac-8c8a-719dfd10f516-kube-api-access-z2vlz\") pod \"model-serving-api-54d89bd5fc-wk2gn\" (UID: \"33c1aa64-4544-4eac-8c8a-719dfd10f516\") " pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:14.707533 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.707484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.707713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.707570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.707713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.707609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mlsp\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-kube-api-access-8mlsp\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.707713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.707640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.707713 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.707684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.707915 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.707730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.707915 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.707788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.708809 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.708777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.711005 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.710980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.711114 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.711080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.711297 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.711272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.711859 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.711827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.730684 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.730644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s" event={"ID":"c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20","Type":"ContainerStarted","Data":"43d1e79566c0bf75e27f030087bbf624871579e4e0dcca95e2016df5f726c1eb"}
Jul 24 16:53:14.732360 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.732232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mlsp\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-kube-api-access-8mlsp\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.737871 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.737834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-72sk8\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.779949 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.779911    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:14.963800 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:14.963725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"]
Jul 24 16:53:14.966032 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:53:14.966001    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfa1ffa_8a99_4015_85d7_9d0baebf0456.slice/crio-f348f18b79272e87131024ff01eb5827baa7959c963db2b0dea6dc86d2237158 WatchSource:0}: Error finding container f348f18b79272e87131024ff01eb5827baa7959c963db2b0dea6dc86d2237158: Status 404 returned error can't find the container with id f348f18b79272e87131024ff01eb5827baa7959c963db2b0dea6dc86d2237158
Jul 24 16:53:15.111949 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:15.111903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c1aa64-4544-4eac-8c8a-719dfd10f516-tls-certs\") pod \"model-serving-api-54d89bd5fc-wk2gn\" (UID: \"33c1aa64-4544-4eac-8c8a-719dfd10f516\") " pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:15.115123 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:15.115090    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33c1aa64-4544-4eac-8c8a-719dfd10f516-tls-certs\") pod \"model-serving-api-54d89bd5fc-wk2gn\" (UID: \"33c1aa64-4544-4eac-8c8a-719dfd10f516\") " pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:15.245068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:15.244962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:15.404656 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:15.404623    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wk2gn"]
Jul 24 16:53:15.415957 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:53:15.415902    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c1aa64_4544_4eac_8c8a_719dfd10f516.slice/crio-ef906a017255583eb1ca50a7f1d4d594ba56862d742b870d4b5f8d71650048ba WatchSource:0}: Error finding container ef906a017255583eb1ca50a7f1d4d594ba56862d742b870d4b5f8d71650048ba: Status 404 returned error can't find the container with id ef906a017255583eb1ca50a7f1d4d594ba56862d742b870d4b5f8d71650048ba
Jul 24 16:53:15.737525 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:15.737470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8" event={"ID":"4cfa1ffa-8a99-4015-85d7-9d0baebf0456","Type":"ContainerStarted","Data":"f348f18b79272e87131024ff01eb5827baa7959c963db2b0dea6dc86d2237158"}
Jul 24 16:53:15.738748 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:15.738708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn" event={"ID":"33c1aa64-4544-4eac-8c8a-719dfd10f516","Type":"ContainerStarted","Data":"ef906a017255583eb1ca50a7f1d4d594ba56862d742b870d4b5f8d71650048ba"}
Jul 24 16:53:18.758382 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:18.758335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8" event={"ID":"463eac62-9a2d-43e5-86b3-979072b24091","Type":"ContainerStarted","Data":"1e8a91c0fee73b61d3595dcae17a89439d220867e563d46916e613e5c5e339d9"}
Jul 24 16:53:18.774276 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:18.774052    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6cb5df4894-7xdl8" podStartSLOduration=1.823069989 podStartE2EDuration="5.774034985s" totalImagesPullingTime="3.950964996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:53:18.773815229 +0000 UTC m=+620.004562656" watchObservedRunningTime="2026-07-24 16:53:18.774034985 +0000 UTC m=+620.004782412"
Jul 24 16:53:19.077757 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.077720    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:53:19.077867 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.077803    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:53:19.764914 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.764874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8" event={"ID":"4cfa1ffa-8a99-4015-85d7-9d0baebf0456","Type":"ContainerStarted","Data":"17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40"}
Jul 24 16:53:19.765365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.764976    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:19.766898 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.766871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn" event={"ID":"33c1aa64-4544-4eac-8c8a-719dfd10f516","Type":"ContainerStarted","Data":"98df3e093aacb078b02bf830632375d5245aaa9f753c5fe4706a74ef3169a4da"}
Jul 24 16:53:19.767011 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.766926    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:19.769152 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.769104    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s" event={"ID":"c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20","Type":"ContainerStarted","Data":"bdfa7770406b25de7ef6cda14e41bbf9c95be4772113d6ccbb9da0155172925d"}
Jul 24 16:53:19.823058 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.823001    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8" podStartSLOduration=1.7142145549999999 podStartE2EDuration="5.822985553s" totalImagesPullingTime="4.108770998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:53:19.794280145 +0000 UTC m=+621.025027598" watchObservedRunningTime="2026-07-24 16:53:19.822985553 +0000 UTC m=+621.053732980"
Jul 24 16:53:19.823406 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.823382    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s" podStartSLOduration=2.597777342 podStartE2EDuration="6.823374594s" totalImagesPullingTime="4.225597252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:53:19.82191696 +0000 UTC m=+621.052664413" watchObservedRunningTime="2026-07-24 16:53:19.823374594 +0000 UTC m=+621.054122021"
Jul 24 16:53:19.856162 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:19.856108    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn" podStartSLOduration=2.259755506 podStartE2EDuration="5.856090927s" totalImagesPullingTime="3.596335421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:53:19.854686935 +0000 UTC m=+621.085434386" watchObservedRunningTime="2026-07-24 16:53:19.856090927 +0000 UTC m=+621.086838354"
Jul 24 16:53:20.774584 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.774552    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:20.776134 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.776108    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:20.777479 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.777455    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"]
Jul 24 16:53:20.781639 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.781620    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.784058 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.784038    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p4dwz\""
Jul 24 16:53:20.796210 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.796184    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"]
Jul 24 16:53:20.968203 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.968371 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.968371 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.968371 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.968371 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c87bbd3e-7be2-419c-bd53-c7c040e79897-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.968371 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.968571 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.968571 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrz6r\" (UniqueName: \"kubernetes.io/projected/c87bbd3e-7be2-419c-bd53-c7c040e79897-kube-api-access-mrz6r\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:20.968571 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:20.968474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069200 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069200 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrz6r\" (UniqueName: \"kubernetes.io/projected/c87bbd3e-7be2-419c-bd53-c7c040e79897-kube-api-access-mrz6r\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069438 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069438 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069438 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069438 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069438 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069438 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c87bbd3e-7be2-419c-bd53-c7c040e79897-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069774 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069774 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.069908 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.069880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.070076 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.070055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.070149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.070129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.070236 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.070221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c87bbd3e-7be2-419c-bd53-c7c040e79897-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.071688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.071668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.071786 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.071712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.080730 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.080707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrz6r\" (UniqueName: \"kubernetes.io/projected/c87bbd3e-7be2-419c-bd53-c7c040e79897-kube-api-access-mrz6r\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.081380 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.081362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c87bbd3e-7be2-419c-bd53-c7c040e79897-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f\" (UID: \"c87bbd3e-7be2-419c-bd53-c7c040e79897\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.091385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.091364    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:21.257148 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.257118    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"]
Jul 24 16:53:21.258447 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:53:21.258416    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87bbd3e_7be2_419c_bd53_c7c040e79897.slice/crio-fb3cf07bd5cc094867c14b2344d667f8b98298e6ac9ee6d29f5eb621de7666e6 WatchSource:0}: Error finding container fb3cf07bd5cc094867c14b2344d667f8b98298e6ac9ee6d29f5eb621de7666e6: Status 404 returned error can't find the container with id fb3cf07bd5cc094867c14b2344d667f8b98298e6ac9ee6d29f5eb621de7666e6
Jul 24 16:53:21.779804 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:21.779742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f" event={"ID":"c87bbd3e-7be2-419c-bd53-c7c040e79897","Type":"ContainerStarted","Data":"fb3cf07bd5cc094867c14b2344d667f8b98298e6ac9ee6d29f5eb621de7666e6"}
Jul 24 16:53:23.506288 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.506205    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"]
Jul 24 16:53:23.509850 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.509823    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"]
Jul 24 16:53:23.509994 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.509940    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:23.512523 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.512486    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 16:53:23.512635 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.512492    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4vdj6\""
Jul 24 16:53:23.514162 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.513947    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:23.517113 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.516961    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zkxqn\""
Jul 24 16:53:23.518343 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.517364    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 16:53:23.520089 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.520052    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"]
Jul 24 16:53:23.523832 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.523806    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"]
Jul 24 16:53:23.592482 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.592444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q69nt\" (UniqueName: \"kubernetes.io/projected/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-kube-api-access-q69nt\") pod \"llmisvc-controller-manager-777c6bd7d5-zthkv\" (UID: \"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:23.592688 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.592508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zthkv\" (UID: \"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:23.693755 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.693715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zthkv\" (UID: \"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:23.693942 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.693769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kfwm\" (UniqueName: \"kubernetes.io/projected/b5cf345d-1af3-4bbd-ba71-1734fe57be5e-kube-api-access-2kfwm\") pod \"kserve-controller-manager-d6f4b65b8-mxzdh\" (UID: \"b5cf345d-1af3-4bbd-ba71-1734fe57be5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:23.693942 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.693885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5cf345d-1af3-4bbd-ba71-1734fe57be5e-cert\") pod \"kserve-controller-manager-d6f4b65b8-mxzdh\" (UID: \"b5cf345d-1af3-4bbd-ba71-1734fe57be5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:23.693942 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:53:23.693890    2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 24 16:53:23.693942 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.693928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q69nt\" (UniqueName: \"kubernetes.io/projected/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-kube-api-access-q69nt\") pod \"llmisvc-controller-manager-777c6bd7d5-zthkv\" (UID: \"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:23.694152 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:53:23.693987    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-cert podName:b3f403b1-8bc4-4f79-9f9a-f833c7a7e935 nodeName:}" failed. No retries permitted until 2026-07-24 16:53:24.193965965 +0000 UTC m=+625.424713387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-cert") pod "llmisvc-controller-manager-777c6bd7d5-zthkv" (UID: "b3f403b1-8bc4-4f79-9f9a-f833c7a7e935") : secret "llmisvc-webhook-server-cert" not found
Jul 24 16:53:23.712911 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.712876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q69nt\" (UniqueName: \"kubernetes.io/projected/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-kube-api-access-q69nt\") pod \"llmisvc-controller-manager-777c6bd7d5-zthkv\" (UID: \"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:23.794951 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.794856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5cf345d-1af3-4bbd-ba71-1734fe57be5e-cert\") pod \"kserve-controller-manager-d6f4b65b8-mxzdh\" (UID: \"b5cf345d-1af3-4bbd-ba71-1734fe57be5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:23.794951 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.794947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfwm\" (UniqueName: \"kubernetes.io/projected/b5cf345d-1af3-4bbd-ba71-1734fe57be5e-kube-api-access-2kfwm\") pod \"kserve-controller-manager-d6f4b65b8-mxzdh\" (UID: \"b5cf345d-1af3-4bbd-ba71-1734fe57be5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:23.797860 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.797832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5cf345d-1af3-4bbd-ba71-1734fe57be5e-cert\") pod \"kserve-controller-manager-d6f4b65b8-mxzdh\" (UID: \"b5cf345d-1af3-4bbd-ba71-1734fe57be5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:23.815410 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.815364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfwm\" (UniqueName: \"kubernetes.io/projected/b5cf345d-1af3-4bbd-ba71-1734fe57be5e-kube-api-access-2kfwm\") pod \"kserve-controller-manager-d6f4b65b8-mxzdh\" (UID: \"b5cf345d-1af3-4bbd-ba71-1734fe57be5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:23.828907 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:23.828875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:24.198126 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:24.198037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zthkv\" (UID: \"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:24.200930 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:24.200898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3f403b1-8bc4-4f79-9f9a-f833c7a7e935-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zthkv\" (UID: \"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:24.436383 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:24.436337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:24.734084 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:24.733207    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:53:24.734084 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:24.733312    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:53:24.734084 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:24.733359    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:53:24.813130 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:24.813098    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"]
Jul 24 16:53:24.816041 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:53:24.816015    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cf345d_1af3_4bbd_ba71_1734fe57be5e.slice/crio-e382c7f4504c727019722d12f7c011466d1691df74a9c1b2e9ca0527e6b1deb2 WatchSource:0}: Error finding container e382c7f4504c727019722d12f7c011466d1691df74a9c1b2e9ca0527e6b1deb2: Status 404 returned error can't find the container with id e382c7f4504c727019722d12f7c011466d1691df74a9c1b2e9ca0527e6b1deb2
Jul 24 16:53:24.837714 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:24.837674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"]
Jul 24 16:53:24.841488 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:53:24.841453    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb3f403b1_8bc4_4f79_9f9a_f833c7a7e935.slice/crio-9829d7e44cb3141c5b62dfa5d134b7ef12d79690ca611983da310f78e0a18e57 WatchSource:0}: Error finding container 9829d7e44cb3141c5b62dfa5d134b7ef12d79690ca611983da310f78e0a18e57: Status 404 returned error can't find the container with id 9829d7e44cb3141c5b62dfa5d134b7ef12d79690ca611983da310f78e0a18e57
Jul 24 16:53:25.806348 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:25.806255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh" event={"ID":"b5cf345d-1af3-4bbd-ba71-1734fe57be5e","Type":"ContainerStarted","Data":"e382c7f4504c727019722d12f7c011466d1691df74a9c1b2e9ca0527e6b1deb2"}
Jul 24 16:53:25.808326 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:25.808290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f" event={"ID":"c87bbd3e-7be2-419c-bd53-c7c040e79897","Type":"ContainerStarted","Data":"0b2c467e0183c84e5081615e65eaf97246f482fd7ff59bafae35c2da2879530f"}
Jul 24 16:53:25.809963 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:25.809926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv" event={"ID":"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935","Type":"ContainerStarted","Data":"9829d7e44cb3141c5b62dfa5d134b7ef12d79690ca611983da310f78e0a18e57"}
Jul 24 16:53:25.829486 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:25.829419    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f" podStartSLOduration=2.357180929 podStartE2EDuration="5.829397736s" totalImagesPullingTime="3.472216807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:53:25.828974405 +0000 UTC m=+627.059721856" watchObservedRunningTime="2026-07-24 16:53:25.829397736 +0000 UTC m=+627.060145165"
Jul 24 16:53:26.092089 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.091998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:26.098474 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.098307    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:26.351307 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.351219    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"]
Jul 24 16:53:26.351507 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.351464    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8" podUID="4cfa1ffa-8a99-4015-85d7-9d0baebf0456" containerName="discovery" containerID="cri-o://17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40" gracePeriod=30
Jul 24 16:53:26.623608 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.623575    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:26.723385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723347    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-cacerts\") pod \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") "
Jul 24 16:53:26.723577 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-ca-configmap\") pod \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") "
Jul 24 16:53:26.723577 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723442    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-dns-cert\") pod \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") "
Jul 24 16:53:26.723577 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mlsp\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-kube-api-access-8mlsp\") pod \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") "
Jul 24 16:53:26.723772 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723585    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-local-certs\") pod \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") "
Jul 24 16:53:26.723772 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723626    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-token\") pod \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") "
Jul 24 16:53:26.723772 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723649    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-kubeconfig\") pod \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\" (UID: \"4cfa1ffa-8a99-4015-85d7-9d0baebf0456\") "
Jul 24 16:53:26.723920 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723847    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4cfa1ffa-8a99-4015-85d7-9d0baebf0456" (UID: "4cfa1ffa-8a99-4015-85d7-9d0baebf0456"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:53:26.723983 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.723961    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-ca-configmap\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:53:26.726570 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.726479    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-cacerts" (OuterVolumeSpecName: "cacerts") pod "4cfa1ffa-8a99-4015-85d7-9d0baebf0456" (UID: "4cfa1ffa-8a99-4015-85d7-9d0baebf0456"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:53:26.726693 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.726653    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-local-certs" (OuterVolumeSpecName: "local-certs") pod "4cfa1ffa-8a99-4015-85d7-9d0baebf0456" (UID: "4cfa1ffa-8a99-4015-85d7-9d0baebf0456"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:53:26.726758 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.726689    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4cfa1ffa-8a99-4015-85d7-9d0baebf0456" (UID: "4cfa1ffa-8a99-4015-85d7-9d0baebf0456"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:53:26.726758 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.726690    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-token" (OuterVolumeSpecName: "istio-token") pod "4cfa1ffa-8a99-4015-85d7-9d0baebf0456" (UID: "4cfa1ffa-8a99-4015-85d7-9d0baebf0456"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:53:26.726857 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.726797    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-kube-api-access-8mlsp" (OuterVolumeSpecName: "kube-api-access-8mlsp") pod "4cfa1ffa-8a99-4015-85d7-9d0baebf0456" (UID: "4cfa1ffa-8a99-4015-85d7-9d0baebf0456"). InnerVolumeSpecName "kube-api-access-8mlsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:53:26.727148 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.727119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4cfa1ffa-8a99-4015-85d7-9d0baebf0456" (UID: "4cfa1ffa-8a99-4015-85d7-9d0baebf0456"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:53:26.818141 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.818101    2578 generic.go:356] "Generic (PLEG): container finished" podID="4cfa1ffa-8a99-4015-85d7-9d0baebf0456" containerID="17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40" exitCode=0
Jul 24 16:53:26.818616 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.818152    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"
Jul 24 16:53:26.818616 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.818187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8" event={"ID":"4cfa1ffa-8a99-4015-85d7-9d0baebf0456","Type":"ContainerDied","Data":"17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40"}
Jul 24 16:53:26.818616 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.818239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8" event={"ID":"4cfa1ffa-8a99-4015-85d7-9d0baebf0456","Type":"ContainerDied","Data":"f348f18b79272e87131024ff01eb5827baa7959c963db2b0dea6dc86d2237158"}
Jul 24 16:53:26.818616 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.818272    2578 scope.go:117] "RemoveContainer" containerID="17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40"
Jul 24 16:53:26.818832 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.818737    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:26.819760 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.819738    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f"
Jul 24 16:53:26.824702 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.824680    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-cacerts\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:53:26.824813 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.824704    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-csr-dns-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:53:26.824813 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.824718    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mlsp\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-kube-api-access-8mlsp\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:53:26.824813 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.824736    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-local-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:53:26.824813 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.824748    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:53:26.824813 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.824759    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cfa1ffa-8a99-4015-85d7-9d0baebf0456-istio-kubeconfig\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:53:26.869062 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.868971    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"]
Jul 24 16:53:26.878437 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:26.878403    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-72sk8"]
Jul 24 16:53:27.306343 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:27.306317    2578 scope.go:117] "RemoveContainer" containerID="17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40"
Jul 24 16:53:27.306766 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:53:27.306735    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40\": container with ID starting with 17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40 not found: ID does not exist" containerID="17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40"
Jul 24 16:53:27.306862 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:27.306782    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40"} err="failed to get container status \"17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40\": rpc error: code = NotFound desc = could not find container \"17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40\": container with ID starting with 17ff7e5d8845d11c1daf8b5d9ec34411f166f9d4c2d7efcc217fac49ab5adb40 not found: ID does not exist"
Jul 24 16:53:27.312044 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:27.312017    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cfa1ffa-8a99-4015-85d7-9d0baebf0456" path="/var/lib/kubelet/pods/4cfa1ffa-8a99-4015-85d7-9d0baebf0456/volumes"
Jul 24 16:53:28.831309 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:28.831267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv" event={"ID":"b3f403b1-8bc4-4f79-9f9a-f833c7a7e935","Type":"ContainerStarted","Data":"e851e0311ade2d8db13b2c4d56a363af5c9186aae5a357ff6b1970791356daf4"}
Jul 24 16:53:28.831811 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:28.831374    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:28.832816 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:28.832790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh" event={"ID":"b5cf345d-1af3-4bbd-ba71-1734fe57be5e","Type":"ContainerStarted","Data":"98966338e38d5c9a3a787f81627030e6358a7b69dc1ae979927713d4aad86aea"}
Jul 24 16:53:28.833016 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:28.832997    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:53:28.852064 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:28.852008    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv" podStartSLOduration=2.7860205540000003 podStartE2EDuration="5.851994085s" totalImagesPullingTime="3.065973531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:53:28.8513826 +0000 UTC m=+630.082130038" watchObservedRunningTime="2026-07-24 16:53:28.851994085 +0000 UTC m=+630.082741545"
Jul 24 16:53:28.868839 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:28.868781    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh" podStartSLOduration=2.779563845 podStartE2EDuration="5.868766634s" totalImagesPullingTime="3.089202789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:53:28.866879502 +0000 UTC m=+630.097626953" watchObservedRunningTime="2026-07-24 16:53:28.868766634 +0000 UTC m=+630.099514060"
Jul 24 16:53:30.778741 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:30.778710    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wk2gn"
Jul 24 16:53:31.828085 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:31.828049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tfl6s"
Jul 24 16:53:59.839931 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:59.839889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zthkv"
Jul 24 16:53:59.843067 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:53:59.843038    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mxzdh"
Jul 24 16:54:14.196724 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.196683    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4d8q"]
Jul 24 16:54:14.197282 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.197200    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cfa1ffa-8a99-4015-85d7-9d0baebf0456" containerName="discovery"
Jul 24 16:54:14.197282 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.197220    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cfa1ffa-8a99-4015-85d7-9d0baebf0456" containerName="discovery"
Jul 24 16:54:14.197404 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.197310    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cfa1ffa-8a99-4015-85d7-9d0baebf0456" containerName="discovery"
Jul 24 16:54:14.204045 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.204017    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q"
Jul 24 16:54:14.207463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.207428    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 16:54:14.207463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.207429    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5wn92\""
Jul 24 16:54:14.207684 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.207438    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 16:54:14.208563 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.208537    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4d8q"]
Jul 24 16:54:14.252354 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.252322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jgf\" (UniqueName: \"kubernetes.io/projected/b56c0ce5-0cb2-4110-ba2c-7a3f3f472579-kube-api-access-89jgf\") pod \"kuadrant-operator-catalog-t4d8q\" (UID: \"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579\") " pod="kuadrant-system/kuadrant-operator-catalog-t4d8q"
Jul 24 16:54:14.353113 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.353079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jgf\" (UniqueName: \"kubernetes.io/projected/b56c0ce5-0cb2-4110-ba2c-7a3f3f472579-kube-api-access-89jgf\") pod \"kuadrant-operator-catalog-t4d8q\" (UID: \"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579\") " pod="kuadrant-system/kuadrant-operator-catalog-t4d8q"
Jul 24 16:54:14.362588 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.362542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jgf\" (UniqueName: \"kubernetes.io/projected/b56c0ce5-0cb2-4110-ba2c-7a3f3f472579-kube-api-access-89jgf\") pod \"kuadrant-operator-catalog-t4d8q\" (UID: \"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579\") " pod="kuadrant-system/kuadrant-operator-catalog-t4d8q"
Jul 24 16:54:14.515785 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.515746    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q"
Jul 24 16:54:14.559746 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.559710    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4d8q"]
Jul 24 16:54:14.650735 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.650709    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4d8q"]
Jul 24 16:54:14.652788 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:14.652754    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56c0ce5_0cb2_4110_ba2c_7a3f3f472579.slice/crio-fe79296f4be3a19b74b0e855cf41c0b3c90fe6c6452dfe5006ae76cc9d5cccb3 WatchSource:0}: Error finding container fe79296f4be3a19b74b0e855cf41c0b3c90fe6c6452dfe5006ae76cc9d5cccb3: Status 404 returned error can't find the container with id fe79296f4be3a19b74b0e855cf41c0b3c90fe6c6452dfe5006ae76cc9d5cccb3
Jul 24 16:54:14.770782 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.770703    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f7hp4"]
Jul 24 16:54:14.773604 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.773588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:14.781968 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.781946    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f7hp4"]
Jul 24 16:54:14.857574 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.857507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rczts\" (UniqueName: \"kubernetes.io/projected/dc07539b-9acc-43e2-b6ac-39382ba89c5d-kube-api-access-rczts\") pod \"kuadrant-operator-catalog-f7hp4\" (UID: \"dc07539b-9acc-43e2-b6ac-39382ba89c5d\") " pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:14.958389 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.958341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rczts\" (UniqueName: \"kubernetes.io/projected/dc07539b-9acc-43e2-b6ac-39382ba89c5d-kube-api-access-rczts\") pod \"kuadrant-operator-catalog-f7hp4\" (UID: \"dc07539b-9acc-43e2-b6ac-39382ba89c5d\") " pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:14.967382 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:14.967355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rczts\" (UniqueName: \"kubernetes.io/projected/dc07539b-9acc-43e2-b6ac-39382ba89c5d-kube-api-access-rczts\") pod \"kuadrant-operator-catalog-f7hp4\" (UID: \"dc07539b-9acc-43e2-b6ac-39382ba89c5d\") " pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:15.053548 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:15.053464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q" event={"ID":"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579","Type":"ContainerStarted","Data":"fe79296f4be3a19b74b0e855cf41c0b3c90fe6c6452dfe5006ae76cc9d5cccb3"}
Jul 24 16:54:15.083842 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:15.083809    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:15.273129 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:15.273102    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f7hp4"]
Jul 24 16:54:15.277314 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:15.277285    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc07539b_9acc_43e2_b6ac_39382ba89c5d.slice/crio-6b86467171725863a0a7e91383212508eb5d82fcafdaaa95d0bb76239ef74939 WatchSource:0}: Error finding container 6b86467171725863a0a7e91383212508eb5d82fcafdaaa95d0bb76239ef74939: Status 404 returned error can't find the container with id 6b86467171725863a0a7e91383212508eb5d82fcafdaaa95d0bb76239ef74939
Jul 24 16:54:16.058791 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:16.058752    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4" event={"ID":"dc07539b-9acc-43e2-b6ac-39382ba89c5d","Type":"ContainerStarted","Data":"6b86467171725863a0a7e91383212508eb5d82fcafdaaa95d0bb76239ef74939"}
Jul 24 16:54:17.064895 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.064854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q" event={"ID":"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579","Type":"ContainerStarted","Data":"90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918"}
Jul 24 16:54:17.065373 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.064930    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q" podUID="b56c0ce5-0cb2-4110-ba2c-7a3f3f472579" containerName="registry-server" containerID="cri-o://90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918" gracePeriod=2
Jul 24 16:54:17.066544 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.066494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4" event={"ID":"dc07539b-9acc-43e2-b6ac-39382ba89c5d","Type":"ContainerStarted","Data":"af1357f801ba06e3e5a54aab4b1e2b1429fa20c8b6d7a58d4cd4acb9849260c4"}
Jul 24 16:54:17.078664 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.078605    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q" podStartSLOduration=1.201651164 podStartE2EDuration="3.078585231s" totalImagesPullingTime="1.876934067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:17.078455373 +0000 UTC m=+678.309202803" watchObservedRunningTime="2026-07-24 16:54:17.078585231 +0000 UTC m=+678.309332658"
Jul 24 16:54:17.092479 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.092437    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4" podStartSLOduration=1.839372922 podStartE2EDuration="3.092420964s" totalImagesPullingTime="1.253048042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:17.091432876 +0000 UTC m=+678.322180304" watchObservedRunningTime="2026-07-24 16:54:17.092420964 +0000 UTC m=+678.323168390"
Jul 24 16:54:17.317010 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.316932    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q"
Jul 24 16:54:17.381671 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.381631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89jgf\" (UniqueName: \"kubernetes.io/projected/b56c0ce5-0cb2-4110-ba2c-7a3f3f472579-kube-api-access-89jgf\") pod \"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579\" (UID: \"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579\") "
Jul 24 16:54:17.383927 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.383896    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b56c0ce5-0cb2-4110-ba2c-7a3f3f472579-kube-api-access-89jgf" (OuterVolumeSpecName: "kube-api-access-89jgf") pod "b56c0ce5-0cb2-4110-ba2c-7a3f3f472579" (UID: "b56c0ce5-0cb2-4110-ba2c-7a3f3f472579"). InnerVolumeSpecName "kube-api-access-89jgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:17.482283 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:17.482243    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89jgf\" (UniqueName: \"kubernetes.io/projected/b56c0ce5-0cb2-4110-ba2c-7a3f3f472579-kube-api-access-89jgf\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:18.071889 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.071853    2578 generic.go:356] "Generic (PLEG): container finished" podID="b56c0ce5-0cb2-4110-ba2c-7a3f3f472579" containerID="90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918" exitCode=0
Jul 24 16:54:18.072352 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.071900    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q"
Jul 24 16:54:18.072352 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.071944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q" event={"ID":"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579","Type":"ContainerDied","Data":"90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918"}
Jul 24 16:54:18.072352 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.071994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t4d8q" event={"ID":"b56c0ce5-0cb2-4110-ba2c-7a3f3f472579","Type":"ContainerDied","Data":"fe79296f4be3a19b74b0e855cf41c0b3c90fe6c6452dfe5006ae76cc9d5cccb3"}
Jul 24 16:54:18.072352 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.072014    2578 scope.go:117] "RemoveContainer" containerID="90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918"
Jul 24 16:54:18.081279 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.081261    2578 scope.go:117] "RemoveContainer" containerID="90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918"
Jul 24 16:54:18.081570 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:54:18.081546    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918\": container with ID starting with 90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918 not found: ID does not exist" containerID="90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918"
Jul 24 16:54:18.081652 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.081581    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918"} err="failed to get container status \"90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918\": rpc error: code = NotFound desc = could not find container \"90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918\": container with ID starting with 90b00be8fcf0349c8eba2a12add126ab7492dfb5e785cb40f1e0bc7941eb3918 not found: ID does not exist"
Jul 24 16:54:18.092408 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.092381    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4d8q"]
Jul 24 16:54:18.095791 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:18.095768    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4d8q"]
Jul 24 16:54:19.310868 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:19.310838    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b56c0ce5-0cb2-4110-ba2c-7a3f3f472579" path="/var/lib/kubelet/pods/b56c0ce5-0cb2-4110-ba2c-7a3f3f472579/volumes"
Jul 24 16:54:25.084714 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:25.084664    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:25.085226 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:25.084747    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:25.107956 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:25.107914    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:25.129586 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:25.129561    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-f7hp4"
Jul 24 16:54:29.541602 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.541559    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"]
Jul 24 16:54:29.542120 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.542053    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56c0ce5-0cb2-4110-ba2c-7a3f3f472579" containerName="registry-server"
Jul 24 16:54:29.542120 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.542072    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56c0ce5-0cb2-4110-ba2c-7a3f3f472579" containerName="registry-server"
Jul 24 16:54:29.542232 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.542177    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b56c0ce5-0cb2-4110-ba2c-7a3f3f472579" containerName="registry-server"
Jul 24 16:54:29.545424 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.545402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.547776 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.547760    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dwnsj\""
Jul 24 16:54:29.552066 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.552041    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"]
Jul 24 16:54:29.586235 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.586199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.586406 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.586250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqcn\" (UniqueName: \"kubernetes.io/projected/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-kube-api-access-5kqcn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.586406 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.586335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.687552 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.687494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.687730 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.687650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqcn\" (UniqueName: \"kubernetes.io/projected/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-kube-api-access-5kqcn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.687802 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.687727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.687891 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.687869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.688070 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.688050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.695606 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.695576    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqcn\" (UniqueName: \"kubernetes.io/projected/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-kube-api-access-5kqcn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.856689 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.856588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:29.990228 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:29.990201    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"]
Jul 24 16:54:29.992612 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:29.992587    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0f578e_d331_4eb3_bf13_e6c3b1b80684.slice/crio-b2780f3df599320cd9a89f29c6302005e9488eaab418099d612b64f25bb54ff8 WatchSource:0}: Error finding container b2780f3df599320cd9a89f29c6302005e9488eaab418099d612b64f25bb54ff8: Status 404 returned error can't find the container with id b2780f3df599320cd9a89f29c6302005e9488eaab418099d612b64f25bb54ff8
Jul 24 16:54:30.130287 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.130253    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerID="8d9eb7bbe7fd1532b43f498f78e4ad9564a5cc840d273070c85914a1843692f4" exitCode=0
Jul 24 16:54:30.130439 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.130331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9" event={"ID":"fa0f578e-d331-4eb3-bf13-e6c3b1b80684","Type":"ContainerDied","Data":"8d9eb7bbe7fd1532b43f498f78e4ad9564a5cc840d273070c85914a1843692f4"}
Jul 24 16:54:30.130439 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.130379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9" event={"ID":"fa0f578e-d331-4eb3-bf13-e6c3b1b80684","Type":"ContainerStarted","Data":"b2780f3df599320cd9a89f29c6302005e9488eaab418099d612b64f25bb54ff8"}
Jul 24 16:54:30.140626 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.140603    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"]
Jul 24 16:54:30.144005 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.143990    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.151577 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.151553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"]
Jul 24 16:54:30.193252 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.193218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.193366 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.193275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nprsb\" (UniqueName: \"kubernetes.io/projected/ecb9afe7-78a3-49d7-8b97-7d27b001836f-kube-api-access-nprsb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.193423 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.193375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.294048 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.294014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nprsb\" (UniqueName: \"kubernetes.io/projected/ecb9afe7-78a3-49d7-8b97-7d27b001836f-kube-api-access-nprsb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.294234 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.294072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.294234 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.294108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.294498 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.294481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.294566 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.294537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.301801 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.301784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nprsb\" (UniqueName: \"kubernetes.io/projected/ecb9afe7-78a3-49d7-8b97-7d27b001836f-kube-api-access-nprsb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.468487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.468450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:30.600984 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.600960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"]
Jul 24 16:54:30.603111 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:30.603085    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb9afe7_78a3_49d7_8b97_7d27b001836f.slice/crio-ede67e1575748d5df908db0f1ff6a28bcb46303bd8753e835c76e33c434cb0c2 WatchSource:0}: Error finding container ede67e1575748d5df908db0f1ff6a28bcb46303bd8753e835c76e33c434cb0c2: Status 404 returned error can't find the container with id ede67e1575748d5df908db0f1ff6a28bcb46303bd8753e835c76e33c434cb0c2
Jul 24 16:54:30.743215 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.743136    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"]
Jul 24 16:54:30.746871 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.746853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.753911 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.753867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"]
Jul 24 16:54:30.798406 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.798374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.798571 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.798421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.798571 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.798481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29zv\" (UniqueName: \"kubernetes.io/projected/75c8814c-6856-4055-bc56-721005f4da95-kube-api-access-q29zv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.900034 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.900005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.900107 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.900060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29zv\" (UniqueName: \"kubernetes.io/projected/75c8814c-6856-4055-bc56-721005f4da95-kube-api-access-q29zv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.900209 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.900193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.900425 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.900397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.900502 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.900464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:30.907371 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:30.907349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29zv\" (UniqueName: \"kubernetes.io/projected/75c8814c-6856-4055-bc56-721005f4da95-kube-api-access-q29zv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:31.082723 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.082641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:31.137763 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.137733    2578 generic.go:356] "Generic (PLEG): container finished" podID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerID="401b39e2988dea2b4c3753c8aac000989714b18989490c7549d86296b6c5ccfa" exitCode=0
Jul 24 16:54:31.138161 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.137896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz" event={"ID":"ecb9afe7-78a3-49d7-8b97-7d27b001836f","Type":"ContainerDied","Data":"401b39e2988dea2b4c3753c8aac000989714b18989490c7549d86296b6c5ccfa"}
Jul 24 16:54:31.138161 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.137952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz" event={"ID":"ecb9afe7-78a3-49d7-8b97-7d27b001836f","Type":"ContainerStarted","Data":"ede67e1575748d5df908db0f1ff6a28bcb46303bd8753e835c76e33c434cb0c2"}
Jul 24 16:54:31.142762 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.142741    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerID="39b2f9a042d591b01916a1c9a9180deb4325bfac504dcfd5cd69fdbb696c806f" exitCode=0
Jul 24 16:54:31.142877 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.142816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9" event={"ID":"fa0f578e-d331-4eb3-bf13-e6c3b1b80684","Type":"ContainerDied","Data":"39b2f9a042d591b01916a1c9a9180deb4325bfac504dcfd5cd69fdbb696c806f"}
Jul 24 16:54:31.146782 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.146757    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"]
Jul 24 16:54:31.150994 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.150968    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.162293 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.162265    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"]
Jul 24 16:54:31.202634 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.202596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg5lh\" (UniqueName: \"kubernetes.io/projected/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-kube-api-access-fg5lh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.202757 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.202648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.202757 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.202710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.230079 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.230045    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"]
Jul 24 16:54:31.231197 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:31.231168    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c8814c_6856_4055_bc56_721005f4da95.slice/crio-626881559abdf7c0737eb8cc7f536be1249d9274281a0e19d1b5342801db60de WatchSource:0}: Error finding container 626881559abdf7c0737eb8cc7f536be1249d9274281a0e19d1b5342801db60de: Status 404 returned error can't find the container with id 626881559abdf7c0737eb8cc7f536be1249d9274281a0e19d1b5342801db60de
Jul 24 16:54:31.303643 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.303613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg5lh\" (UniqueName: \"kubernetes.io/projected/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-kube-api-access-fg5lh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.303785 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.303652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.303785 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.303691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.304033 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.304017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.304071 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.304043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.311884 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.311858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg5lh\" (UniqueName: \"kubernetes.io/projected/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-kube-api-access-fg5lh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.462238 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.462199    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:31.594674 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:31.594644    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"]
Jul 24 16:54:31.598014 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:31.597978    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16abe7a_13b6_45d6_9ab6_d49ba3ab4765.slice/crio-d82a1279a5c76157a3a65cd8b05d8b6eb59a889935fc4db7d7c684d9a29aca77 WatchSource:0}: Error finding container d82a1279a5c76157a3a65cd8b05d8b6eb59a889935fc4db7d7c684d9a29aca77: Status 404 returned error can't find the container with id d82a1279a5c76157a3a65cd8b05d8b6eb59a889935fc4db7d7c684d9a29aca77
Jul 24 16:54:32.151497 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.151406    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerID="de914ed97f96781c0f3da3700e769811ba14c38c4cb604722051998e464152d6" exitCode=0
Jul 24 16:54:32.151928 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.151487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9" event={"ID":"fa0f578e-d331-4eb3-bf13-e6c3b1b80684","Type":"ContainerDied","Data":"de914ed97f96781c0f3da3700e769811ba14c38c4cb604722051998e464152d6"}
Jul 24 16:54:32.153022 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.152996    2578 generic.go:356] "Generic (PLEG): container finished" podID="75c8814c-6856-4055-bc56-721005f4da95" containerID="0c9d13a5cd9f2aa892c0b54d89e35da6d7565ab6bb6c8369f0ee13edcc9032d8" exitCode=0
Jul 24 16:54:32.153151 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.153078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr" event={"ID":"75c8814c-6856-4055-bc56-721005f4da95","Type":"ContainerDied","Data":"0c9d13a5cd9f2aa892c0b54d89e35da6d7565ab6bb6c8369f0ee13edcc9032d8"}
Jul 24 16:54:32.153151 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.153121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr" event={"ID":"75c8814c-6856-4055-bc56-721005f4da95","Type":"ContainerStarted","Data":"626881559abdf7c0737eb8cc7f536be1249d9274281a0e19d1b5342801db60de"}
Jul 24 16:54:32.155133 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.155112    2578 generic.go:356] "Generic (PLEG): container finished" podID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerID="55a85d4c75eedc73709166de6a223842c41009b23ec11da69e9fb191e6cde566" exitCode=0
Jul 24 16:54:32.155233 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.155200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz" event={"ID":"ecb9afe7-78a3-49d7-8b97-7d27b001836f","Type":"ContainerDied","Data":"55a85d4c75eedc73709166de6a223842c41009b23ec11da69e9fb191e6cde566"}
Jul 24 16:54:32.156852 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.156765    2578 generic.go:356] "Generic (PLEG): container finished" podID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerID="5518edee61b21171ded3e1b7c2b105c2603c1dd33a3fc964f3a2bfc2b488a713" exitCode=0
Jul 24 16:54:32.156852 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.156812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm" event={"ID":"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765","Type":"ContainerDied","Data":"5518edee61b21171ded3e1b7c2b105c2603c1dd33a3fc964f3a2bfc2b488a713"}
Jul 24 16:54:32.156852 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:32.156843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm" event={"ID":"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765","Type":"ContainerStarted","Data":"d82a1279a5c76157a3a65cd8b05d8b6eb59a889935fc4db7d7c684d9a29aca77"}
Jul 24 16:54:33.165031 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.165002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr" event={"ID":"75c8814c-6856-4055-bc56-721005f4da95","Type":"ContainerStarted","Data":"3201fd2e6c534a898ee72288c7228b726bf9d9168239323fee3d6c2f44f2eeaf"}
Jul 24 16:54:33.167340 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.167312    2578 generic.go:356] "Generic (PLEG): container finished" podID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerID="670b26f8637299b386492db3df80e68219a4234b26af0ce21e7d22fbf29f99e2" exitCode=0
Jul 24 16:54:33.167436 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.167390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz" event={"ID":"ecb9afe7-78a3-49d7-8b97-7d27b001836f","Type":"ContainerDied","Data":"670b26f8637299b386492db3df80e68219a4234b26af0ce21e7d22fbf29f99e2"}
Jul 24 16:54:33.302315 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.302290    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:33.421781 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.421745    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-bundle\") pod \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") "
Jul 24 16:54:33.421931 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.421857    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-util\") pod \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") "
Jul 24 16:54:33.421931 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.421882    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kqcn\" (UniqueName: \"kubernetes.io/projected/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-kube-api-access-5kqcn\") pod \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\" (UID: \"fa0f578e-d331-4eb3-bf13-e6c3b1b80684\") "
Jul 24 16:54:33.422353 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.422329    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-bundle" (OuterVolumeSpecName: "bundle") pod "fa0f578e-d331-4eb3-bf13-e6c3b1b80684" (UID: "fa0f578e-d331-4eb3-bf13-e6c3b1b80684"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:33.424050 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.424020    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-kube-api-access-5kqcn" (OuterVolumeSpecName: "kube-api-access-5kqcn") pod "fa0f578e-d331-4eb3-bf13-e6c3b1b80684" (UID: "fa0f578e-d331-4eb3-bf13-e6c3b1b80684"). InnerVolumeSpecName "kube-api-access-5kqcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:33.427671 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.427640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-util" (OuterVolumeSpecName: "util") pod "fa0f578e-d331-4eb3-bf13-e6c3b1b80684" (UID: "fa0f578e-d331-4eb3-bf13-e6c3b1b80684"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:33.522602 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.522565    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-bundle\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:33.522602 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.522595    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-util\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:33.522602 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:33.522605    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kqcn\" (UniqueName: \"kubernetes.io/projected/fa0f578e-d331-4eb3-bf13-e6c3b1b80684-kube-api-access-5kqcn\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:34.173890 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.173853    2578 generic.go:356] "Generic (PLEG): container finished" podID="75c8814c-6856-4055-bc56-721005f4da95" containerID="3201fd2e6c534a898ee72288c7228b726bf9d9168239323fee3d6c2f44f2eeaf" exitCode=0
Jul 24 16:54:34.174327 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.173938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr" event={"ID":"75c8814c-6856-4055-bc56-721005f4da95","Type":"ContainerDied","Data":"3201fd2e6c534a898ee72288c7228b726bf9d9168239323fee3d6c2f44f2eeaf"}
Jul 24 16:54:34.175907 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.175885    2578 generic.go:356] "Generic (PLEG): container finished" podID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerID="dc36376e376d8aed978b6fd2cdb8177ac7b46f3f11e0eb20802f1a4fa54c4cce" exitCode=0
Jul 24 16:54:34.176005 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.175987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm" event={"ID":"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765","Type":"ContainerDied","Data":"dc36376e376d8aed978b6fd2cdb8177ac7b46f3f11e0eb20802f1a4fa54c4cce"}
Jul 24 16:54:34.177952 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.177931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9" event={"ID":"fa0f578e-d331-4eb3-bf13-e6c3b1b80684","Type":"ContainerDied","Data":"b2780f3df599320cd9a89f29c6302005e9488eaab418099d612b64f25bb54ff8"}
Jul 24 16:54:34.178038 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.177965    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9"
Jul 24 16:54:34.178038 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.177966    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2780f3df599320cd9a89f29c6302005e9488eaab418099d612b64f25bb54ff8"
Jul 24 16:54:34.330440 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.330408    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:34.429714 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.429621    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-util\") pod \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") "
Jul 24 16:54:34.429714 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.429711    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-bundle\") pod \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") "
Jul 24 16:54:34.429951 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.429798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nprsb\" (UniqueName: \"kubernetes.io/projected/ecb9afe7-78a3-49d7-8b97-7d27b001836f-kube-api-access-nprsb\") pod \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\" (UID: \"ecb9afe7-78a3-49d7-8b97-7d27b001836f\") "
Jul 24 16:54:34.430391 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.430354    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-bundle" (OuterVolumeSpecName: "bundle") pod "ecb9afe7-78a3-49d7-8b97-7d27b001836f" (UID: "ecb9afe7-78a3-49d7-8b97-7d27b001836f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:34.431798 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.431771    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb9afe7-78a3-49d7-8b97-7d27b001836f-kube-api-access-nprsb" (OuterVolumeSpecName: "kube-api-access-nprsb") pod "ecb9afe7-78a3-49d7-8b97-7d27b001836f" (UID: "ecb9afe7-78a3-49d7-8b97-7d27b001836f"). InnerVolumeSpecName "kube-api-access-nprsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:34.435365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.435325    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-util" (OuterVolumeSpecName: "util") pod "ecb9afe7-78a3-49d7-8b97-7d27b001836f" (UID: "ecb9afe7-78a3-49d7-8b97-7d27b001836f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:34.531149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.531108    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nprsb\" (UniqueName: \"kubernetes.io/projected/ecb9afe7-78a3-49d7-8b97-7d27b001836f-kube-api-access-nprsb\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:34.531149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.531144    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-util\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:34.531149 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:34.531158    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecb9afe7-78a3-49d7-8b97-7d27b001836f-bundle\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:35.185186 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.185151    2578 generic.go:356] "Generic (PLEG): container finished" podID="75c8814c-6856-4055-bc56-721005f4da95" containerID="03cdc9ae6e12b2a0d35c71e88b8c21919fbd4bcce0c73a200eb927aec9bb8bbb" exitCode=0
Jul 24 16:54:35.185653 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.185244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr" event={"ID":"75c8814c-6856-4055-bc56-721005f4da95","Type":"ContainerDied","Data":"03cdc9ae6e12b2a0d35c71e88b8c21919fbd4bcce0c73a200eb927aec9bb8bbb"}
Jul 24 16:54:35.187119 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.187101    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz"
Jul 24 16:54:35.187249 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.187120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz" event={"ID":"ecb9afe7-78a3-49d7-8b97-7d27b001836f","Type":"ContainerDied","Data":"ede67e1575748d5df908db0f1ff6a28bcb46303bd8753e835c76e33c434cb0c2"}
Jul 24 16:54:35.187249 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.187161    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ede67e1575748d5df908db0f1ff6a28bcb46303bd8753e835c76e33c434cb0c2"
Jul 24 16:54:35.189247 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.189221    2578 generic.go:356] "Generic (PLEG): container finished" podID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerID="dd1ef8badb88cdf63f2607b05da3530ad4270793121495440776b07252efedc7" exitCode=0
Jul 24 16:54:35.189365 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.189287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm" event={"ID":"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765","Type":"ContainerDied","Data":"dd1ef8badb88cdf63f2607b05da3530ad4270793121495440776b07252efedc7"}
Jul 24 16:54:35.692584 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.692546    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69f69f4957-r54g4"]
Jul 24 16:54:35.692950 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.692934    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerName="pull"
Jul 24 16:54:35.693023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.692953    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerName="pull"
Jul 24 16:54:35.693023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.692966    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerName="extract"
Jul 24 16:54:35.693023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.692974    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerName="extract"
Jul 24 16:54:35.693023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.692991    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerName="util"
Jul 24 16:54:35.693023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693000    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerName="util"
Jul 24 16:54:35.693023 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693017    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerName="extract"
Jul 24 16:54:35.693289 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693026    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerName="extract"
Jul 24 16:54:35.693289 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693038    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerName="util"
Jul 24 16:54:35.693289 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693047    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerName="util"
Jul 24 16:54:35.693289 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693075    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerName="pull"
Jul 24 16:54:35.693289 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693083    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerName="pull"
Jul 24 16:54:35.693289 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693162    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb9afe7-78a3-49d7-8b97-7d27b001836f" containerName="extract"
Jul 24 16:54:35.693289 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.693175    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa0f578e-d331-4eb3-bf13-e6c3b1b80684" containerName="extract"
Jul 24 16:54:35.696505 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.696483    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.698901 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.698878    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 16:54:35.699032 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.698994    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 16:54:35.699102 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.699055    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 16:54:35.699150 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.699130    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 16:54:35.699350 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.699337    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 16:54:35.699386 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.699347    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q6qvj\""
Jul 24 16:54:35.704629 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.704607    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 16:54:35.710475 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.710450    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f69f4957-r54g4"]
Jul 24 16:54:35.841877 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.841837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-service-ca\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.841877 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.841881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-oauth-serving-cert\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.842180 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.841910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5pjj\" (UniqueName: \"kubernetes.io/projected/31b8c5f3-a359-4ad7-a819-b1e98b736f35-kube-api-access-g5pjj\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.842180 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.842027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-serving-cert\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.842180 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.842089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-config\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.842180 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.842145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-oauth-config\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.842180 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.842178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-trusted-ca-bundle\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.943255 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.943167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-config\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.943255 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.943222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-oauth-config\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.943255 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.943251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-trusted-ca-bundle\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.943579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.943281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-service-ca\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.943579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.943308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-oauth-serving-cert\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.943579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.943337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5pjj\" (UniqueName: \"kubernetes.io/projected/31b8c5f3-a359-4ad7-a819-b1e98b736f35-kube-api-access-g5pjj\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.943579 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.943390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-serving-cert\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.944105 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.944077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-config\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.944201 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.944114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-trusted-ca-bundle\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.944201 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.944162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-oauth-serving-cert\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.944467 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.944443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31b8c5f3-a359-4ad7-a819-b1e98b736f35-service-ca\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.945753 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.945721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-oauth-config\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.945832 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.945797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b8c5f3-a359-4ad7-a819-b1e98b736f35-console-serving-cert\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:35.953836 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:35.953813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5pjj\" (UniqueName: \"kubernetes.io/projected/31b8c5f3-a359-4ad7-a819-b1e98b736f35-kube-api-access-g5pjj\") pod \"console-69f69f4957-r54g4\" (UID: \"31b8c5f3-a359-4ad7-a819-b1e98b736f35\") " pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:36.006363 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.006328    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:36.139416 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.139387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f69f4957-r54g4"]
Jul 24 16:54:36.141388 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:36.141362    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b8c5f3_a359_4ad7_a819_b1e98b736f35.slice/crio-bfcc6258c56a7927efc144e86b27a3942a2be49bf6ceb0acf547c916261db9c1 WatchSource:0}: Error finding container bfcc6258c56a7927efc144e86b27a3942a2be49bf6ceb0acf547c916261db9c1: Status 404 returned error can't find the container with id bfcc6258c56a7927efc144e86b27a3942a2be49bf6ceb0acf547c916261db9c1
Jul 24 16:54:36.196173 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.196144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f69f4957-r54g4" event={"ID":"31b8c5f3-a359-4ad7-a819-b1e98b736f35","Type":"ContainerStarted","Data":"bfcc6258c56a7927efc144e86b27a3942a2be49bf6ceb0acf547c916261db9c1"}
Jul 24 16:54:36.344074 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.344048    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:36.351433 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.351408    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:36.447868 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.447785    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-util\") pod \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") "
Jul 24 16:54:36.447868 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.447844    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-bundle\") pod \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") "
Jul 24 16:54:36.448068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.447916    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q29zv\" (UniqueName: \"kubernetes.io/projected/75c8814c-6856-4055-bc56-721005f4da95-kube-api-access-q29zv\") pod \"75c8814c-6856-4055-bc56-721005f4da95\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") "
Jul 24 16:54:36.448068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.447944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg5lh\" (UniqueName: \"kubernetes.io/projected/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-kube-api-access-fg5lh\") pod \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\" (UID: \"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765\") "
Jul 24 16:54:36.448068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.447981    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-util\") pod \"75c8814c-6856-4055-bc56-721005f4da95\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") "
Jul 24 16:54:36.448068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.448065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-bundle\") pod \"75c8814c-6856-4055-bc56-721005f4da95\" (UID: \"75c8814c-6856-4055-bc56-721005f4da95\") "
Jul 24 16:54:36.448487 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.448452    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-bundle" (OuterVolumeSpecName: "bundle") pod "a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" (UID: "a16abe7a-13b6-45d6-9ab6-d49ba3ab4765"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:36.448799 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.448769    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-bundle" (OuterVolumeSpecName: "bundle") pod "75c8814c-6856-4055-bc56-721005f4da95" (UID: "75c8814c-6856-4055-bc56-721005f4da95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:36.450167 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.450138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c8814c-6856-4055-bc56-721005f4da95-kube-api-access-q29zv" (OuterVolumeSpecName: "kube-api-access-q29zv") pod "75c8814c-6856-4055-bc56-721005f4da95" (UID: "75c8814c-6856-4055-bc56-721005f4da95"). InnerVolumeSpecName "kube-api-access-q29zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:36.450238 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.450175    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-kube-api-access-fg5lh" (OuterVolumeSpecName: "kube-api-access-fg5lh") pod "a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" (UID: "a16abe7a-13b6-45d6-9ab6-d49ba3ab4765"). InnerVolumeSpecName "kube-api-access-fg5lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:36.453765 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.453733    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-util" (OuterVolumeSpecName: "util") pod "a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" (UID: "a16abe7a-13b6-45d6-9ab6-d49ba3ab4765"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:36.453814 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.453797    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-util" (OuterVolumeSpecName: "util") pod "75c8814c-6856-4055-bc56-721005f4da95" (UID: "75c8814c-6856-4055-bc56-721005f4da95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:36.548851 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.548809    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-bundle\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:36.548851 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.548844    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-util\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:36.548851 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.548855    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-bundle\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:36.549071 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.548864    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q29zv\" (UniqueName: \"kubernetes.io/projected/75c8814c-6856-4055-bc56-721005f4da95-kube-api-access-q29zv\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:36.549071 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.548874    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg5lh\" (UniqueName: \"kubernetes.io/projected/a16abe7a-13b6-45d6-9ab6-d49ba3ab4765-kube-api-access-fg5lh\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:36.549071 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:36.548883    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75c8814c-6856-4055-bc56-721005f4da95-util\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:54:37.203061 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:37.202986    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm"
Jul 24 16:54:37.203061 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:37.203020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm" event={"ID":"a16abe7a-13b6-45d6-9ab6-d49ba3ab4765","Type":"ContainerDied","Data":"d82a1279a5c76157a3a65cd8b05d8b6eb59a889935fc4db7d7c684d9a29aca77"}
Jul 24 16:54:37.203477 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:37.203078    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d82a1279a5c76157a3a65cd8b05d8b6eb59a889935fc4db7d7c684d9a29aca77"
Jul 24 16:54:37.204977 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:37.204956    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr"
Jul 24 16:54:37.205092 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:37.204990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr" event={"ID":"75c8814c-6856-4055-bc56-721005f4da95","Type":"ContainerDied","Data":"626881559abdf7c0737eb8cc7f536be1249d9274281a0e19d1b5342801db60de"}
Jul 24 16:54:37.205092 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:37.205046    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="626881559abdf7c0737eb8cc7f536be1249d9274281a0e19d1b5342801db60de"
Jul 24 16:54:37.206592 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:37.206567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f69f4957-r54g4" event={"ID":"31b8c5f3-a359-4ad7-a819-b1e98b736f35","Type":"ContainerStarted","Data":"3fa966f337aed01a1beffd9fbc5110bcedbd4483564770d88fa99912f59bb21d"}
Jul 24 16:54:37.226274 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:37.226219    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69f69f4957-r54g4" podStartSLOduration=2.226200853 podStartE2EDuration="2.226200853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:37.223937315 +0000 UTC m=+698.454684742" watchObservedRunningTime="2026-07-24 16:54:37.226200853 +0000 UTC m=+698.456948280"
Jul 24 16:54:45.767178 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767139    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"]
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767466    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c8814c-6856-4055-bc56-721005f4da95" containerName="extract"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767478    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c8814c-6856-4055-bc56-721005f4da95" containerName="extract"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767487    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c8814c-6856-4055-bc56-721005f4da95" containerName="util"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767493    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c8814c-6856-4055-bc56-721005f4da95" containerName="util"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767503    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c8814c-6856-4055-bc56-721005f4da95" containerName="pull"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767523    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c8814c-6856-4055-bc56-721005f4da95" containerName="pull"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767530    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerName="util"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767535    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerName="util"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767545    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerName="pull"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767550    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerName="pull"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767558    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerName="extract"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767563    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerName="extract"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767628    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c8814c-6856-4055-bc56-721005f4da95" containerName="extract"
Jul 24 16:54:45.767668 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.767635    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16abe7a-13b6-45d6-9ab6-d49ba3ab4765" containerName="extract"
Jul 24 16:54:45.772282 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.772264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"
Jul 24 16:54:45.776313 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.776289    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 24 16:54:45.776434 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.776361    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-948f2\""
Jul 24 16:54:45.781385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.781362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"]
Jul 24 16:54:45.927871 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:45.927834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnfz5\" (UniqueName: \"kubernetes.io/projected/afcc0bd2-fba7-4114-a67e-9c514efad67e-kube-api-access-gnfz5\") pod \"dns-operator-controller-manager-864dd78c4c-7qh7v\" (UID: \"afcc0bd2-fba7-4114-a67e-9c514efad67e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"
Jul 24 16:54:46.006474 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.006442    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:46.006648 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.006499    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:46.011280 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.011262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:46.029295 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.029228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnfz5\" (UniqueName: \"kubernetes.io/projected/afcc0bd2-fba7-4114-a67e-9c514efad67e-kube-api-access-gnfz5\") pod \"dns-operator-controller-manager-864dd78c4c-7qh7v\" (UID: \"afcc0bd2-fba7-4114-a67e-9c514efad67e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"
Jul 24 16:54:46.038850 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.038822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnfz5\" (UniqueName: \"kubernetes.io/projected/afcc0bd2-fba7-4114-a67e-9c514efad67e-kube-api-access-gnfz5\") pod \"dns-operator-controller-manager-864dd78c4c-7qh7v\" (UID: \"afcc0bd2-fba7-4114-a67e-9c514efad67e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"
Jul 24 16:54:46.082339 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.082313    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"
Jul 24 16:54:46.215414 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.215389    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"]
Jul 24 16:54:46.217480 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:46.217450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafcc0bd2_fba7_4114_a67e_9c514efad67e.slice/crio-b96b0f3b280991abfc8f996825ac88484f1aed69cd19fd936a5519a4be63bebe WatchSource:0}: Error finding container b96b0f3b280991abfc8f996825ac88484f1aed69cd19fd936a5519a4be63bebe: Status 404 returned error can't find the container with id b96b0f3b280991abfc8f996825ac88484f1aed69cd19fd936a5519a4be63bebe
Jul 24 16:54:46.252825 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.252796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v" event={"ID":"afcc0bd2-fba7-4114-a67e-9c514efad67e","Type":"ContainerStarted","Data":"b96b0f3b280991abfc8f996825ac88484f1aed69cd19fd936a5519a4be63bebe"}
Jul 24 16:54:46.257566 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:46.257542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69f69f4957-r54g4"
Jul 24 16:54:48.265661 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:48.265576    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v" event={"ID":"afcc0bd2-fba7-4114-a67e-9c514efad67e","Type":"ContainerStarted","Data":"fa53753404a9d19f98853407837e16b7f8c713b801079c088b810ef32f6bb15d"}
Jul 24 16:54:48.266041 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:48.265721    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"
Jul 24 16:54:48.284013 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:48.283962    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v" podStartSLOduration=1.5402105860000002 podStartE2EDuration="3.283948481s" totalImagesPullingTime="1.743737895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:48.281344929 +0000 UTC m=+709.512092356" watchObservedRunningTime="2026-07-24 16:54:48.283948481 +0000 UTC m=+709.514695907"
Jul 24 16:54:49.230270 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.230229    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"]
Jul 24 16:54:49.233743 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.233725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:54:49.236461 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.236439    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2xggd\""
Jul 24 16:54:49.243633 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.243607    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"]
Jul 24 16:54:49.360845 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.360809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9v8k\" (UniqueName: \"kubernetes.io/projected/040bb4ae-b01b-4f5a-bf60-65255429dea1-kube-api-access-l9v8k\") pod \"limitador-operator-controller-manager-859d7b78bd-88gfx\" (UID: \"040bb4ae-b01b-4f5a-bf60-65255429dea1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:54:49.462288 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.462250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9v8k\" (UniqueName: \"kubernetes.io/projected/040bb4ae-b01b-4f5a-bf60-65255429dea1-kube-api-access-l9v8k\") pod \"limitador-operator-controller-manager-859d7b78bd-88gfx\" (UID: \"040bb4ae-b01b-4f5a-bf60-65255429dea1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:54:49.471985 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.471951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9v8k\" (UniqueName: \"kubernetes.io/projected/040bb4ae-b01b-4f5a-bf60-65255429dea1-kube-api-access-l9v8k\") pod \"limitador-operator-controller-manager-859d7b78bd-88gfx\" (UID: \"040bb4ae-b01b-4f5a-bf60-65255429dea1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:54:49.544376 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.544285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:54:49.681227 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:49.681198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"]
Jul 24 16:54:49.682905 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:49.682876    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040bb4ae_b01b_4f5a_bf60_65255429dea1.slice/crio-d08e4457f795c3eae466f70e9eeaf8ef7af9835786e5b8bd8d2146ed1fbc1b45 WatchSource:0}: Error finding container d08e4457f795c3eae466f70e9eeaf8ef7af9835786e5b8bd8d2146ed1fbc1b45: Status 404 returned error can't find the container with id d08e4457f795c3eae466f70e9eeaf8ef7af9835786e5b8bd8d2146ed1fbc1b45
Jul 24 16:54:50.278165 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:50.278130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx" event={"ID":"040bb4ae-b01b-4f5a-bf60-65255429dea1","Type":"ContainerStarted","Data":"d08e4457f795c3eae466f70e9eeaf8ef7af9835786e5b8bd8d2146ed1fbc1b45"}
Jul 24 16:54:52.291454 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:52.291408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx" event={"ID":"040bb4ae-b01b-4f5a-bf60-65255429dea1","Type":"ContainerStarted","Data":"52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24"}
Jul 24 16:54:52.291949 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:52.291531    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:54:52.308614 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:52.308558    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx" podStartSLOduration=1.5526823680000001 podStartE2EDuration="3.308539888s" totalImagesPullingTime="1.75585752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:52.307015816 +0000 UTC m=+713.537763244" watchObservedRunningTime="2026-07-24 16:54:52.308539888 +0000 UTC m=+713.539287310"
Jul 24 16:54:53.172298 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.172259    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"]
Jul 24 16:54:53.175890 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.175870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"
Jul 24 16:54:53.178272 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.178253    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mxkcw\""
Jul 24 16:54:53.185076 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.185050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"]
Jul 24 16:54:53.295784 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.295754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-857tk\" (UniqueName: \"kubernetes.io/projected/7c3531d2-1874-4bb5-9cfb-80e0caa1bc95-kube-api-access-857tk\") pod \"authorino-operator-75cc8d5cb7-87hrf\" (UID: \"7c3531d2-1874-4bb5-9cfb-80e0caa1bc95\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"
Jul 24 16:54:53.396834 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.396795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-857tk\" (UniqueName: \"kubernetes.io/projected/7c3531d2-1874-4bb5-9cfb-80e0caa1bc95-kube-api-access-857tk\") pod \"authorino-operator-75cc8d5cb7-87hrf\" (UID: \"7c3531d2-1874-4bb5-9cfb-80e0caa1bc95\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"
Jul 24 16:54:53.405002 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.404976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-857tk\" (UniqueName: \"kubernetes.io/projected/7c3531d2-1874-4bb5-9cfb-80e0caa1bc95-kube-api-access-857tk\") pod \"authorino-operator-75cc8d5cb7-87hrf\" (UID: \"7c3531d2-1874-4bb5-9cfb-80e0caa1bc95\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"
Jul 24 16:54:53.486647 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.486614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"
Jul 24 16:54:53.631457 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:53.631424    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"]
Jul 24 16:54:53.634010 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:54:53.633986    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3531d2_1874_4bb5_9cfb_80e0caa1bc95.slice/crio-48f1044f89958ff0abbe899043110a185262b5d06462fd94395b1648e3f8c95a WatchSource:0}: Error finding container 48f1044f89958ff0abbe899043110a185262b5d06462fd94395b1648e3f8c95a: Status 404 returned error can't find the container with id 48f1044f89958ff0abbe899043110a185262b5d06462fd94395b1648e3f8c95a
Jul 24 16:54:54.305332 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:54.305292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf" event={"ID":"7c3531d2-1874-4bb5-9cfb-80e0caa1bc95","Type":"ContainerStarted","Data":"48f1044f89958ff0abbe899043110a185262b5d06462fd94395b1648e3f8c95a"}
Jul 24 16:54:56.318385 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:56.318351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf" event={"ID":"7c3531d2-1874-4bb5-9cfb-80e0caa1bc95","Type":"ContainerStarted","Data":"263fc49e8d9c5f8f6934b5f17faeb87054b47cb04cd78628927e8c7b34daab26"}
Jul 24 16:54:56.318868 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:56.318429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"
Jul 24 16:54:56.336737 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:56.336690    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf" podStartSLOduration=1.065754283 podStartE2EDuration="3.336675584s" totalImagesPullingTime="2.270921301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:56.334695212 +0000 UTC m=+717.565442818" watchObservedRunningTime="2026-07-24 16:54:56.336675584 +0000 UTC m=+717.567423010"
Jul 24 16:54:59.273126 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:54:59.273094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7qh7v"
Jul 24 16:55:03.298687 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:03.298652    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:55:06.565255 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.565217    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"]
Jul 24 16:55:06.570589 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.570567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.572826 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.572799    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 24 16:55:06.572929 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.572826    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 24 16:55:06.573069 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.573052    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dwnsj\""
Jul 24 16:55:06.576736 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.576717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"]
Jul 24 16:55:06.612355 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.612323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.612544 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.612378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.612544 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.612457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx7zx\" (UniqueName: \"kubernetes.io/projected/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-kube-api-access-fx7zx\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.713248 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.713209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx7zx\" (UniqueName: \"kubernetes.io/projected/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-kube-api-access-fx7zx\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.713426 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.713262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.713426 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.713308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.713985 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.713962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.715841 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.715820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.720886 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.720864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx7zx\" (UniqueName: \"kubernetes.io/projected/8d80ccd9-c030-4057-99c5-b5e6067f9bb4-kube-api-access-fx7zx\") pod \"kuadrant-console-plugin-66b5774985-6kgs9\" (UID: \"8d80ccd9-c030-4057-99c5-b5e6067f9bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:06.880979 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:06.880890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"
Jul 24 16:55:07.026349 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:07.026325    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9"]
Jul 24 16:55:07.028737 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:55:07.028710    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d80ccd9_c030_4057_99c5_b5e6067f9bb4.slice/crio-4e967580df742c48adbceb316fa2425626aaac5ff111a72f199a4bf2636e059e WatchSource:0}: Error finding container 4e967580df742c48adbceb316fa2425626aaac5ff111a72f199a4bf2636e059e: Status 404 returned error can't find the container with id 4e967580df742c48adbceb316fa2425626aaac5ff111a72f199a4bf2636e059e
Jul 24 16:55:07.325926 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:07.325887    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-87hrf"
Jul 24 16:55:07.376320 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:07.376285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9" event={"ID":"8d80ccd9-c030-4057-99c5-b5e6067f9bb4","Type":"ContainerStarted","Data":"4e967580df742c48adbceb316fa2425626aaac5ff111a72f199a4bf2636e059e"}
Jul 24 16:55:16.150363 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.150323    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"]
Jul 24 16:55:16.163865 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.163832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:16.165252 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.165222    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"]
Jul 24 16:55:16.166199 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.166158    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f9j46\""
Jul 24 16:55:16.212441 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.212407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6pln\" (UniqueName: \"kubernetes.io/projected/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-kube-api-access-k6pln\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" (UID: \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:16.212643 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.212496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" (UID: \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:16.313807 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.313756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6pln\" (UniqueName: \"kubernetes.io/projected/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-kube-api-access-k6pln\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" (UID: \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:16.313969 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.313818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" (UID: \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:16.314235 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.314212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" (UID: \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:16.327301 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.327277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6pln\" (UniqueName: \"kubernetes.io/projected/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-kube-api-access-k6pln\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" (UID: \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:16.478145 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.478103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:16.859564 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.859462    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"]
Jul 24 16:55:16.868347 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.868301    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"]
Jul 24 16:55:16.906894 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.906860    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"]
Jul 24 16:55:16.907148 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.907106    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" containerName="manager" containerID="cri-o://52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24" gracePeriod=2
Jul 24 16:55:16.922341 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.922265    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"]
Jul 24 16:55:16.927537 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:16.927281    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"040bb4ae-b01b-4f5a-bf60-65255429dea1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-88gfx\": pods \"limitador-operator-controller-manager-859d7b78bd-88gfx\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:55:16.930925 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.930900    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"]
Jul 24 16:55:16.931452 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.931435    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" containerName="manager"
Jul 24 16:55:16.931543 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.931454    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" containerName="manager"
Jul 24 16:55:16.931611 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.931575    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" containerName="manager"
Jul 24 16:55:16.936445 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.936424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"
Jul 24 16:55:16.938603 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:16.938571    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-88gfx\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:55:16.944870 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:16.944683    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"]
Jul 24 16:55:17.020622 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:17.020582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ppqc\" (UniqueName: \"kubernetes.io/projected/27efba3e-79ac-44ab-a567-4788babec4a6-kube-api-access-7ppqc\") pod \"limitador-operator-controller-manager-859d7b78bd-nxq9z\" (UID: \"27efba3e-79ac-44ab-a567-4788babec4a6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"
Jul 24 16:55:17.122102 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:17.122021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ppqc\" (UniqueName: \"kubernetes.io/projected/27efba3e-79ac-44ab-a567-4788babec4a6-kube-api-access-7ppqc\") pod \"limitador-operator-controller-manager-859d7b78bd-nxq9z\" (UID: \"27efba3e-79ac-44ab-a567-4788babec4a6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"
Jul 24 16:55:17.131375 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:17.131345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ppqc\" (UniqueName: \"kubernetes.io/projected/27efba3e-79ac-44ab-a567-4788babec4a6-kube-api-access-7ppqc\") pod \"limitador-operator-controller-manager-859d7b78bd-nxq9z\" (UID: \"27efba3e-79ac-44ab-a567-4788babec4a6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"
Jul 24 16:55:17.286585 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:17.286549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"
Jul 24 16:55:28.917919 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:28.917890    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:55:28.920398 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:28.920365    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-88gfx\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:55:28.946606 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:28.946547    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"]
Jul 24 16:55:28.948959 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:55:28.948933    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27efba3e_79ac_44ab_a567_4788babec4a6.slice/crio-a55cc47359e669d35814508fc70f14df03ee88b54d8b22a8a1672974c4866397 WatchSource:0}: Error finding container a55cc47359e669d35814508fc70f14df03ee88b54d8b22a8a1672974c4866397: Status 404 returned error can't find the container with id a55cc47359e669d35814508fc70f14df03ee88b54d8b22a8a1672974c4866397
Jul 24 16:55:29.041715 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.041631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9v8k\" (UniqueName: \"kubernetes.io/projected/040bb4ae-b01b-4f5a-bf60-65255429dea1-kube-api-access-l9v8k\") pod \"040bb4ae-b01b-4f5a-bf60-65255429dea1\" (UID: \"040bb4ae-b01b-4f5a-bf60-65255429dea1\") "
Jul 24 16:55:29.043750 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.043719    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040bb4ae-b01b-4f5a-bf60-65255429dea1-kube-api-access-l9v8k" (OuterVolumeSpecName: "kube-api-access-l9v8k") pod "040bb4ae-b01b-4f5a-bf60-65255429dea1" (UID: "040bb4ae-b01b-4f5a-bf60-65255429dea1"). InnerVolumeSpecName "kube-api-access-l9v8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:55:29.142565 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.142528    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9v8k\" (UniqueName: \"kubernetes.io/projected/040bb4ae-b01b-4f5a-bf60-65255429dea1-kube-api-access-l9v8k\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:55:29.309796 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:29.309710    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-88gfx\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:55:29.311350 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.311323    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" path="/var/lib/kubelet/pods/040bb4ae-b01b-4f5a-bf60-65255429dea1/volumes"
Jul 24 16:55:29.519709 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.519653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z" event={"ID":"27efba3e-79ac-44ab-a567-4788babec4a6","Type":"ContainerStarted","Data":"65be8e3706e170db65bc6eeaae419a150d95827dc76504b130a7a7feb1dcb939"}
Jul 24 16:55:29.519888 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.519866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"
Jul 24 16:55:29.519946 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.519924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z" event={"ID":"27efba3e-79ac-44ab-a567-4788babec4a6","Type":"ContainerStarted","Data":"a55cc47359e669d35814508fc70f14df03ee88b54d8b22a8a1672974c4866397"}
Jul 24 16:55:29.521233 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.521208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9" event={"ID":"8d80ccd9-c030-4057-99c5-b5e6067f9bb4","Type":"ContainerStarted","Data":"b681671757f5bff892f91394f9fda90db4791667e62779243e3e036d33456538"}
Jul 24 16:55:29.522478 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.522453    2578 generic.go:356] "Generic (PLEG): container finished" podID="040bb4ae-b01b-4f5a-bf60-65255429dea1" containerID="52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24" exitCode=0
Jul 24 16:55:29.522586 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.522498    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:55:29.522586 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.522527    2578 scope.go:117] "RemoveContainer" containerID="52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24"
Jul 24 16:55:29.531402 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.531381    2578 scope.go:117] "RemoveContainer" containerID="52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24"
Jul 24 16:55:29.531700 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:29.531677    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24\": container with ID starting with 52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24 not found: ID does not exist" containerID="52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24"
Jul 24 16:55:29.531750 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.531709    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24"} err="failed to get container status \"52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24\": rpc error: code = NotFound desc = could not find container \"52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24\": container with ID starting with 52f259bd99cd2dd55b4ef8c783f9f6544e6a62a7db543d013012b73d3fa1be24 not found: ID does not exist"
Jul 24 16:55:29.538284 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:29.538253    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-88gfx\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="040bb4ae-b01b-4f5a-bf60-65255429dea1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88gfx"
Jul 24 16:55:29.538754 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.538715    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z" podStartSLOduration=13.53870072 podStartE2EDuration="13.53870072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:55:29.536444655 +0000 UTC m=+750.767192083" watchObservedRunningTime="2026-07-24 16:55:29.53870072 +0000 UTC m=+750.769448235"
Jul 24 16:55:29.556444 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:29.556401    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kgs9" podStartSLOduration=1.711172921 podStartE2EDuration="23.556390848s" totalImagesPullingTime="21.845217927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:55:29.555013172 +0000 UTC m=+750.785760600" watchObservedRunningTime="2026-07-24 16:55:29.556390848 +0000 UTC m=+750.787138273"
Jul 24 16:55:31.333378 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:31.333341    2578 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-pq2c5_kuadrant-system_5672ab7f-685a-4be9-9f3f-f5a33c0abb72_0(65c99e4f7f03785727d545f4e52b6995090f2aa8c0a4514e14a70fec44aca5a9): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-pq2c5 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 24 16:55:31.333687 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:31.333403    2578 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-pq2c5_kuadrant-system_5672ab7f-685a-4be9-9f3f-f5a33c0abb72_0(65c99e4f7f03785727d545f4e52b6995090f2aa8c0a4514e14a70fec44aca5a9): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-pq2c5 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:31.534865 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:31.534829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:31.537156 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:31.537127    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="5672ab7f-685a-4be9-9f3f-f5a33c0abb72" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:31.543828 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:31.543811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:31.545737 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:31.545714    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="5672ab7f-685a-4be9-9f3f-f5a33c0abb72" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:31.665009 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:31.664914    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-extensions-socket-volume\") pod \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\" (UID: \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\") "
Jul 24 16:55:31.665009 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:31.665005    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6pln\" (UniqueName: \"kubernetes.io/projected/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-kube-api-access-k6pln\") pod \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\" (UID: \"5672ab7f-685a-4be9-9f3f-f5a33c0abb72\") "
Jul 24 16:55:31.665239 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:31.665172    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5672ab7f-685a-4be9-9f3f-f5a33c0abb72" (UID: "5672ab7f-685a-4be9-9f3f-f5a33c0abb72"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:55:31.667105 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:31.667083    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-kube-api-access-k6pln" (OuterVolumeSpecName: "kube-api-access-k6pln") pod "5672ab7f-685a-4be9-9f3f-f5a33c0abb72" (UID: "5672ab7f-685a-4be9-9f3f-f5a33c0abb72"). InnerVolumeSpecName "kube-api-access-k6pln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:55:31.765789 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:31.765745    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6pln\" (UniqueName: \"kubernetes.io/projected/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-kube-api-access-k6pln\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:55:31.765789 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:31.765781    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5672ab7f-685a-4be9-9f3f-f5a33c0abb72-extensions-socket-volume\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 16:55:32.539615 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:32.539569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:32.541790 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:32.541763    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="5672ab7f-685a-4be9-9f3f-f5a33c0abb72" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:32.548385 ip-10-0-140-49 kubenswrapper[2578]: E0724 16:55:32.548358    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pq2c5\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="5672ab7f-685a-4be9-9f3f-f5a33c0abb72" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pq2c5"
Jul 24 16:55:33.310648 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:33.310616    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5672ab7f-685a-4be9-9f3f-f5a33c0abb72" path="/var/lib/kubelet/pods/5672ab7f-685a-4be9-9f3f-f5a33c0abb72/volumes"
Jul 24 16:55:40.532175 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:40.532144    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxq9z"
Jul 24 16:55:49.205209 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.205170    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"]
Jul 24 16:55:49.429490 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.429455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.433378 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.433353    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-w8kfv\""
Jul 24 16:55:49.436565 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.436539    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"]
Jul 24 16:55:49.524951 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.524915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.524951 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.524954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.525151 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.524988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.525151 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.525107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.525235 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.525152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.525235 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.525180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2srmb\" (UniqueName: \"kubernetes.io/projected/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-kube-api-access-2srmb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.525235 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.525216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.525336 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.525256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.525336 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.525289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.626650 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.626613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.626842 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.626657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.626842 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.626828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.626973 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.626906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.626973 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.626937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.626973 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.626953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2srmb\" (UniqueName: \"kubernetes.io/projected/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-kube-api-access-2srmb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.626973 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.626967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.627176 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.626975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.627176 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.627030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.627176 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.627082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.627176 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.627163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.627387 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.627307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.627387 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.627366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.627493 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.627472    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.629182 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.629157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.629305 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.629287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.641443 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.641413    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2srmb\" (UniqueName: \"kubernetes.io/projected/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-kube-api-access-2srmb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.646163 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.646140    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe780d3-c0b9-42b0-ab2d-c9749f9b0171-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gzmhb\" (UID: \"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.741557 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.741489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:49.934356 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.934323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"]
Jul 24 16:55:49.937187 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:55:49.937163    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe780d3_c0b9_42b0_ab2d_c9749f9b0171.slice/crio-6dd6eb23940aa1e7c5a2acefdc9b22c39531e178e261d84729d4f7e3b7839a51 WatchSource:0}: Error finding container 6dd6eb23940aa1e7c5a2acefdc9b22c39531e178e261d84729d4f7e3b7839a51: Status 404 returned error can't find the container with id 6dd6eb23940aa1e7c5a2acefdc9b22c39531e178e261d84729d4f7e3b7839a51
Jul 24 16:55:49.939395 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.939367    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:55:49.939463 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.939432    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:55:49.939497 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:49.939463    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:55:50.642562 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:50.642523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" event={"ID":"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171","Type":"ContainerStarted","Data":"70eb66980e41b6ea79c22d39b8a170a4b014d1c835c214ff3e00c2925de470ec"}
Jul 24 16:55:50.643004 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:50.642582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" event={"ID":"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171","Type":"ContainerStarted","Data":"6dd6eb23940aa1e7c5a2acefdc9b22c39531e178e261d84729d4f7e3b7839a51"}
Jul 24 16:55:50.665871 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:50.665817    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" podStartSLOduration=1.665803409 podStartE2EDuration="1.665803409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:55:50.663646872 +0000 UTC m=+771.894394318" watchObservedRunningTime="2026-07-24 16:55:50.665803409 +0000 UTC m=+771.896550834"
Jul 24 16:55:50.742580 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:50.742550    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:51.747121 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:51.747083    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:52.654031 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:52.653997    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:55:52.655030 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:55:52.655003    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:56:06.007234 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.007200    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:56:06.073211 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.073182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:56:06.073211 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.073220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:56:06.073406 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.073300    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:06.077230 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.077207    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 16:56:06.185344 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.185307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7f4c1212-c2f2-4141-88b9-64d713846f1a-config-file\") pod \"limitador-limitador-54d6d988d5-j7wdw\" (UID: \"7f4c1212-c2f2-4141-88b9-64d713846f1a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:06.185344 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.185347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkxm\" (UniqueName: \"kubernetes.io/projected/7f4c1212-c2f2-4141-88b9-64d713846f1a-kube-api-access-krkxm\") pod \"limitador-limitador-54d6d988d5-j7wdw\" (UID: \"7f4c1212-c2f2-4141-88b9-64d713846f1a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:06.286915 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.286807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7f4c1212-c2f2-4141-88b9-64d713846f1a-config-file\") pod \"limitador-limitador-54d6d988d5-j7wdw\" (UID: \"7f4c1212-c2f2-4141-88b9-64d713846f1a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:06.286915 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.286862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krkxm\" (UniqueName: \"kubernetes.io/projected/7f4c1212-c2f2-4141-88b9-64d713846f1a-kube-api-access-krkxm\") pod \"limitador-limitador-54d6d988d5-j7wdw\" (UID: \"7f4c1212-c2f2-4141-88b9-64d713846f1a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:06.287602 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.287581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7f4c1212-c2f2-4141-88b9-64d713846f1a-config-file\") pod \"limitador-limitador-54d6d988d5-j7wdw\" (UID: \"7f4c1212-c2f2-4141-88b9-64d713846f1a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:06.295813 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.295791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkxm\" (UniqueName: \"kubernetes.io/projected/7f4c1212-c2f2-4141-88b9-64d713846f1a-kube-api-access-krkxm\") pod \"limitador-limitador-54d6d988d5-j7wdw\" (UID: \"7f4c1212-c2f2-4141-88b9-64d713846f1a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:06.383459 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.383419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:06.523405 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.523379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:56:06.526356 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:56:06.526320    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4c1212_c2f2_4141_88b9_64d713846f1a.slice/crio-a6973db828314a55d179243beaf796d98c985fa51f0db110f040593a928885dd WatchSource:0}: Error finding container a6973db828314a55d179243beaf796d98c985fa51f0db110f040593a928885dd: Status 404 returned error can't find the container with id a6973db828314a55d179243beaf796d98c985fa51f0db110f040593a928885dd
Jul 24 16:56:06.729578 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:06.729541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw" event={"ID":"7f4c1212-c2f2-4141-88b9-64d713846f1a","Type":"ContainerStarted","Data":"a6973db828314a55d179243beaf796d98c985fa51f0db110f040593a928885dd"}
Jul 24 16:56:09.749937 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:09.749889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw" event={"ID":"7f4c1212-c2f2-4141-88b9-64d713846f1a","Type":"ContainerStarted","Data":"5bc48c25288591150cd8b7125cc1179715d8a3470a57b02ca28874c711ddcf2a"}
Jul 24 16:56:09.750337 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:09.750027    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:56:09.770257 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:09.770196    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw" podStartSLOduration=2.338173314 podStartE2EDuration="4.770177489s" totalImagesPullingTime="2.432004175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:56:09.768155637 +0000 UTC m=+790.998903091" watchObservedRunningTime="2026-07-24 16:56:09.770177489 +0000 UTC m=+791.000924915"
Jul 24 16:56:20.757013 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:56:20.756980    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"
Jul 24 16:57:18.701575 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:18.701536    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:57:27.183491 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:27.183453    2578 generic.go:356] "Generic (PLEG): container finished" podID="dfe780d3-c0b9-42b0-ab2d-c9749f9b0171" containerID="70eb66980e41b6ea79c22d39b8a170a4b014d1c835c214ff3e00c2925de470ec" exitCode=0
Jul 24 16:57:27.183928 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:27.183508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" event={"ID":"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171","Type":"ContainerDied","Data":"70eb66980e41b6ea79c22d39b8a170a4b014d1c835c214ff3e00c2925de470ec"}
Jul 24 16:57:27.183928 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:27.183911    2578 scope.go:117] "RemoveContainer" containerID="70eb66980e41b6ea79c22d39b8a170a4b014d1c835c214ff3e00c2925de470ec"
Jul 24 16:57:27.184907 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:27.184878    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:57:27.184997 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:27.184945    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:57:27.185056 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:27.184992    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:57:28.191264 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:28.191231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" event={"ID":"dfe780d3-c0b9-42b0-ab2d-c9749f9b0171","Type":"ContainerStarted","Data":"062a0a16dad096d83e70f74122348c79e3fb1f1e36b5bbd93bef9b7d99c806e5"}
Jul 24 16:57:28.742141 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:28.741727    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:57:28.742470 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:28.742442    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gzmhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:57:28.742652 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:28.742625    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" podUID="dfe780d3-c0b9-42b0-ab2d-c9749f9b0171" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 16:57:29.742014 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:29.741971    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gzmhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:57:29.742553 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:29.742060    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" podUID="dfe780d3-c0b9-42b0-ab2d-c9749f9b0171" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 16:57:30.743269 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:30.742817    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gzmhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:57:30.743269 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:30.742886    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" podUID="dfe780d3-c0b9-42b0-ab2d-c9749f9b0171" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 16:57:31.742290 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:31.742245    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gzmhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:57:31.742622 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:31.742587    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb" podUID="dfe780d3-c0b9-42b0-ab2d-c9749f9b0171" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 16:57:32.746447 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:32.746414    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:57:32.746859 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:32.746760    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:57:32.747435 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:32.747415    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gzmhb"
Jul 24 16:57:41.939042 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:57:41.939007    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:58:08.072257 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:08.072220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:58:14.978085 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:14.978047    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:58:20.787693 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:20.787648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:58:25.689206 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.689161    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"]
Jul 24 16:58:25.692047 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.692029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.695720 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.695697    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s45jh\""
Jul 24 16:58:25.695830 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.695699    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 16:58:25.695830 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.695700    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 16:58:25.695830 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.695787    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 16:58:25.705116 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.705094    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"]
Jul 24 16:58:25.789847 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.789815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.789847 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.789847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j96g\" (UniqueName: \"kubernetes.io/projected/23672859-211f-4aad-ac57-b125735ab15f-kube-api-access-9j96g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.790063 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.789881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.790063 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.789979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23672859-211f-4aad-ac57-b125735ab15f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.790063 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.790024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.790063 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.790053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.890482 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23672859-211f-4aad-ac57-b125735ab15f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.890689 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.890689 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.890689 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.890689 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j96g\" (UniqueName: \"kubernetes.io/projected/23672859-211f-4aad-ac57-b125735ab15f-kube-api-access-9j96g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.890689 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.890906 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.891138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.891138 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.890977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.892852 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.892832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23672859-211f-4aad-ac57-b125735ab15f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.892946 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.892916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23672859-211f-4aad-ac57-b125735ab15f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:25.899527 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:25.899493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j96g\" (UniqueName: \"kubernetes.io/projected/23672859-211f-4aad-ac57-b125735ab15f-kube-api-access-9j96g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8276\" (UID: \"23672859-211f-4aad-ac57-b125735ab15f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:26.002232 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:26.002198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:26.140155 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:26.140126    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"]
Jul 24 16:58:26.141886 ip-10-0-140-49 kubenswrapper[2578]: W0724 16:58:26.141854    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23672859_211f_4aad_ac57_b125735ab15f.slice/crio-6b60bc20467a8e572dbf7e36ee9c7de4b1da797513d0d9bc7b5662a7d9af7e01 WatchSource:0}: Error finding container 6b60bc20467a8e572dbf7e36ee9c7de4b1da797513d0d9bc7b5662a7d9af7e01: Status 404 returned error can't find the container with id 6b60bc20467a8e572dbf7e36ee9c7de4b1da797513d0d9bc7b5662a7d9af7e01
Jul 24 16:58:26.143164 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:26.143147    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:58:26.505381 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:26.505344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276" event={"ID":"23672859-211f-4aad-ac57-b125735ab15f","Type":"ContainerStarted","Data":"6b60bc20467a8e572dbf7e36ee9c7de4b1da797513d0d9bc7b5662a7d9af7e01"}
Jul 24 16:58:27.512457 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:27.512361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276" event={"ID":"23672859-211f-4aad-ac57-b125735ab15f","Type":"ContainerStarted","Data":"4840e203377d84b70714fb1c2c8ea6fb6dcb7a13352a0b1a2282bf5d974ee687"}
Jul 24 16:58:27.532068 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:27.532014    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276" podStartSLOduration=1.429368183 podStartE2EDuration="2.531997863s" totalImagesPullingTime="1.10262968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:58:27.530471794 +0000 UTC m=+928.761219242" watchObservedRunningTime="2026-07-24 16:58:27.531997863 +0000 UTC m=+928.762745290"
Jul 24 16:58:28.575187 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:28.575151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:58:36.003377 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:36.003324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:36.003997 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:36.003446    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:36.016244 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:36.016218    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:36.573492 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:36.573459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8276"
Jul 24 16:58:37.885196 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:58:37.885158    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 16:59:52.076148 ip-10-0-140-49 kubenswrapper[2578]: I0724 16:59:52.076112    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:00:01.577278 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:00:01.577243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:00:11.476458 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:00:11.476413    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:01:50.780365 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:01:50.779784    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:02:02.674685 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:02:02.674640    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:02:38.975830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:02:38.975785    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:02:48.282125 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:02:48.282090    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:02:58.476583 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:02:58.476541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:03:04.872305 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:03:04.872252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:03:15.182132 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:03:15.182092    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:03:25.473714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:03:25.473677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:03:36.272287 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:03:36.272247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:03:46.276893 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:03:46.276855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:04:08.378366 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:04:08.378279    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:04:17.973196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:04:17.973154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:04:41.784268 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:04:41.784230    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:04:52.871873 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:04:52.871834    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:05:06.377691 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:05:06.377647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:05:17.575021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:05:17.574981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:05:26.982931 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:05:26.982844    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:05:36.678108 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:05:36.678074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:05:46.375663 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:05:46.375625    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:07:34.572783 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:07:34.572747    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:07:46.182905 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:07:46.182870    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:07:55.371457 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:07:55.371422    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:08:07.380429 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:08:07.380398    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:08:16.979399 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:08:16.979357    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:08:29.283713 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:08:29.282176    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:08:37.975303 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:08:37.975266    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:08:48.972780 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:08:48.972731    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:08:58.281032 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:08:58.280992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:09:08.570906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:08.570865    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:09:19.381725 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:19.381681    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:09:40.680602 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:40.680563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:09:50.179501 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.179464    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:09:50.398054 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.398016    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"]
Jul 24 17:09:50.401564 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.401542    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.403803 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.403778    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-ec558e54-kserve-self-signed-certs\""
Jul 24 17:09:50.416733 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.416707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"]
Jul 24 17:09:50.487184 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.487151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tmp-dir\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.487367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.487192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-model-cache\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.487367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.487255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-dshm\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.487367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.487327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tls-certs\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.487367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.487355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-home\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.487580 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.487392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvrc2\" (UniqueName: \"kubernetes.io/projected/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-kube-api-access-dvrc2\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.588674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.588641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tmp-dir\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.588879 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.588684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-model-cache\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.588879 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.588721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-dshm\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.588879 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.588775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tls-certs\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.589045 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.588940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-home\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.589106 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.589044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvrc2\" (UniqueName: \"kubernetes.io/projected/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-kube-api-access-dvrc2\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.589160 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.589102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-model-cache\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.589160 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.589143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tmp-dir\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.589339 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.589307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-home\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.591015 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.590987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-dshm\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.591321 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.591303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tls-certs\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.596581 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.596563    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvrc2\" (UniqueName: \"kubernetes.io/projected/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-kube-api-access-dvrc2\") pod \"e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") " pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.710930 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.710891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:09:50.851270 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:50.851246    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"]
Jul 24 17:09:50.853086 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:09:50.853055    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda12c3bb9_9548_4b3d_a5b8_a9d058b695ef.slice/crio-1314693884f658122e58889b9130b3bf3885f979f9fdc86606603f6f7a8cf21e WatchSource:0}: Error finding container 1314693884f658122e58889b9130b3bf3885f979f9fdc86606603f6f7a8cf21e: Status 404 returned error can't find the container with id 1314693884f658122e58889b9130b3bf3885f979f9fdc86606603f6f7a8cf21e
Jul 24 17:09:51.302811 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:51.302774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk" event={"ID":"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef","Type":"ContainerStarted","Data":"b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35"}
Jul 24 17:09:51.302811 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:51.302825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk" event={"ID":"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef","Type":"ContainerStarted","Data":"1314693884f658122e58889b9130b3bf3885f979f9fdc86606603f6f7a8cf21e"}
Jul 24 17:09:51.320015 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:09:51.319967    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk" podStartSLOduration=1.319952611 podStartE2EDuration="1.319952611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:09:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:09:51.318440923 +0000 UTC m=+1612.549188363" watchObservedRunningTime="2026-07-24 17:09:51.319952611 +0000 UTC m=+1612.550700030"
Jul 24 17:10:00.712093 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:00.712057    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:10:00.712590 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:00.712111    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:10:00.724607 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:00.724577    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:10:01.372562 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:01.372530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:10:02.180905 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:02.180862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:10:20.813877 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:20.813839    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"]
Jul 24 17:10:24.679264 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:24.679224    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:10:35.833826 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:35.833759    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk" podUID="a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" containerName="main" containerID="cri-o://b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35" gracePeriod=45
Jul 24 17:10:36.097589 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.097498    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:10:36.198387 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198334    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-home\") pod \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") "
Jul 24 17:10:36.198387 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198401    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvrc2\" (UniqueName: \"kubernetes.io/projected/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-kube-api-access-dvrc2\") pod \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") "
Jul 24 17:10:36.198691 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198437    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-model-cache\") pod \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") "
Jul 24 17:10:36.198691 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198456    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-dshm\") pod \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") "
Jul 24 17:10:36.198691 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198481    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tmp-dir\") pod \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") "
Jul 24 17:10:36.198691 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198576    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tls-certs\") pod \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\" (UID: \"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef\") "
Jul 24 17:10:36.198902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-home" (OuterVolumeSpecName: "home") pod "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" (UID: "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:36.198902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198759    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" (UID: "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:36.198902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198824    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" (UID: "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:36.198902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198879    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-home\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:10:36.198902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.198896    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-model-cache\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:10:36.200756 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.200729    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-kube-api-access-dvrc2" (OuterVolumeSpecName: "kube-api-access-dvrc2") pod "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" (UID: "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef"). InnerVolumeSpecName "kube-api-access-dvrc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:10:36.200857 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.200751    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" (UID: "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:10:36.200857 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.200740    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-dshm" (OuterVolumeSpecName: "dshm") pod "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" (UID: "a12c3bb9-9548-4b3d-a5b8-a9d058b695ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:36.299433 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.299392    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvrc2\" (UniqueName: \"kubernetes.io/projected/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-kube-api-access-dvrc2\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:10:36.299433 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.299424    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-dshm\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:10:36.299433 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.299434    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tmp-dir\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:10:36.299727 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.299446    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef-tls-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:10:36.552898 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.552864    2578 generic.go:356] "Generic (PLEG): container finished" podID="a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" containerID="b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35" exitCode=0
Jul 24 17:10:36.553069 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.552910    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"
Jul 24 17:10:36.553069 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.552943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk" event={"ID":"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef","Type":"ContainerDied","Data":"b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35"}
Jul 24 17:10:36.553069 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.552985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk" event={"ID":"a12c3bb9-9548-4b3d-a5b8-a9d058b695ef","Type":"ContainerDied","Data":"1314693884f658122e58889b9130b3bf3885f979f9fdc86606603f6f7a8cf21e"}
Jul 24 17:10:36.553069 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.553005    2578 scope.go:117] "RemoveContainer" containerID="b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35"
Jul 24 17:10:36.570590 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.570564    2578 scope.go:117] "RemoveContainer" containerID="b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35"
Jul 24 17:10:36.570893 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:10:36.570871    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35\": container with ID starting with b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35 not found: ID does not exist" containerID="b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35"
Jul 24 17:10:36.570965 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.570907    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35"} err="failed to get container status \"b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35\": rpc error: code = NotFound desc = could not find container \"b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35\": container with ID starting with b3643acb30da3eb015cbdbc90aa5df9d5a024d4b6bedd2cdaa73f9c18a0efb35 not found: ID does not exist"
Jul 24 17:10:36.579707 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.579677    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"]
Jul 24 17:10:36.581864 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:36.581844    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-ec558e54-kserve-6c6859484c-g4knk"]
Jul 24 17:10:37.311124 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:37.311093    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" path="/var/lib/kubelet/pods/a12c3bb9-9548-4b3d-a5b8-a9d058b695ef/volumes"
Jul 24 17:10:39.487902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:39.487866    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:10:49.801202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:10:49.801154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:11:01.883308 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:11:01.883271    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:11:12.492489 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:11:12.492449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:11:22.191068 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:11:22.190970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:11:32.682235 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:11:32.682193    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:11:42.179199 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:11:42.179154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:11:52.181237 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:11:52.181198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:12:05.174487 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:12:05.174451    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:12:14.482327 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:12:14.482292    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:12:29.572579 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:12:29.572530    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:12:38.686488 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:12:38.686439    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:12:50.684053 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:12:50.684012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:13:05.774705 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:13:05.774667    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:13:17.773630 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:13:17.773590    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:13:26.875401 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:13:26.875362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:13:32.886454 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:13:32.886415    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:13:47.177496 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:13:47.177461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:13:56.276935 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:13:56.276901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:14:06.672995 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.672960    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"]
Jul 24 17:14:06.673365 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.673338    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" containerName="main"
Jul 24 17:14:06.673365 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.673349    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" containerName="main"
Jul 24 17:14:06.673438 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.673425    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a12c3bb9-9548-4b3d-a5b8-a9d058b695ef" containerName="main"
Jul 24 17:14:06.676491 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.676474    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.678883 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.678864    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0275111b-openshift-default-dockercfg-qm9cr\""
Jul 24 17:14:06.700202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.700163    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"]
Jul 24 17:14:06.761755 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.761676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvkhh\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-kube-api-access-wvkhh\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.761755 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.761724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-data\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.762000 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.761812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-token\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.762000 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.761858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-socket\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.762000 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.761880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-credential-socket\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.762000 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.761931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-certs\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.762000 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.761984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-podinfo\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.762212 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.762012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061715b-4e08-4bd0-ac5c-781dee3b366a-istiod-ca-cert\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.762212 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.762101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-envoy\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863404 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-envoy\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863652 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkhh\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-kube-api-access-wvkhh\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863652 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-data\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863652 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-token\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863652 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-socket\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863652 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-credential-socket\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863652 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-certs\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863973 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-podinfo\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.863973 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061715b-4e08-4bd0-ac5c-781dee3b366a-istiod-ca-cert\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.864081 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.863989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-data\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.864081 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.864016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-socket\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.864196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.864079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-certs\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.864196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.864178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-credential-socket\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.864443 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.864422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061715b-4e08-4bd0-ac5c-781dee3b366a-istiod-ca-cert\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.865757 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.865740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-envoy\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.866191 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.866174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-podinfo\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.871809 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.871780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-token\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.871935 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.871874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkhh\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-kube-api-access-wvkhh\") pod \"e2e-ait-0275111b-openshift-default-5f574db866-wptpm\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") " pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:06.977679 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.977638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:14:06.986255 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:06.986229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:07.132571 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:07.132537    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"]
Jul 24 17:14:07.135245 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:14:07.135216    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6061715b_4e08_4bd0_ac5c_781dee3b366a.slice/crio-89d57fb616117ce92549724639f079f248f19da2adfa2f6a94c61c62a23a8e10 WatchSource:0}: Error finding container 89d57fb616117ce92549724639f079f248f19da2adfa2f6a94c61c62a23a8e10: Status 404 returned error can't find the container with id 89d57fb616117ce92549724639f079f248f19da2adfa2f6a94c61c62a23a8e10
Jul 24 17:14:07.137276 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:07.137245    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:07.137352 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:07.137315    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:07.137352 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:07.137343    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:07.722676 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:07.722636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" event={"ID":"6061715b-4e08-4bd0-ac5c-781dee3b366a","Type":"ContainerStarted","Data":"0dc18340fbc5870688514a29503cfd7540e1ec10c9e0893c3ec1051c1af68aef"}
Jul 24 17:14:07.723070 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:07.722698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" event={"ID":"6061715b-4e08-4bd0-ac5c-781dee3b366a","Type":"ContainerStarted","Data":"89d57fb616117ce92549724639f079f248f19da2adfa2f6a94c61c62a23a8e10"}
Jul 24 17:14:07.760173 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:07.760108    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" podStartSLOduration=1.7600888860000001 podStartE2EDuration="1.760088886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:07.75943398 +0000 UTC m=+1868.990181427" watchObservedRunningTime="2026-07-24 17:14:07.760088886 +0000 UTC m=+1868.990836317"
Jul 24 17:14:07.986857 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:07.986764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:08.992098 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:08.992067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:09.732877 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:09.732844    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:09.733851 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:09.733831    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:13.976858 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:13.976821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:14:22.805297 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:22.805255    2578 generic.go:356] "Generic (PLEG): container finished" podID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerID="0dc18340fbc5870688514a29503cfd7540e1ec10c9e0893c3ec1051c1af68aef" exitCode=0
Jul 24 17:14:22.805870 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:22.805351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" event={"ID":"6061715b-4e08-4bd0-ac5c-781dee3b366a","Type":"ContainerDied","Data":"0dc18340fbc5870688514a29503cfd7540e1ec10c9e0893c3ec1051c1af68aef"}
Jul 24 17:14:22.805870 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:22.805860    2578 scope.go:117] "RemoveContainer" containerID="0dc18340fbc5870688514a29503cfd7540e1ec10c9e0893c3ec1051c1af68aef"
Jul 24 17:14:22.807765 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:22.807359    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:22.807765 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:22.807504    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:22.807765 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:22.807575    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:23.812759 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:23.812719    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" event={"ID":"6061715b-4e08-4bd0-ac5c-781dee3b366a","Type":"ContainerStarted","Data":"075a1df36531634d104d25c7e8b25760af97674feacac124ba9569b1fbd514ff"}
Jul 24 17:14:23.986836 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:23.986802    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:23.987812 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:23.987777    2578 patch_prober.go:28] interesting pod/e2e-ait-0275111b-openshift-default-5f574db866-wptpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 17:14:23.987963 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:23.987837    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 17:14:24.732960 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:24.732913    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:24.987411 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:24.987317    2578 patch_prober.go:28] interesting pod/e2e-ait-0275111b-openshift-default-5f574db866-wptpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 17:14:24.987411 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:24.987387    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 17:14:25.987439 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:25.987395    2578 patch_prober.go:28] interesting pod/e2e-ait-0275111b-openshift-default-5f574db866-wptpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 17:14:25.987829 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:25.987466    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 17:14:26.986728 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:26.986687    2578 patch_prober.go:28] interesting pod/e2e-ait-0275111b-openshift-default-5f574db866-wptpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 17:14:26.986950 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:26.986762    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 17:14:27.991278 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:27.991246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:27.992233 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:27.992212    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:48.278849 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:48.278807    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:14:49.820674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:49.820643    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"]
Jul 24 17:14:49.821085 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:49.820856    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy" containerID="cri-o://075a1df36531634d104d25c7e8b25760af97674feacac124ba9569b1fbd514ff" gracePeriod=30
Jul 24 17:14:50.839269 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.839232    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"]
Jul 24 17:14:50.843301 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.843276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.845845 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.845819    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9651e0f7-gw-openshift-default-dockercfg-c2qdz\""
Jul 24 17:14:50.855289 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.855260    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"]
Jul 24 17:14:50.986883 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.986846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-credential-socket\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.986883 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.986883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443eb153-664b-4852-94ca-c3f9adea28ca-istio-podinfo\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.987142 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.986910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-socket\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.987142 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.986966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-istio-token\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.987142 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.987020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443eb153-664b-4852-94ca-c3f9adea28ca-istiod-ca-cert\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.987142 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.987046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-envoy\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.987142 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.987117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6jdl\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-kube-api-access-p6jdl\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.987337 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.987157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-certs\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:50.987337 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:50.987174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-data\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.088641 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6jdl\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-kube-api-access-p6jdl\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.088838 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-certs\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.088838 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-data\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.088838 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-credential-socket\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.088838 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443eb153-664b-4852-94ca-c3f9adea28ca-istio-podinfo\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.088838 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-socket\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.089097 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-istio-token\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.089097 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443eb153-664b-4852-94ca-c3f9adea28ca-istiod-ca-cert\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.089097 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.088949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-envoy\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.089197 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.089146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-data\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.089197 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.089170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-certs\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.089640 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.089573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-socket\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.089640 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.089580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-credential-socket\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.089640 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.089621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443eb153-664b-4852-94ca-c3f9adea28ca-istiod-ca-cert\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.091393 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.091370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-envoy\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.091496 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.091392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443eb153-664b-4852-94ca-c3f9adea28ca-istio-podinfo\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.096927 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.096896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-istio-token\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.097063 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.097046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6jdl\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-kube-api-access-p6jdl\") pod \"e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") " pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.154941 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.154907    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:51.314908 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:14:51.312483    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443eb153_664b_4852_94ca_c3f9adea28ca.slice/crio-b941fbdff300b10791fc1baf4ef0e5d09a77e9befb064b4b3e3a23a17f52f9b7 WatchSource:0}: Error finding container b941fbdff300b10791fc1baf4ef0e5d09a77e9befb064b4b3e3a23a17f52f9b7: Status 404 returned error can't find the container with id b941fbdff300b10791fc1baf4ef0e5d09a77e9befb064b4b3e3a23a17f52f9b7
Jul 24 17:14:51.318476 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.318435    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:51.318609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.318534    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:51.318609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.318579    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:14:51.319545 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.319502    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"]
Jul 24 17:14:51.977593 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.977555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" event={"ID":"443eb153-664b-4852-94ca-c3f9adea28ca","Type":"ContainerStarted","Data":"77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d"}
Jul 24 17:14:51.977995 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.977609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" event={"ID":"443eb153-664b-4852-94ca-c3f9adea28ca","Type":"ContainerStarted","Data":"b941fbdff300b10791fc1baf4ef0e5d09a77e9befb064b4b3e3a23a17f52f9b7"}
Jul 24 17:14:51.999548 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:51.999466    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" podStartSLOduration=1.999450135 podStartE2EDuration="1.999450135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:51.998125944 +0000 UTC m=+1913.228873383" watchObservedRunningTime="2026-07-24 17:14:51.999450135 +0000 UTC m=+1913.230197623"
Jul 24 17:14:52.155814 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:52.155780    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:52.160449 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:52.160424    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:52.983840 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:52.983809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:52.984742 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:52.984720    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:14:54.998200 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:54.998167    2578 generic.go:356] "Generic (PLEG): container finished" podID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerID="075a1df36531634d104d25c7e8b25760af97674feacac124ba9569b1fbd514ff" exitCode=0
Jul 24 17:14:54.998660 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:54.998250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" event={"ID":"6061715b-4e08-4bd0-ac5c-781dee3b366a","Type":"ContainerDied","Data":"075a1df36531634d104d25c7e8b25760af97674feacac124ba9569b1fbd514ff"}
Jul 24 17:14:54.998660 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:54.998344    2578 scope.go:117] "RemoveContainer" containerID="0dc18340fbc5870688514a29503cfd7540e1ec10c9e0893c3ec1051c1af68aef"
Jul 24 17:14:55.082251 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.082223    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:55.230832 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.230793    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-token\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.230832 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.230832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-credential-socket\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.231095 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.230852    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-data\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.231095 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.230878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-podinfo\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.231095 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.230995    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvkhh\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-kube-api-access-wvkhh\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.231095 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-envoy\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.231305 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231155    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:55.231305 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231162    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-certs\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.231305 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231273    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-socket\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.231305 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061715b-4e08-4bd0-ac5c-781dee3b366a-istiod-ca-cert\") pod \"6061715b-4e08-4bd0-ac5c-781dee3b366a\" (UID: \"6061715b-4e08-4bd0-ac5c-781dee3b366a\") "
Jul 24 17:14:55.231565 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231539    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:55.231743 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231722    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:55.231817 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231750    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:55.231871 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231816    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:55.231871 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231857    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6061715b-4e08-4bd0-ac5c-781dee3b366a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:14:55.231964 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.231877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:55.233221 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.233202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:55.233386 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.233363    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:55.233608 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.233581    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:14:55.233698 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.233583    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-kube-api-access-wvkhh" (OuterVolumeSpecName: "kube-api-access-wvkhh") pod "6061715b-4e08-4bd0-ac5c-781dee3b366a" (UID: "6061715b-4e08-4bd0-ac5c-781dee3b366a"). InnerVolumeSpecName "kube-api-access-wvkhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:55.333004 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.332956    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvkhh\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-kube-api-access-wvkhh\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:55.333004 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.332994    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:55.333004 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.333007    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:55.333241 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.333018    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061715b-4e08-4bd0-ac5c-781dee3b366a-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:55.333241 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.333028    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:55.333241 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.333038    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:55.333241 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:55.333048    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061715b-4e08-4bd0-ac5c-781dee3b366a-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:14:56.014237 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:56.014190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm" event={"ID":"6061715b-4e08-4bd0-ac5c-781dee3b366a","Type":"ContainerDied","Data":"89d57fb616117ce92549724639f079f248f19da2adfa2f6a94c61c62a23a8e10"}
Jul 24 17:14:56.014728 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:56.014313    2578 scope.go:117] "RemoveContainer" containerID="075a1df36531634d104d25c7e8b25760af97674feacac124ba9569b1fbd514ff"
Jul 24 17:14:56.014728 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:56.014526    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"
Jul 24 17:14:56.034587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:56.034557    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"]
Jul 24 17:14:56.039091 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:56.039066    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0275111b-openshift-default-5f574db866-wptpm"]
Jul 24 17:14:57.312558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:57.312506    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" path="/var/lib/kubelet/pods/6061715b-4e08-4bd0-ac5c-781dee3b366a/volumes"
Jul 24 17:14:58.580659 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:14:58.580623    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:15:07.101406 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:07.101301    2578 generic.go:356] "Generic (PLEG): container finished" podID="443eb153-664b-4852-94ca-c3f9adea28ca" containerID="77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d" exitCode=0
Jul 24 17:15:07.101929 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:07.101498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" event={"ID":"443eb153-664b-4852-94ca-c3f9adea28ca","Type":"ContainerDied","Data":"77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d"}
Jul 24 17:15:07.102637 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:07.102609    2578 scope.go:117] "RemoveContainer" containerID="77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d"
Jul 24 17:15:07.104394 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:07.104353    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:07.104552 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:07.104528    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:07.104660 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:07.104638    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:07.984613 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:07.984578    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:15:08.109272 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:08.109236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" event={"ID":"443eb153-664b-4852-94ca-c3f9adea28ca","Type":"ContainerStarted","Data":"61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41"}
Jul 24 17:15:08.155740 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:08.155688    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:15:08.156980 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:08.156946    2578 patch_prober.go:28] interesting pod/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 24 17:15:08.157142 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:08.157055    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 24 17:15:09.155934 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:09.155894    2578 patch_prober.go:28] interesting pod/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 24 17:15:09.156342 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:09.155951    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 24 17:15:10.156025 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:10.155984    2578 patch_prober.go:28] interesting pod/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 24 17:15:10.156440 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:10.156058    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 24 17:15:11.155909 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:11.155868    2578 patch_prober.go:28] interesting pod/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 24 17:15:11.156096 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:11.155931    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 24 17:15:12.159665 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:12.159633    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:15:12.160108 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:12.160021    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:15:12.160742 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:12.160724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:15:32.077852 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:32.077813    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:15:33.702188 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:33.702152    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"]
Jul 24 17:15:33.702710 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:33.702377    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy" containerID="cri-o://61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41" gracePeriod=30
Jul 24 17:15:34.463910 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.463871    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"]
Jul 24 17:15:34.464499 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.464468    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy"
Jul 24 17:15:34.464499 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.464494    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy"
Jul 24 17:15:34.464696 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.464660    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy"
Jul 24 17:15:34.464696 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.464676    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy"
Jul 24 17:15:34.467452 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.467433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.469753 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.469733    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9300b6a3-openshift-default-dockercfg-w7kxl\""
Jul 24 17:15:34.477577 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.477551    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"]
Jul 24 17:15:34.610430 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b03d6b8-6407-4f29-8991-34394a9d19b1-istiod-ca-cert\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.610653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-data\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.610653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-credential-socket\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.610653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-socket\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.610653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-certs\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.610653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-token\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.610653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-podinfo\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.610653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsjjl\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-kube-api-access-zsjjl\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.610927 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.610761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-envoy\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b03d6b8-6407-4f29-8991-34394a9d19b1-istiod-ca-cert\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-data\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-credential-socket\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-socket\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-certs\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-token\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-podinfo\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsjjl\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-kube-api-access-zsjjl\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-envoy\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-credential-socket\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.712735 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-socket\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.713309 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-certs\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.713309 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.712912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-data\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.713309 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.713207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b03d6b8-6407-4f29-8991-34394a9d19b1-istiod-ca-cert\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.715007 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.714942    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-envoy\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.715102 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.715034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-podinfo\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.720182 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.720153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-token\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.720784 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.720765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsjjl\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-kube-api-access-zsjjl\") pod \"e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") " pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.779051 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.779004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:34.925312 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.925286    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"]
Jul 24 17:15:34.932445 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.932411    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:34.932620 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.932496    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:34.932620 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:34.932590    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:35.264687 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:35.264572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" event={"ID":"7b03d6b8-6407-4f29-8991-34394a9d19b1","Type":"ContainerStarted","Data":"fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b"}
Jul 24 17:15:35.264687 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:35.264633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" event={"ID":"7b03d6b8-6407-4f29-8991-34394a9d19b1","Type":"ContainerStarted","Data":"1da053ec59a6ffcd95be7af0c0229f10286ac9025e0452e455ac90455e48ea53"}
Jul 24 17:15:35.286938 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:35.286886    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" podStartSLOduration=1.286867397 podStartE2EDuration="1.286867397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:35.284140616 +0000 UTC m=+1956.514888075" watchObservedRunningTime="2026-07-24 17:15:35.286867397 +0000 UTC m=+1956.517614824"
Jul 24 17:15:35.779758 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:35.779713    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:35.785142 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:35.785115    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:36.270292 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:36.270252    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:36.271155 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:36.271132    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:38.958726 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:38.958655    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:15:39.055862 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.055772    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443eb153-664b-4852-94ca-c3f9adea28ca-istio-podinfo\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.055862 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.055821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-certs\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.055862 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.055844    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-istio-token\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.055862 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.055866    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443eb153-664b-4852-94ca-c3f9adea28ca-istiod-ca-cert\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.056196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.055895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-envoy\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.056196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.055910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-data\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.056196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.055973    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6jdl\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-kube-api-access-p6jdl\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.056196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056062    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-socket\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.056196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056105    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:15:39.056457 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-credential-socket\") pod \"443eb153-664b-4852-94ca-c3f9adea28ca\" (UID: \"443eb153-664b-4852-94ca-c3f9adea28ca\") "
Jul 24 17:15:39.056457 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056344    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/443eb153-664b-4852-94ca-c3f9adea28ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:15:39.056617 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056488    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:15:39.056808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056726    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.056808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056748    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443eb153-664b-4852-94ca-c3f9adea28ca-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.056808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056753    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:15:39.056808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.056761    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.057090 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.057025    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:15:39.058310 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.058284    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-kube-api-access-p6jdl" (OuterVolumeSpecName: "kube-api-access-p6jdl") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "kube-api-access-p6jdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:15:39.058310 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.058294    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:15:39.058559 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.058540    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:15:39.058637 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.058616    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/443eb153-664b-4852-94ca-c3f9adea28ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "443eb153-664b-4852-94ca-c3f9adea28ca" (UID: "443eb153-664b-4852-94ca-c3f9adea28ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:15:39.157748 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.157720    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.157748 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.157747    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443eb153-664b-4852-94ca-c3f9adea28ca-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.157748 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.157757    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.157980 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.157764    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.157980 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.157772    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443eb153-664b-4852-94ca-c3f9adea28ca-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.157980 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.157780    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6jdl\" (UniqueName: \"kubernetes.io/projected/443eb153-664b-4852-94ca-c3f9adea28ca-kube-api-access-p6jdl\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:15:39.289334 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.289300    2578 generic.go:356] "Generic (PLEG): container finished" podID="443eb153-664b-4852-94ca-c3f9adea28ca" containerID="61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41" exitCode=0
Jul 24 17:15:39.289556 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.289347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" event={"ID":"443eb153-664b-4852-94ca-c3f9adea28ca","Type":"ContainerDied","Data":"61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41"}
Jul 24 17:15:39.289556 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.289359    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"
Jul 24 17:15:39.289556 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.289392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc" event={"ID":"443eb153-664b-4852-94ca-c3f9adea28ca","Type":"ContainerDied","Data":"b941fbdff300b10791fc1baf4ef0e5d09a77e9befb064b4b3e3a23a17f52f9b7"}
Jul 24 17:15:39.289556 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.289414    2578 scope.go:117] "RemoveContainer" containerID="61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41"
Jul 24 17:15:39.299620 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.299603    2578 scope.go:117] "RemoveContainer" containerID="77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d"
Jul 24 17:15:39.307989 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.307964    2578 scope.go:117] "RemoveContainer" containerID="61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41"
Jul 24 17:15:39.308316 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:15:39.308278    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41\": container with ID starting with 61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41 not found: ID does not exist" containerID="61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41"
Jul 24 17:15:39.308422 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.308317    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41"} err="failed to get container status \"61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41\": rpc error: code = NotFound desc = could not find container \"61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41\": container with ID starting with 61ef85ce14242885956cac8b3eef7766642fbbdf9379cd949b014a6d139b6e41 not found: ID does not exist"
Jul 24 17:15:39.308422 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.308343    2578 scope.go:117] "RemoveContainer" containerID="77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d"
Jul 24 17:15:39.308636 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:15:39.308612    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d\": container with ID starting with 77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d not found: ID does not exist" containerID="77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d"
Jul 24 17:15:39.308721 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.308641    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d"} err="failed to get container status \"77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d\": rpc error: code = NotFound desc = could not find container \"77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d\": container with ID starting with 77a242679fdb7a532ad5dc2c02881f860e01f2bfea408f6182bb66fd9a3f8e2d not found: ID does not exist"
Jul 24 17:15:39.311607 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.311587    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"]
Jul 24 17:15:39.320801 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:39.320780    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9651e0f7-gw-openshift-default-68b669b444-w7gzc"]
Jul 24 17:15:41.311647 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:41.311612    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" path="/var/lib/kubelet/pods/443eb153-664b-4852-94ca-c3f9adea28ca/volumes"
Jul 24 17:15:43.276397 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:43.276351    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:15:51.272012 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:51.271975    2578 patch_prober.go:28] interesting pod/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:15:51.272418 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:51.272056    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 24 17:15:51.362084 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:51.361997    2578 generic.go:356] "Generic (PLEG): container finished" podID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerID="fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b" exitCode=0
Jul 24 17:15:51.362237 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:51.362073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" event={"ID":"7b03d6b8-6407-4f29-8991-34394a9d19b1","Type":"ContainerDied","Data":"fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b"}
Jul 24 17:15:51.362602 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:51.362584    2578 scope.go:117] "RemoveContainer" containerID="fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b"
Jul 24 17:15:51.363685 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:51.363657    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:51.363746 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:51.363734    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:51.363803 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:51.363791    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:15:52.370176 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:52.370138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" event={"ID":"7b03d6b8-6407-4f29-8991-34394a9d19b1","Type":"ContainerStarted","Data":"eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49"}
Jul 24 17:15:52.779796 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:52.779745    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:52.780140 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:52.780115    2578 patch_prober.go:28] interesting pod/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:15:52.780209 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:52.780167    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 24 17:15:53.779396 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:53.779360    2578 patch_prober.go:28] interesting pod/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:15:53.779843 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:53.779421    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 24 17:15:54.779668 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:54.779627    2578 patch_prober.go:28] interesting pod/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:15:54.780088 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:54.779687    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 24 17:15:55.780113 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:55.780073    2578 patch_prober.go:28] interesting pod/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:15:55.780546 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:55.780130    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 24 17:15:56.784155 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:56.784124    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:56.784560 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:56.784502    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:15:56.785090 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:15:56.785070    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:16:15.476908 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:15.476871    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:16:18.657676 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:18.657643    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"]
Jul 24 17:16:18.658115 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:18.657891    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy" containerID="cri-o://eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49" gracePeriod=30
Jul 24 17:16:19.373975 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.373934    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"]
Jul 24 17:16:19.374334 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.374322    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy"
Jul 24 17:16:19.374388 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.374336    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6061715b-4e08-4bd0-ac5c-781dee3b366a" containerName="istio-proxy"
Jul 24 17:16:19.374388 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.374355    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy"
Jul 24 17:16:19.374388 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.374361    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy"
Jul 24 17:16:19.374388 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.374367    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy"
Jul 24 17:16:19.374388 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.374372    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy"
Jul 24 17:16:19.374570 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.374446    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy"
Jul 24 17:16:19.374570 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.374454    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="443eb153-664b-4852-94ca-c3f9adea28ca" containerName="istio-proxy"
Jul 24 17:16:19.377507 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.377487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.379856 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.379837    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-57de5652-openshift-default-dockercfg-k55mf\""
Jul 24 17:16:19.390700 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.390675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"]
Jul 24 17:16:19.533964 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.533911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-podinfo\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.533964 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.533957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-socket\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.534226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.533988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-data\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.534226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.534016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-certs\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.534226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.534037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-token\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.534226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.534112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-envoy\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.534226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.534152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-credential-socket\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.534226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.534171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzq2r\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-kube-api-access-qzq2r\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.534560 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.534261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istiod-ca-cert\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.634960 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.634865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-podinfo\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.634960 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.634905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-socket\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.634960 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.634929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-data\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635258 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.634968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-certs\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635258 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-token\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635258 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-envoy\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635258 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-credential-socket\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635258 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzq2r\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-kube-api-access-qzq2r\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635258 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istiod-ca-cert\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635607 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-socket\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635607 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-certs\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635607 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-data\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635607 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-credential-socket\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.635917 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.635897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istiod-ca-cert\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.637314 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.637290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-envoy\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.637590 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.637572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-podinfo\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.643437 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.643412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-token\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.643579 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.643561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzq2r\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-kube-api-access-qzq2r\") pod \"e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") " pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.687434 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.687400    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:19.842167 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.842131    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"]
Jul 24 17:16:19.844443 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:16:19.844414    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe052014_5ed3_40b7_aa2c_d7a91419edcf.slice/crio-b440e080792e399508172a8ff464a53e2a5aad9f0828f8aa6c7fbad59ac6d74f WatchSource:0}: Error finding container b440e080792e399508172a8ff464a53e2a5aad9f0828f8aa6c7fbad59ac6d74f: Status 404 returned error can't find the container with id b440e080792e399508172a8ff464a53e2a5aad9f0828f8aa6c7fbad59ac6d74f
Jul 24 17:16:19.846971 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.846937    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:16:19.847060 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.847010    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:16:19.847060 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:19.847038    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:16:20.529985 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:20.529940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" event={"ID":"fe052014-5ed3-40b7-aa2c-d7a91419edcf","Type":"ContainerStarted","Data":"f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b"}
Jul 24 17:16:20.530185 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:20.530010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" event={"ID":"fe052014-5ed3-40b7-aa2c-d7a91419edcf","Type":"ContainerStarted","Data":"b440e080792e399508172a8ff464a53e2a5aad9f0828f8aa6c7fbad59ac6d74f"}
Jul 24 17:16:20.551090 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:20.551027    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" podStartSLOduration=1.551008424 podStartE2EDuration="1.551008424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:16:20.54927164 +0000 UTC m=+2001.780019067" watchObservedRunningTime="2026-07-24 17:16:20.551008424 +0000 UTC m=+2001.781756236"
Jul 24 17:16:20.688001 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:20.687959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:20.693103 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:20.693076    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:21.536345 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:21.536309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:21.537484 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:21.537458    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:23.925535 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:23.925449    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:16:24.086958 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.086910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-data\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.086958 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.086974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsjjl\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-kube-api-access-zsjjl\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.087229 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087016    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-envoy\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.087229 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087061    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-socket\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.087229 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087093    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-podinfo\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.087229 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087137    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-certs\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.087229 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087167    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-credential-socket\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.087229 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b03d6b8-6407-4f29-8991-34394a9d19b1-istiod-ca-cert\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.087229 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087225    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-token\") pod \"7b03d6b8-6407-4f29-8991-34394a9d19b1\" (UID: \"7b03d6b8-6407-4f29-8991-34394a9d19b1\") "
Jul 24 17:16:24.087737 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087683    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:16:24.087737 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087697    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:16:24.087962 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.087839    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:16:24.088056 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.088030    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b03d6b8-6407-4f29-8991-34394a9d19b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:16:24.088169 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.088032    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:16:24.089706 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.089676    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:16:24.089821 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.089702    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-kube-api-access-zsjjl" (OuterVolumeSpecName: "kube-api-access-zsjjl") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "kube-api-access-zsjjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:16:24.089889 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.089821    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:16:24.089931 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.089900    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b03d6b8-6407-4f29-8991-34394a9d19b1" (UID: "7b03d6b8-6407-4f29-8991-34394a9d19b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188685    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188717    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188727    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188737    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188747    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188756    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b03d6b8-6407-4f29-8991-34394a9d19b1-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188764    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188771    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b03d6b8-6407-4f29-8991-34394a9d19b1-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.188779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.188778    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsjjl\" (UniqueName: \"kubernetes.io/projected/7b03d6b8-6407-4f29-8991-34394a9d19b1-kube-api-access-zsjjl\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:16:24.280422 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.280385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:16:24.557139 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.557097    2578 generic.go:356] "Generic (PLEG): container finished" podID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerID="eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49" exitCode=0
Jul 24 17:16:24.557314 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.557148    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"
Jul 24 17:16:24.557314 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.557150    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" event={"ID":"7b03d6b8-6407-4f29-8991-34394a9d19b1","Type":"ContainerDied","Data":"eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49"}
Jul 24 17:16:24.557314 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.557282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg" event={"ID":"7b03d6b8-6407-4f29-8991-34394a9d19b1","Type":"ContainerDied","Data":"1da053ec59a6ffcd95be7af0c0229f10286ac9025e0452e455ac90455e48ea53"}
Jul 24 17:16:24.557419 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.557313    2578 scope.go:117] "RemoveContainer" containerID="eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49"
Jul 24 17:16:24.568235 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.568218    2578 scope.go:117] "RemoveContainer" containerID="fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b"
Jul 24 17:16:24.576711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.576691    2578 scope.go:117] "RemoveContainer" containerID="eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49"
Jul 24 17:16:24.576972 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:16:24.576952    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49\": container with ID starting with eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49 not found: ID does not exist" containerID="eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49"
Jul 24 17:16:24.577033 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.576981    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49"} err="failed to get container status \"eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49\": rpc error: code = NotFound desc = could not find container \"eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49\": container with ID starting with eb8e3b80030454225b68a7f91e37eccdddfba8e0bac849fde3fc89a652227a49 not found: ID does not exist"
Jul 24 17:16:24.577033 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.576999    2578 scope.go:117] "RemoveContainer" containerID="fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b"
Jul 24 17:16:24.577277 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:16:24.577258    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b\": container with ID starting with fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b not found: ID does not exist" containerID="fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b"
Jul 24 17:16:24.577314 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.577284    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b"} err="failed to get container status \"fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b\": rpc error: code = NotFound desc = could not find container \"fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b\": container with ID starting with fed785ae7ba9a1e5659ad6f00d0c2dc65b448fce3d0f91e15cef0c5caeed889b not found: ID does not exist"
Jul 24 17:16:24.581659 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.581638    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"]
Jul 24 17:16:24.585476 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:24.585452    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9300b6a3-openshift-default-66949768d-8cpxg"]
Jul 24 17:16:25.313329 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:25.313292    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" path="/var/lib/kubelet/pods/7b03d6b8-6407-4f29-8991-34394a9d19b1/volumes"
Jul 24 17:16:32.606436 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:32.606402    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerID="f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b" exitCode=0
Jul 24 17:16:32.606894 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:32.606455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" event={"ID":"fe052014-5ed3-40b7-aa2c-d7a91419edcf","Type":"ContainerDied","Data":"f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b"}
Jul 24 17:16:32.606894 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:32.606863    2578 scope.go:117] "RemoveContainer" containerID="f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b"
Jul 24 17:16:32.607919 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:32.607893    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:16:32.607981 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:32.607963    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:16:32.608019 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:32.607994    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:16:33.614921 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:33.614886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" event={"ID":"fe052014-5ed3-40b7-aa2c-d7a91419edcf","Type":"ContainerStarted","Data":"1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7"}
Jul 24 17:16:33.688620 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:33.688581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:33.689640 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:33.689611    2578 patch_prober.go:28] interesting pod/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:16:33.689753 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:33.689679    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 17:16:34.688818 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:34.688780    2578 patch_prober.go:28] interesting pod/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:16:34.689222 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:34.688836    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 17:16:35.688567 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:35.688499    2578 patch_prober.go:28] interesting pod/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:16:35.688730 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:35.688603    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 17:16:36.536879 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:36.536835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:36.688251 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:36.688210    2578 patch_prober.go:28] interesting pod/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:16:36.688433 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:36.688268    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 17:16:37.688060 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:37.688021    2578 patch_prober.go:28] interesting pod/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 17:16:37.688455 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:37.688085    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 17:16:38.691993 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:38.691962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:16:38.692809 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:16:38.692791    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:17:00.286815 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:00.286777    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:17:01.980391 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:01.980356    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"]
Jul 24 17:17:01.980798 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:01.980629    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy" containerID="cri-o://1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7" gracePeriod=30
Jul 24 17:17:07.242293 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.242227    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:17:07.316648 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316617    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-socket\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.316808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-token\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.316808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istiod-ca-cert\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.316808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316736    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-credential-socket\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.316808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316776    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-data\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.316808 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316803    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-envoy\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.317090 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316830    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzq2r\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-kube-api-access-qzq2r\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.317090 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316876    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-certs\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.317090 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316920    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:07.317090 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.316943    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-podinfo\") pod \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\" (UID: \"fe052014-5ed3-40b7-aa2c-d7a91419edcf\") "
Jul 24 17:17:07.317090 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.317056    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:07.317348 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.317151    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:17:07.317348 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.317312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:07.317470 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.317378    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.317470 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.317396    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.317470 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.317409    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.317812 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.317789    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:07.319126 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.319089    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:07.319221 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.319149    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-kube-api-access-qzq2r" (OuterVolumeSpecName: "kube-api-access-qzq2r") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "kube-api-access-qzq2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:07.319221 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.319167    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:17:07.319221 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.319167    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe052014-5ed3-40b7-aa2c-d7a91419edcf" (UID: "fe052014-5ed3-40b7-aa2c-d7a91419edcf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:07.418261 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.418221    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.418261 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.418256    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.418261 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.418265    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.418261 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.418272    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.418564 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.418281    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzq2r\" (UniqueName: \"kubernetes.io/projected/fe052014-5ed3-40b7-aa2c-d7a91419edcf-kube-api-access-qzq2r\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.418564 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.418290    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe052014-5ed3-40b7-aa2c-d7a91419edcf-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:17:07.816117 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.816080    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerID="1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7" exitCode=0
Jul 24 17:17:07.816264 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.816128    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"
Jul 24 17:17:07.816264 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.816143    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" event={"ID":"fe052014-5ed3-40b7-aa2c-d7a91419edcf","Type":"ContainerDied","Data":"1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7"}
Jul 24 17:17:07.816264 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.816188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg" event={"ID":"fe052014-5ed3-40b7-aa2c-d7a91419edcf","Type":"ContainerDied","Data":"b440e080792e399508172a8ff464a53e2a5aad9f0828f8aa6c7fbad59ac6d74f"}
Jul 24 17:17:07.816264 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.816209    2578 scope.go:117] "RemoveContainer" containerID="1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7"
Jul 24 17:17:07.826337 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.826316    2578 scope.go:117] "RemoveContainer" containerID="f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b"
Jul 24 17:17:07.834923 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.834895    2578 scope.go:117] "RemoveContainer" containerID="1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7"
Jul 24 17:17:07.835219 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:17:07.835198    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7\": container with ID starting with 1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7 not found: ID does not exist" containerID="1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7"
Jul 24 17:17:07.835287 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.835228    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7"} err="failed to get container status \"1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7\": rpc error: code = NotFound desc = could not find container \"1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7\": container with ID starting with 1ad3cbb9469e44392a81af416fddee90eb99d81d7a66604adb28c2b20afdd6d7 not found: ID does not exist"
Jul 24 17:17:07.835287 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.835247    2578 scope.go:117] "RemoveContainer" containerID="f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b"
Jul 24 17:17:07.835544 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:17:07.835503    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b\": container with ID starting with f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b not found: ID does not exist" containerID="f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b"
Jul 24 17:17:07.835593 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.835555    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b"} err="failed to get container status \"f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b\": rpc error: code = NotFound desc = could not find container \"f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b\": container with ID starting with f868fcc23d22269666cbec4f7526fb2b9174a70066cc735dde53c4b8d525c91b not found: ID does not exist"
Jul 24 17:17:07.841053 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.841029    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"]
Jul 24 17:17:07.845411 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:07.845387    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-57de5652-openshift-default-7646d8486d-wpnfg"]
Jul 24 17:17:09.312447 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:17:09.312412    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" path="/var/lib/kubelet/pods/fe052014-5ed3-40b7-aa2c-d7a91419edcf/volumes"
Jul 24 17:18:27.171585 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:27.171544    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:18:36.379675 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:36.379642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:18:39.892249 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892216    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"]
Jul 24 17:18:39.892668 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892638    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy"
Jul 24 17:18:39.892668 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892653    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy"
Jul 24 17:18:39.892668 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892665    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy"
Jul 24 17:18:39.892668 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892671    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy"
Jul 24 17:18:39.892805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892684    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy"
Jul 24 17:18:39.892805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892690    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy"
Jul 24 17:18:39.892805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892756    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy"
Jul 24 17:18:39.892805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892765    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy"
Jul 24 17:18:39.892805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.892773    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy"
Jul 24 17:18:39.894961 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.894944    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.898858 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.898837    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e30ccfde-openshift-default-dockercfg-hjrgs\""
Jul 24 17:18:39.916268 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.916237    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"]
Jul 24 17:18:39.982755 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-podinfo\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.982755 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istiod-ca-cert\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.983021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-socket\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.983021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-data\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.983021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-credential-socket\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.983021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-token\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.983021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-certs\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.983021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-envoy\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:39.983021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:39.982973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rr5x\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-kube-api-access-4rr5x\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084344 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-socket\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084344 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-data\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-credential-socket\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-token\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-certs\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-envoy\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rr5x\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-kube-api-access-4rr5x\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084879 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-podinfo\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084879 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istiod-ca-cert\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084879 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-data\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.084879 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.084797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-credential-socket\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.085050 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.085001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-socket\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.085241 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.085215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-certs\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.085370 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.085356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istiod-ca-cert\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.086903 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.086869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-envoy\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.087159 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.087141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-podinfo\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.092711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.092688    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-token\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.092795 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.092765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rr5x\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-kube-api-access-4rr5x\") pod \"e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") " pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.205689 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.205597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:40.359252 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.359224    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"]
Jul 24 17:18:40.361033 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:18:40.361000    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6363829a_a30c_4c0b_b3e2_84e4a6dd2ad6.slice/crio-c73b8675d7bfa46a6eddd6cb8b8ef5ce6e104abb9e09555a5ac3bd86f8b2e9ab WatchSource:0}: Error finding container c73b8675d7bfa46a6eddd6cb8b8ef5ce6e104abb9e09555a5ac3bd86f8b2e9ab: Status 404 returned error can't find the container with id c73b8675d7bfa46a6eddd6cb8b8ef5ce6e104abb9e09555a5ac3bd86f8b2e9ab
Jul 24 17:18:40.363369 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.363334    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:18:40.363472 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.363401    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:18:40.363472 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:40.363430    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:18:41.339857 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:41.339819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" event={"ID":"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6","Type":"ContainerStarted","Data":"fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a"}
Jul 24 17:18:41.340249 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:41.339881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" event={"ID":"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6","Type":"ContainerStarted","Data":"c73b8675d7bfa46a6eddd6cb8b8ef5ce6e104abb9e09555a5ac3bd86f8b2e9ab"}
Jul 24 17:18:41.363848 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:41.363794    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" podStartSLOduration=2.36377921 podStartE2EDuration="2.36377921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:41.361204289 +0000 UTC m=+2142.591951735" watchObservedRunningTime="2026-07-24 17:18:41.36377921 +0000 UTC m=+2142.594526637"
Jul 24 17:18:42.206584 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:42.206539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:42.211492 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:42.211461    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:42.345330 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:42.345287    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:42.346196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:42.346178    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:46.486678 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:46.486640    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:18:55.420848 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:55.420811    2578 generic.go:356] "Generic (PLEG): container finished" podID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerID="fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a" exitCode=0
Jul 24 17:18:55.421299 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:55.420886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" event={"ID":"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6","Type":"ContainerDied","Data":"fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a"}
Jul 24 17:18:55.421299 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:55.421277    2578 scope.go:117] "RemoveContainer" containerID="fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a"
Jul 24 17:18:55.422361 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:55.422335    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:18:55.422426 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:55.422402    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:18:55.422470 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:55.422436    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:18:56.428704 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:56.428651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" event={"ID":"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6","Type":"ContainerStarted","Data":"ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5"}
Jul 24 17:18:57.205777 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:57.205736    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:57.206793 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:57.206768    2578 patch_prober.go:28] interesting pod/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 24 17:18:57.206896 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:57.206826    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 24 17:18:57.345533 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:57.345480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:18:58.205994 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:58.205959    2578 patch_prober.go:28] interesting pod/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 24 17:18:58.206391 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:58.206017    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 24 17:18:59.205986 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:59.205947    2578 patch_prober.go:28] interesting pod/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 24 17:18:59.206151 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:18:59.206029    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 24 17:19:00.206804 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:00.206762    2578 patch_prober.go:28] interesting pod/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 24 17:19:00.207188 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:00.206832    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 24 17:19:01.210242 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:01.210209    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:19:01.211382 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:01.211361    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:19:08.580215 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:08.580173    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:19:16.590506 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:16.590471    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"]
Jul 24 17:19:16.590971 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:16.590717    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy" containerID="cri-o://ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5" gracePeriod=30
Jul 24 17:19:21.851977 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.851948    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:19:21.892335 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892249    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istiod-ca-cert\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892335 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892312    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-token\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892608 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892357    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-credential-socket\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892608 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892387    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-certs\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892608 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892457    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-podinfo\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892608 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892480    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rr5x\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-kube-api-access-4rr5x\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892608 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892567    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-envoy\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892608 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-data\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892921 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892627    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-socket\") pod \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\" (UID: \"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6\") "
Jul 24 17:19:21.892921 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:19:21.892921 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892879    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:19:21.893072 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892972    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:21.893072 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.892992    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:21.893180 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.893086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:19:21.893180 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.893165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:19:21.894184 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.894156    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-data" (OuterVolumeSpecName: "istio-data") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:19:21.894802 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.894773    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:19:21.894930 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.894899    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-token" (OuterVolumeSpecName: "istio-token") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:19:21.895058 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.895035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-kube-api-access-4rr5x" (OuterVolumeSpecName: "kube-api-access-4rr5x") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "kube-api-access-4rr5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:19:21.895125 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.895090    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" (UID: "6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:19:21.993836 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.993799    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:21.993836 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.993830    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rr5x\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-kube-api-access-4rr5x\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:21.993836 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.993840    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:21.993836 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.993849    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:21.994105 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.993858    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:21.994105 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.993866    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:21.994105 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:21.993875    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:19:22.588048 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.588017    2578 generic.go:356] "Generic (PLEG): container finished" podID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerID="ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5" exitCode=0
Jul 24 17:19:22.588225 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.588070    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"
Jul 24 17:19:22.588225 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.588104    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" event={"ID":"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6","Type":"ContainerDied","Data":"ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5"}
Jul 24 17:19:22.588225 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.588160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247" event={"ID":"6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6","Type":"ContainerDied","Data":"c73b8675d7bfa46a6eddd6cb8b8ef5ce6e104abb9e09555a5ac3bd86f8b2e9ab"}
Jul 24 17:19:22.588225 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.588183    2578 scope.go:117] "RemoveContainer" containerID="ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5"
Jul 24 17:19:22.598292 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.598273    2578 scope.go:117] "RemoveContainer" containerID="fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a"
Jul 24 17:19:22.606758 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.606738    2578 scope.go:117] "RemoveContainer" containerID="ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5"
Jul 24 17:19:22.607038 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:19:22.607016    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5\": container with ID starting with ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5 not found: ID does not exist" containerID="ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5"
Jul 24 17:19:22.607077 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.607048    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5"} err="failed to get container status \"ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5\": rpc error: code = NotFound desc = could not find container \"ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5\": container with ID starting with ffbbb82a876ab52d7e89a0673df388e36e898d8adb11ee0487551a994a15a6c5 not found: ID does not exist"
Jul 24 17:19:22.607077 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.607066    2578 scope.go:117] "RemoveContainer" containerID="fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a"
Jul 24 17:19:22.607313 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:19:22.607294    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a\": container with ID starting with fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a not found: ID does not exist" containerID="fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a"
Jul 24 17:19:22.607353 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.607320    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a"} err="failed to get container status \"fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a\": rpc error: code = NotFound desc = could not find container \"fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a\": container with ID starting with fc4b2b0d0e5e08325a212a76377b45f7d469b17d25c01e74f22e3a06f875dd5a not found: ID does not exist"
Jul 24 17:19:22.610859 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.610837    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"]
Jul 24 17:19:22.617392 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:22.617369    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e30ccfde-openshift-default-5cdbf9768-tw247"]
Jul 24 17:19:23.311780 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:23.311746    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" path="/var/lib/kubelet/pods/6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6/volumes"
Jul 24 17:19:35.912829 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.912791    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"]
Jul 24 17:19:35.913295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913191    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy"
Jul 24 17:19:35.913295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913202    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe052014-5ed3-40b7-aa2c-d7a91419edcf" containerName="istio-proxy"
Jul 24 17:19:35.913295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913211    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy"
Jul 24 17:19:35.913295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913217    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy"
Jul 24 17:19:35.913295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913225    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy"
Jul 24 17:19:35.913295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913232    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy"
Jul 24 17:19:35.913295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913288    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b03d6b8-6407-4f29-8991-34394a9d19b1" containerName="istio-proxy"
Jul 24 17:19:35.913295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913296    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy"
Jul 24 17:19:35.913573 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.913303    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6363829a-a30c-4c0b-b3e2-84e4a6dd2ad6" containerName="istio-proxy"
Jul 24 17:19:35.915672 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.915654    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:35.918256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.918233    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5e27a909-openshift-default-dockercfg-kdgch\""
Jul 24 17:19:35.929151 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:35.929121    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"]
Jul 24 17:19:36.026725 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a717a201-5757-409c-b097-55211fd31239-istio-podinfo\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.026913 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-socket\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.026913 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-istio-token\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.026913 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a717a201-5757-409c-b097-55211fd31239-istiod-ca-cert\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.026913 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-data\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.026913 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-certs\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.026913 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w485j\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-kube-api-access-w485j\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.027126 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-credential-socket\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.027126 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.026988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-envoy\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.128351 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-data\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.128351 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-certs\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.128665 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w485j\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-kube-api-access-w485j\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.128665 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-credential-socket\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.128825 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-envoy\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.128899 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-data\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.128952 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a717a201-5757-409c-b097-55211fd31239-istio-podinfo\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.128952 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-certs\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.129044 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.128974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-socket\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.129044 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.129005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-istio-token\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.129044 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.129030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a717a201-5757-409c-b097-55211fd31239-istiod-ca-cert\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.129198 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.129090    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-credential-socket\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.129323 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.129272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-socket\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.129745 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.129724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a717a201-5757-409c-b097-55211fd31239-istiod-ca-cert\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.131363 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.131341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a717a201-5757-409c-b097-55211fd31239-istio-podinfo\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.131446 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.131416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-envoy\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.136416 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.136389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-istio-token\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.136531 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.136490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w485j\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-kube-api-access-w485j\") pod \"e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") " pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.225210 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.225169    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:36.370026 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.369992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"]
Jul 24 17:19:36.371578 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:19:36.371553    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda717a201_5757_409c_b097_55211fd31239.slice/crio-1b268593cd8595b660a99a953100cce19352004820669c3bea611a6be135fb31 WatchSource:0}: Error finding container 1b268593cd8595b660a99a953100cce19352004820669c3bea611a6be135fb31: Status 404 returned error can't find the container with id 1b268593cd8595b660a99a953100cce19352004820669c3bea611a6be135fb31
Jul 24 17:19:36.374034 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.374003    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:19:36.374198 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.374080    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:19:36.374198 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.374126    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:19:36.670847 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.670745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" event={"ID":"a717a201-5757-409c-b097-55211fd31239","Type":"ContainerStarted","Data":"13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f"}
Jul 24 17:19:36.670847 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.670804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" event={"ID":"a717a201-5757-409c-b097-55211fd31239","Type":"ContainerStarted","Data":"1b268593cd8595b660a99a953100cce19352004820669c3bea611a6be135fb31"}
Jul 24 17:19:36.689766 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:36.689700    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" podStartSLOduration=1.6896778430000001 podStartE2EDuration="1.689677843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:19:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:19:36.688873107 +0000 UTC m=+2197.919620534" watchObservedRunningTime="2026-07-24 17:19:36.689677843 +0000 UTC m=+2197.920425271"
Jul 24 17:19:37.225608 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:37.225558    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:37.231000 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:37.230973    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:37.677994 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:37.677902    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:37.678994 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:37.678972    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:43.284062 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:43.284020    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:19:51.767330 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:51.767294    2578 generic.go:356] "Generic (PLEG): container finished" podID="a717a201-5757-409c-b097-55211fd31239" containerID="13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f" exitCode=0
Jul 24 17:19:51.767780 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:51.767366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" event={"ID":"a717a201-5757-409c-b097-55211fd31239","Type":"ContainerDied","Data":"13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f"}
Jul 24 17:19:51.767780 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:51.767770    2578 scope.go:117] "RemoveContainer" containerID="13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f"
Jul 24 17:19:51.768801 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:51.768776    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:19:51.768872 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:51.768840    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:19:51.768909 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:51.768870    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:19:52.677995 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:52.677952    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:52.775764 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:52.775720    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" event={"ID":"a717a201-5757-409c-b097-55211fd31239","Type":"ContainerStarted","Data":"56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02"}
Jul 24 17:19:53.225588 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:53.225551    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:53.226716 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:53.226687    2578 patch_prober.go:28] interesting pod/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:19:53.226855 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:53.226748    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 24 17:19:54.226220 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:54.226183    2578 patch_prober.go:28] interesting pod/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:19:54.226628 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:54.226239    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 24 17:19:55.225946 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:55.225899    2578 patch_prober.go:28] interesting pod/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:19:55.226133 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:55.225963    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 24 17:19:56.201555 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.201495    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"]
Jul 24 17:19:56.204048 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.204030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.207261 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.207236    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5e27a909\"/\"default-dockercfg-46c2n\""
Jul 24 17:19:56.207417 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.207248    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5e27a909\"/\"openshift-service-ca.crt\""
Jul 24 17:19:56.207417 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.207311    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5e27a909\"/\"kube-root-ca.crt\""
Jul 24 17:19:56.207417 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.207248    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5e27a909\"/\"e2e-lifecycle-model-5e27a909-kserve-self-signed-certs\""
Jul 24 17:19:56.215064 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.215038    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"]
Jul 24 17:19:56.225750 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.225718    2578 patch_prober.go:28] interesting pod/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 24 17:19:56.225902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.225780    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 24 17:19:56.244535 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.244034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvfcf\" (UniqueName: \"kubernetes.io/projected/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-kube-api-access-nvfcf\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.244535 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.244139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-model-cache\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.244535 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.244177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tmp-dir\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.244535 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.244226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-dshm\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.244535 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.244274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tls-certs\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.244535 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.244311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-home\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.345374 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.345332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-model-cache\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.345959 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.345935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tmp-dir\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.346173 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.346155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-dshm\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.346712 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.345965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-model-cache\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.346888 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.346280    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tmp-dir\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.347024 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.346693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tls-certs\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.347226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.347210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-home\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.347372 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.347357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvfcf\" (UniqueName: \"kubernetes.io/projected/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-kube-api-access-nvfcf\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.348152 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.348126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-home\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.353541 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.349798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tls-certs\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.353541 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.350017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-dshm\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.361206 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.361172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvfcf\" (UniqueName: \"kubernetes.io/projected/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-kube-api-access-nvfcf\") pod \"e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") " pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.514825 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.514787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:19:56.705867 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.705838    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"]
Jul 24 17:19:56.707555 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:19:56.707495    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ad7fdb8_b1c5_484a_941d_148cb54a4b13.slice/crio-01e6fa9dba74091ffae4a337a9e5dc83e51dbe392ee5866237f8d3cb33821c0d WatchSource:0}: Error finding container 01e6fa9dba74091ffae4a337a9e5dc83e51dbe392ee5866237f8d3cb33821c0d: Status 404 returned error can't find the container with id 01e6fa9dba74091ffae4a337a9e5dc83e51dbe392ee5866237f8d3cb33821c0d
Jul 24 17:19:56.800052 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.799961    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2" event={"ID":"2ad7fdb8-b1c5-484a-941d-148cb54a4b13","Type":"ContainerStarted","Data":"17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db"}
Jul 24 17:19:56.800052 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.800017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2" event={"ID":"2ad7fdb8-b1c5-484a-941d-148cb54a4b13","Type":"ContainerStarted","Data":"01e6fa9dba74091ffae4a337a9e5dc83e51dbe392ee5866237f8d3cb33821c0d"}
Jul 24 17:19:56.818484 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:56.818421    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2" podStartSLOduration=0.818405758 podStartE2EDuration="818.405758ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:19:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:19:56.816489858 +0000 UTC m=+2218.047237286" watchObservedRunningTime="2026-07-24 17:19:56.818405758 +0000 UTC m=+2218.049153184"
Jul 24 17:19:57.229909 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:57.229869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:57.230352 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:57.230293    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:57.231158 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:57.231136    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:19:59.469844 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:19:59.469811    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:20:06.515296 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:20:06.515262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:20:06.515867 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:20:06.515494    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:20:06.528047 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:20:06.528018    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:20:06.868845 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:20:06.868759    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:20:12.878805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:20:12.878759    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:20:31.880390 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:20:31.880305    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:20:40.879805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:20:40.879755    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:20:46.105770 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:20:46.105737    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"]
Jul 24 17:21:01.125272 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.125213    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2" podUID="2ad7fdb8-b1c5-484a-941d-148cb54a4b13" containerName="main" containerID="cri-o://17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db" gracePeriod=45
Jul 24 17:21:01.386017 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.385952    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:21:01.405789 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.405757    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-home\") pod \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") "
Jul 24 17:21:01.405974 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.405803    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-dshm\") pod \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") "
Jul 24 17:21:01.405974 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.405841    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-model-cache\") pod \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") "
Jul 24 17:21:01.405974 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.405881    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvfcf\" (UniqueName: \"kubernetes.io/projected/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-kube-api-access-nvfcf\") pod \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") "
Jul 24 17:21:01.405974 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.405904    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tmp-dir\") pod \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") "
Jul 24 17:21:01.405974 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.405949    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tls-certs\") pod \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\" (UID: \"2ad7fdb8-b1c5-484a-941d-148cb54a4b13\") "
Jul 24 17:21:01.406243 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.406075    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-home" (OuterVolumeSpecName: "home") pod "2ad7fdb8-b1c5-484a-941d-148cb54a4b13" (UID: "2ad7fdb8-b1c5-484a-941d-148cb54a4b13"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:01.406243 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.406162    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-model-cache" (OuterVolumeSpecName: "model-cache") pod "2ad7fdb8-b1c5-484a-941d-148cb54a4b13" (UID: "2ad7fdb8-b1c5-484a-941d-148cb54a4b13"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:01.406420 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.406368    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2ad7fdb8-b1c5-484a-941d-148cb54a4b13" (UID: "2ad7fdb8-b1c5-484a-941d-148cb54a4b13"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:01.406420 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.406388    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-home\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:01.406420 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.406411    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-model-cache\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:01.408721 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.408682    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ad7fdb8-b1c5-484a-941d-148cb54a4b13" (UID: "2ad7fdb8-b1c5-484a-941d-148cb54a4b13"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:21:01.408835 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.408772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-dshm" (OuterVolumeSpecName: "dshm") pod "2ad7fdb8-b1c5-484a-941d-148cb54a4b13" (UID: "2ad7fdb8-b1c5-484a-941d-148cb54a4b13"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:01.415043 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.415010    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-kube-api-access-nvfcf" (OuterVolumeSpecName: "kube-api-access-nvfcf") pod "2ad7fdb8-b1c5-484a-941d-148cb54a4b13" (UID: "2ad7fdb8-b1c5-484a-941d-148cb54a4b13"). InnerVolumeSpecName "kube-api-access-nvfcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:21:01.507116 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.507074    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-dshm\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:01.507116 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.507111    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvfcf\" (UniqueName: \"kubernetes.io/projected/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-kube-api-access-nvfcf\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:01.507116 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.507123    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tmp-dir\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:01.507356 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:01.507133    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ad7fdb8-b1c5-484a-941d-148cb54a4b13-tls-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:02.171801 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.171764    2578 generic.go:356] "Generic (PLEG): container finished" podID="2ad7fdb8-b1c5-484a-941d-148cb54a4b13" containerID="17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db" exitCode=0
Jul 24 17:21:02.172226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.171805    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"
Jul 24 17:21:02.172226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.171846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2" event={"ID":"2ad7fdb8-b1c5-484a-941d-148cb54a4b13","Type":"ContainerDied","Data":"17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db"}
Jul 24 17:21:02.172226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.171890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2" event={"ID":"2ad7fdb8-b1c5-484a-941d-148cb54a4b13","Type":"ContainerDied","Data":"01e6fa9dba74091ffae4a337a9e5dc83e51dbe392ee5866237f8d3cb33821c0d"}
Jul 24 17:21:02.172226 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.171909    2578 scope.go:117] "RemoveContainer" containerID="17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db"
Jul 24 17:21:02.181232 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.181215    2578 scope.go:117] "RemoveContainer" containerID="17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db"
Jul 24 17:21:02.181496 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:21:02.181476    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db\": container with ID starting with 17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db not found: ID does not exist" containerID="17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db"
Jul 24 17:21:02.181581 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.181526    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db"} err="failed to get container status \"17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db\": rpc error: code = NotFound desc = could not find container \"17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db\": container with ID starting with 17c5905fb3dbf180fddc71f7eed8da3bce48b55b4839d252e757ebcc8d2d08db not found: ID does not exist"
Jul 24 17:21:02.193331 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.193307    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"]
Jul 24 17:21:02.197434 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:02.197414    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5e27a909/e2e-lifecycle-model-5e27a909-kserve-694b8b6bc5-m59z2"]
Jul 24 17:21:03.311255 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:03.311219    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ad7fdb8-b1c5-484a-941d-148cb54a4b13" path="/var/lib/kubelet/pods/2ad7fdb8-b1c5-484a-941d-148cb54a4b13/volumes"
Jul 24 17:21:34.706773 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:34.706737    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"]
Jul 24 17:21:34.707361 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:34.706998    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy" containerID="cri-o://56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02" gracePeriod=30
Jul 24 17:21:36.494711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:36.494668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:21:39.969696 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.969630    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:21:39.979729 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.979705    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a717a201-5757-409c-b097-55211fd31239-istio-podinfo\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.979873 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.979793    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-socket\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.979873 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.979818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-envoy\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.979873 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.979852    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-istio-token\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.980040 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.979900    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a717a201-5757-409c-b097-55211fd31239-istiod-ca-cert\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.980040 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.979933    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-certs\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.980040 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.979968    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-credential-socket\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.980190 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:39.980284 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-data\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.980415 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980396    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w485j\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-kube-api-access-w485j\") pod \"a717a201-5757-409c-b097-55211fd31239\" (UID: \"a717a201-5757-409c-b097-55211fd31239\") "
Jul 24 17:21:39.980508 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980233    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:39.980508 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980346    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:39.980508 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a717a201-5757-409c-b097-55211fd31239-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:21:39.980761 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980742    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a717a201-5757-409c-b097-55211fd31239-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:39.980824 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980767    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:39.980824 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980780    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:39.980824 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980795    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:39.981016 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.980993    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-data" (OuterVolumeSpecName: "istio-data") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:39.982127 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.982105    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:21:39.982234 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.982138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a717a201-5757-409c-b097-55211fd31239-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:21:39.982466 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.982449    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-istio-token" (OuterVolumeSpecName: "istio-token") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:21:39.982668 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:39.982647    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-kube-api-access-w485j" (OuterVolumeSpecName: "kube-api-access-w485j") pod "a717a201-5757-409c-b097-55211fd31239" (UID: "a717a201-5757-409c-b097-55211fd31239"). InnerVolumeSpecName "kube-api-access-w485j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:21:40.081332 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.081293    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w485j\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-kube-api-access-w485j\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:40.081332 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.081325    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a717a201-5757-409c-b097-55211fd31239-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:40.081332 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.081334    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:40.081332 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.081342    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a717a201-5757-409c-b097-55211fd31239-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:40.081645 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.081350    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a717a201-5757-409c-b097-55211fd31239-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:21:40.385356 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.385271    2578 generic.go:356] "Generic (PLEG): container finished" podID="a717a201-5757-409c-b097-55211fd31239" containerID="56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02" exitCode=0
Jul 24 17:21:40.385356 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.385319    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"
Jul 24 17:21:40.385558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.385355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" event={"ID":"a717a201-5757-409c-b097-55211fd31239","Type":"ContainerDied","Data":"56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02"}
Jul 24 17:21:40.385558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.385407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7" event={"ID":"a717a201-5757-409c-b097-55211fd31239","Type":"ContainerDied","Data":"1b268593cd8595b660a99a953100cce19352004820669c3bea611a6be135fb31"}
Jul 24 17:21:40.386687 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.385429    2578 scope.go:117] "RemoveContainer" containerID="56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02"
Jul 24 17:21:40.396636 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.396618    2578 scope.go:117] "RemoveContainer" containerID="13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f"
Jul 24 17:21:40.405018 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.404998    2578 scope.go:117] "RemoveContainer" containerID="56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02"
Jul 24 17:21:40.405369 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:21:40.405339    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02\": container with ID starting with 56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02 not found: ID does not exist" containerID="56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02"
Jul 24 17:21:40.405482 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.405377    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02"} err="failed to get container status \"56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02\": rpc error: code = NotFound desc = could not find container \"56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02\": container with ID starting with 56412f7426ee617123b6a193fb71603131e1f9edd9f9cf46f7b25c0d5a9a1b02 not found: ID does not exist"
Jul 24 17:21:40.405482 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.405409    2578 scope.go:117] "RemoveContainer" containerID="13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f"
Jul 24 17:21:40.405726 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:21:40.405699    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f\": container with ID starting with 13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f not found: ID does not exist" containerID="13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f"
Jul 24 17:21:40.405845 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.405735    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f"} err="failed to get container status \"13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f\": rpc error: code = NotFound desc = could not find container \"13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f\": container with ID starting with 13a89570d737d3c9793268edaa9e5224a4f3a5f75b48358fc583b3780467ca3f not found: ID does not exist"
Jul 24 17:21:40.408417 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.408395    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"]
Jul 24 17:21:40.412061 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:40.412037    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5e27a909-openshift-default-7987c87b-qb8f7"]
Jul 24 17:21:41.310871 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:41.310832    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a717a201-5757-409c-b097-55211fd31239" path="/var/lib/kubelet/pods/a717a201-5757-409c-b097-55211fd31239/volumes"
Jul 24 17:21:44.687050 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:44.687016    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:21:56.379396 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:21:56.379309    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:22:31.002132 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.002099    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"]
Jul 24 17:22:31.003223 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003194    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy"
Jul 24 17:22:31.003223 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003223    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy"
Jul 24 17:22:31.003410 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003239    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy"
Jul 24 17:22:31.003410 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003248    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy"
Jul 24 17:22:31.003410 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003271    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad7fdb8-b1c5-484a-941d-148cb54a4b13" containerName="main"
Jul 24 17:22:31.003410 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003282    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad7fdb8-b1c5-484a-941d-148cb54a4b13" containerName="main"
Jul 24 17:22:31.003669 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003652    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ad7fdb8-b1c5-484a-941d-148cb54a4b13" containerName="main"
Jul 24 17:22:31.003732 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003686    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy"
Jul 24 17:22:31.003732 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.003703    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a717a201-5757-409c-b097-55211fd31239" containerName="istio-proxy"
Jul 24 17:22:31.008195 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.008167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.011335 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.011211    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0a7def-openshift-default-dockercfg-cw4sl\""
Jul 24 17:22:31.018531 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.018489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"]
Jul 24 17:22:31.044075 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-credential-socket\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.044278 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-socket\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.044278 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-certs\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.044278 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g85jz\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-kube-api-access-g85jz\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.044278 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-data\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.044278 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6263934-3b9f-4e86-99a0-65918ca82525-istiod-ca-cert\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.044622 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-istio-token\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.044622 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6263934-3b9f-4e86-99a0-65918ca82525-istio-podinfo\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.044622 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.044378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-envoy\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.145799 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.145752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-envoy\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.145989 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.145823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-credential-socket\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.145989 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.145871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-socket\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.145989 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.145903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-certs\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.145989 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.145974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g85jz\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-kube-api-access-g85jz\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.145996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-data\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.146045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6263934-3b9f-4e86-99a0-65918ca82525-istiod-ca-cert\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.146090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-istio-token\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146196 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.146116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6263934-3b9f-4e86-99a0-65918ca82525-istio-podinfo\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146430 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.146338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-credential-socket\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146505 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.146482    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-data\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.146494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-certs\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146657 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.146633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-socket\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.146877 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.146860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6263934-3b9f-4e86-99a0-65918ca82525-istiod-ca-cert\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.148250 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.148230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-envoy\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.148491 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.148473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6263934-3b9f-4e86-99a0-65918ca82525-istio-podinfo\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.154645 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.154617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-istio-token\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.154783 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.154759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g85jz\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-kube-api-access-g85jz\") pod \"e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") " pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.320791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.320700    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:31.467558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.467530    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"]
Jul 24 17:22:31.469344 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:22:31.469300    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6263934_3b9f_4e86_99a0_65918ca82525.slice/crio-796bb314e93760bcaec7a8d4835c800edd6b5f6fa886c8c28887ca4b129a10a1 WatchSource:0}: Error finding container 796bb314e93760bcaec7a8d4835c800edd6b5f6fa886c8c28887ca4b129a10a1: Status 404 returned error can't find the container with id 796bb314e93760bcaec7a8d4835c800edd6b5f6fa886c8c28887ca4b129a10a1
Jul 24 17:22:31.471983 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.471940    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:31.472079 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.472034    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:31.472122 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.472079    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:31.673242 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.673143    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" event={"ID":"e6263934-3b9f-4e86-99a0-65918ca82525","Type":"ContainerStarted","Data":"ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d"}
Jul 24 17:22:31.673242 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.673214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" event={"ID":"e6263934-3b9f-4e86-99a0-65918ca82525","Type":"ContainerStarted","Data":"796bb314e93760bcaec7a8d4835c800edd6b5f6fa886c8c28887ca4b129a10a1"}
Jul 24 17:22:31.692197 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:31.692131    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" podStartSLOduration=1.6921080069999999 podStartE2EDuration="1.692108007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:31.691832844 +0000 UTC m=+2372.922580310" watchObservedRunningTime="2026-07-24 17:22:31.692108007 +0000 UTC m=+2372.922855436"
Jul 24 17:22:32.321673 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:32.321633    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:32.327057 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:32.327029    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:32.679940 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:32.679853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:32.680789 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:32.680768    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:38.758095 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.758055    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"]
Jul 24 17:22:38.762191 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.762167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.765353 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.765329    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b3a7b4-openshift-default-dockercfg-4g274\""
Jul 24 17:22:38.774626 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.774596    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"]
Jul 24 17:22:38.825031 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.824994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-socket\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.825031 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.825030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2xh4\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-kube-api-access-w2xh4\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.825250 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.825074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-podinfo\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.825250 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.825125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istiod-ca-cert\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.825250 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.825148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-token\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.825250 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.825187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-data\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.825385 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.825275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-credential-socket\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.825385 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.825316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-certs\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.825385 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.825343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-envoy\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926297 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-socket\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926297 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2xh4\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-kube-api-access-w2xh4\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-podinfo\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istiod-ca-cert\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-token\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-data\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-credential-socket\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926871 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-certs\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926871 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-envoy\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926871 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-socket\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926974 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-data\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.926974 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926938    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-certs\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.927042 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.926985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-credential-socket\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.927259 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.927235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istiod-ca-cert\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.929029 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.929005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-envoy\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.929451 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.929419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-podinfo\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.933971 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.933948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-token\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:38.934086 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:38.934008    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2xh4\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-kube-api-access-w2xh4\") pod \"e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") " pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:39.073332 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:39.073238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:39.222908 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:39.222879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"]
Jul 24 17:22:39.224606 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:22:39.224577    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90ad2dc_f7a8_4304_a07f_e4a1e57858bc.slice/crio-fa01872f5f2030bd0796820584f78d62d0989be39da92a7fb9194e41fd4ad6a8 WatchSource:0}: Error finding container fa01872f5f2030bd0796820584f78d62d0989be39da92a7fb9194e41fd4ad6a8: Status 404 returned error can't find the container with id fa01872f5f2030bd0796820584f78d62d0989be39da92a7fb9194e41fd4ad6a8
Jul 24 17:22:39.226792 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:39.226761    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:39.226876 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:39.226825    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:39.226876 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:39.226855    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:39.722831 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:39.722794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" event={"ID":"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc","Type":"ContainerStarted","Data":"c21e8f5319d188fda2b0f6e3aeae6f840efbfa872f2c0f23e60d8d4bb528f702"}
Jul 24 17:22:39.723012 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:39.722864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" event={"ID":"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc","Type":"ContainerStarted","Data":"fa01872f5f2030bd0796820584f78d62d0989be39da92a7fb9194e41fd4ad6a8"}
Jul 24 17:22:39.742656 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:39.742600    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" podStartSLOduration=1.742582573 podStartE2EDuration="1.742582573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:39.739683306 +0000 UTC m=+2380.970430744" watchObservedRunningTime="2026-07-24 17:22:39.742582573 +0000 UTC m=+2380.973329999"
Jul 24 17:22:40.073766 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:40.073673    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:40.078814 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:40.078787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:40.728140 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:40.728099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:40.729327 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:40.729300    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:40.879215 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:40.879178    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:22:48.721697 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:48.721650    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:22:48.722186 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:48.721779    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:22:49.792207 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:49.792171    2578 generic.go:356] "Generic (PLEG): container finished" podID="e6263934-3b9f-4e86-99a0-65918ca82525" containerID="ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d" exitCode=0
Jul 24 17:22:49.792651 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:49.792221    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" event={"ID":"e6263934-3b9f-4e86-99a0-65918ca82525","Type":"ContainerDied","Data":"ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d"}
Jul 24 17:22:49.792769 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:49.792751    2578 scope.go:117] "RemoveContainer" containerID="ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d"
Jul 24 17:22:49.793940 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:49.793902    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:49.794006 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:49.793992    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:49.794043 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:49.794028    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:50.800193 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:50.800158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" event={"ID":"e6263934-3b9f-4e86-99a0-65918ca82525","Type":"ContainerStarted","Data":"564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35"}
Jul 24 17:22:51.321826 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:51.321796    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:51.322058 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:51.322031    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:22:51.322147 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:51.322091    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 17:22:51.799393 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:51.799354    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:22:52.321161 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:52.321122    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:22:52.321559 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:52.321178    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 17:22:53.321551 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:53.321494    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:22:53.322012 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:53.321576    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 17:22:54.321367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:54.321325    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:22:54.321577 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:54.321395    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 17:22:55.325549 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.325498    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:55.326038 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.326019    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:55.326761 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.326743    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:22:55.729567 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.729491    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 17:22:55.729760 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.729615    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 17:22:55.832610 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.832529    2578 generic.go:356] "Generic (PLEG): container finished" podID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerID="c21e8f5319d188fda2b0f6e3aeae6f840efbfa872f2c0f23e60d8d4bb528f702" exitCode=0
Jul 24 17:22:55.832833 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.832618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" event={"ID":"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc","Type":"ContainerDied","Data":"c21e8f5319d188fda2b0f6e3aeae6f840efbfa872f2c0f23e60d8d4bb528f702"}
Jul 24 17:22:55.833164 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.833144    2578 scope.go:117] "RemoveContainer" containerID="c21e8f5319d188fda2b0f6e3aeae6f840efbfa872f2c0f23e60d8d4bb528f702"
Jul 24 17:22:55.834310 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.834282    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:55.834371 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.834352    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:55.834420 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:55.834385    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:22:56.846647 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:56.846602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" event={"ID":"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc","Type":"ContainerStarted","Data":"25b82fa2a03f2e2ebac158352b22e3d2de69426147215c36f81b1be198b1ee2f"}
Jul 24 17:22:57.073903 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:57.073864    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:22:57.074130 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:57.074104    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 17:22:57.074190 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:57.074169    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 17:22:58.073728 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:58.073686    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 17:22:58.074137 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:58.073749    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 17:22:59.073877 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:59.073834    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 17:22:59.074276 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:22:59.073906    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 17:23:00.074089 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:00.074043    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 17:23:00.074615 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:00.074109    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 17:23:01.077674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:01.077642    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:23:01.078182 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:01.078165    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:23:01.078830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:01.078808    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:23:03.082545 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:03.082492    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:23:07.986424 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:07.986390    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"]
Jul 24 17:23:07.989042 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:07.989021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:07.991624 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:07.991598    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b3a7b4\"/\"kube-root-ca.crt\""
Jul 24 17:23:07.992456 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:07.992429    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b3a7b4\"/\"test-model-b3a7b4-kserve-self-signed-certs\""
Jul 24 17:23:07.992598 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:07.992500    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b3a7b4\"/\"default-dockercfg-f7fm2\""
Jul 24 17:23:07.992701 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:07.992595    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b3a7b4\"/\"openshift-service-ca.crt\""
Jul 24 17:23:08.002269 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.002243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"]
Jul 24 17:23:08.048395 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.048352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tmp-dir\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.048628 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.048410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-dshm\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.048628 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.048458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtqlc\" (UniqueName: \"kubernetes.io/projected/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-kube-api-access-rtqlc\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.048628 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.048567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-home\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.048628 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.048596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tls-certs\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.048795 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.048646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-model-cache\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.150378 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.150324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtqlc\" (UniqueName: \"kubernetes.io/projected/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-kube-api-access-rtqlc\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.150584 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.150457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-home\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.150584 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.150538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tls-certs\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.150729 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.150614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-model-cache\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.150729 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.150695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tmp-dir\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.150858 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.150736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-dshm\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.151274 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.151220    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-model-cache\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.151410 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.151289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-home\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.151410 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.151385    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tmp-dir\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.153743 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.153712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tls-certs\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.154230 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.154208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-dshm\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.159711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.159681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtqlc\" (UniqueName: \"kubernetes.io/projected/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-kube-api-access-rtqlc\") pod \"test-model-b3a7b4-kserve-7f8665b59-tkjdw\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") " pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.300070 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.299983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:08.436000 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.435966    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"]
Jul 24 17:23:08.437920 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:23:08.437890    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b62eeb1_aa33_4b14_ba72_a1eb0c3ba1dc.slice/crio-b5010e66d19279f68571ee22002f8fa778de4e594d1a6f15e15fe1b3aa0572f1 WatchSource:0}: Error finding container b5010e66d19279f68571ee22002f8fa778de4e594d1a6f15e15fe1b3aa0572f1: Status 404 returned error can't find the container with id b5010e66d19279f68571ee22002f8fa778de4e594d1a6f15e15fe1b3aa0572f1
Jul 24 17:23:08.928396 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.928346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw" event={"ID":"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc","Type":"ContainerStarted","Data":"0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf"}
Jul 24 17:23:08.928396 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.928397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw" event={"ID":"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc","Type":"ContainerStarted","Data":"b5010e66d19279f68571ee22002f8fa778de4e594d1a6f15e15fe1b3aa0572f1"}
Jul 24 17:23:08.948352 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:08.948301    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw" podStartSLOduration=1.948284471 podStartE2EDuration="1.948284471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:23:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:23:08.945014642 +0000 UTC m=+2410.175762069" watchObservedRunningTime="2026-07-24 17:23:08.948284471 +0000 UTC m=+2410.179031945"
Jul 24 17:23:14.683913 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:14.683877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:23:18.300537 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:18.300479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:18.300961 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:18.300557    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:18.313197 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:18.313171    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:18.996039 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:18.996010    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:23:28.575073 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:23:28.574984    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:24:01.909176 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:01.909141    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"]
Jul 24 17:24:05.982718 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:05.982680    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:24:16.928780 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:16.928736    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw" podUID="9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" containerName="main" containerID="cri-o://0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf" gracePeriod=45
Jul 24 17:24:17.186654 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.186593    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:24:17.242284 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242247    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-dshm\") pod \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") "
Jul 24 17:24:17.242447 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242290    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtqlc\" (UniqueName: \"kubernetes.io/projected/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-kube-api-access-rtqlc\") pod \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") "
Jul 24 17:24:17.242447 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242317    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tls-certs\") pod \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") "
Jul 24 17:24:17.242447 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242399    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tmp-dir\") pod \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") "
Jul 24 17:24:17.242447 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242437    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-home\") pod \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") "
Jul 24 17:24:17.242684 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242500    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-model-cache\") pod \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\" (UID: \"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc\") "
Jul 24 17:24:17.242744 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242689    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" (UID: "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:17.242832 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242810    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-home" (OuterVolumeSpecName: "home") pod "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" (UID: "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:17.242832 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242818    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" (UID: "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:17.242977 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242960    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tmp-dir\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:17.243034 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242983    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-home\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:17.243034 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.242999    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-model-cache\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:17.244668 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.244650    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" (UID: "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:24:17.244964 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.244937    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-dshm" (OuterVolumeSpecName: "dshm") pod "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" (UID: "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:17.245057 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.244981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-kube-api-access-rtqlc" (OuterVolumeSpecName: "kube-api-access-rtqlc") pod "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" (UID: "9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc"). InnerVolumeSpecName "kube-api-access-rtqlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:24:17.318232 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.318200    2578 generic.go:356] "Generic (PLEG): container finished" podID="9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" containerID="0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf" exitCode=0
Jul 24 17:24:17.318399 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.318239    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"
Jul 24 17:24:17.318399 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.318286    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw" event={"ID":"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc","Type":"ContainerDied","Data":"0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf"}
Jul 24 17:24:17.318399 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.318326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw" event={"ID":"9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc","Type":"ContainerDied","Data":"b5010e66d19279f68571ee22002f8fa778de4e594d1a6f15e15fe1b3aa0572f1"}
Jul 24 17:24:17.318399 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.318350    2578 scope.go:117] "RemoveContainer" containerID="0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf"
Jul 24 17:24:17.327444 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.327426    2578 scope.go:117] "RemoveContainer" containerID="0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf"
Jul 24 17:24:17.327728 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:24:17.327709    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf\": container with ID starting with 0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf not found: ID does not exist" containerID="0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf"
Jul 24 17:24:17.327805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.327735    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf"} err="failed to get container status \"0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf\": rpc error: code = NotFound desc = could not find container \"0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf\": container with ID starting with 0d528218b5c7c378f2bdd64ee4a7a441415acc882a0cab312f9fac04ba01f5cf not found: ID does not exist"
Jul 24 17:24:17.335274 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.335249    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"]
Jul 24 17:24:17.344004 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.343970    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b3a7b4/test-model-b3a7b4-kserve-7f8665b59-tkjdw"]
Jul 24 17:24:17.345021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.344996    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-dshm\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:17.345123 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.345026    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtqlc\" (UniqueName: \"kubernetes.io/projected/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-kube-api-access-rtqlc\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:17.345123 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:17.345047    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc-tls-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:19.312075 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:19.312042    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" path="/var/lib/kubelet/pods/9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc/volumes"
Jul 24 17:24:21.480103 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:21.480066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:24:23.496775 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:23.496734    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"]
Jul 24 17:24:23.497261 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:23.497045    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy" containerID="cri-o://564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35" gracePeriod=30
Jul 24 17:24:25.328405 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:25.328368    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:24:25.328813 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:25.328435    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:24:28.762426 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.762353    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:24:28.863598 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863551    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-data\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.863791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863614    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-istio-token\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.863791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-envoy\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.863791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-credential-socket\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.863791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6263934-3b9f-4e86-99a0-65918ca82525-istiod-ca-cert\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.863791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863778    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-certs\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.864060 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863810    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-socket\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.864060 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863854    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6263934-3b9f-4e86-99a0-65918ca82525-istio-podinfo\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.864060 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.863886    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g85jz\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-kube-api-access-g85jz\") pod \"e6263934-3b9f-4e86-99a0-65918ca82525\" (UID: \"e6263934-3b9f-4e86-99a0-65918ca82525\") "
Jul 24 17:24:28.864227 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.864079    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:28.864227 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.864204    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:28.864327 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.864277    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:28.864327 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.864297    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6263934-3b9f-4e86-99a0-65918ca82525-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:24:28.864432 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.864404    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:28.864493 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.864469    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:28.866064 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.866040    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:24:28.866064 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.866049    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:28.866064 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.866037    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6263934-3b9f-4e86-99a0-65918ca82525-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:24:28.866414 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.866400    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-kube-api-access-g85jz" (OuterVolumeSpecName: "kube-api-access-g85jz") pod "e6263934-3b9f-4e86-99a0-65918ca82525" (UID: "e6263934-3b9f-4e86-99a0-65918ca82525"). InnerVolumeSpecName "kube-api-access-g85jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:24:28.965587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.965530    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6263934-3b9f-4e86-99a0-65918ca82525-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:28.965587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.965564    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:28.965587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.965578    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6263934-3b9f-4e86-99a0-65918ca82525-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:28.965587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.965590    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g85jz\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-kube-api-access-g85jz\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:28.965587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.965601    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:28.965897 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.965613    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6263934-3b9f-4e86-99a0-65918ca82525-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:28.965897 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.965624    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:28.965897 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:28.965635    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6263934-3b9f-4e86-99a0-65918ca82525-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:29.388290 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.388251    2578 generic.go:356] "Generic (PLEG): container finished" podID="e6263934-3b9f-4e86-99a0-65918ca82525" containerID="564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35" exitCode=0
Jul 24 17:24:29.388485 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.388299    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"
Jul 24 17:24:29.388485 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.388334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" event={"ID":"e6263934-3b9f-4e86-99a0-65918ca82525","Type":"ContainerDied","Data":"564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35"}
Jul 24 17:24:29.388485 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.388393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj" event={"ID":"e6263934-3b9f-4e86-99a0-65918ca82525","Type":"ContainerDied","Data":"796bb314e93760bcaec7a8d4835c800edd6b5f6fa886c8c28887ca4b129a10a1"}
Jul 24 17:24:29.388485 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.388417    2578 scope.go:117] "RemoveContainer" containerID="564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35"
Jul 24 17:24:29.397792 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.397772    2578 scope.go:117] "RemoveContainer" containerID="ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d"
Jul 24 17:24:29.408459 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.408235    2578 scope.go:117] "RemoveContainer" containerID="564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35"
Jul 24 17:24:29.408627 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.408491    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"]
Jul 24 17:24:29.408627 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:24:29.408605    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35\": container with ID starting with 564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35 not found: ID does not exist" containerID="564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35"
Jul 24 17:24:29.408713 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.408629    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35"} err="failed to get container status \"564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35\": rpc error: code = NotFound desc = could not find container \"564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35\": container with ID starting with 564c10ba8df54c07c928c4cd01f1d43aea1e8fd37a20d19fe92795f33217de35 not found: ID does not exist"
Jul 24 17:24:29.408713 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.408647    2578 scope.go:117] "RemoveContainer" containerID="ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d"
Jul 24 17:24:29.408900 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:24:29.408883    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d\": container with ID starting with ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d not found: ID does not exist" containerID="ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d"
Jul 24 17:24:29.408943 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.408905    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d"} err="failed to get container status \"ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d\": rpc error: code = NotFound desc = could not find container \"ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d\": container with ID starting with ec6234d1bda36dba8e0d599f69e66b984f6fdd9b8841db3d49636db17c47656d not found: ID does not exist"
Jul 24 17:24:29.411108 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:29.411088    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0a7def-openshift-default-598dfd6b4-d2mjj"]
Jul 24 17:24:31.312162 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:31.312113    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" path="/var/lib/kubelet/pods/e6263934-3b9f-4e86-99a0-65918ca82525/volumes"
Jul 24 17:24:36.975482 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:36.975440    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:24:45.313388 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:45.313354    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"]
Jul 24 17:24:45.313903 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:45.313584    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy" containerID="cri-o://25b82fa2a03f2e2ebac158352b22e3d2de69426147215c36f81b1be198b1ee2f" gracePeriod=30
Jul 24 17:24:46.080338 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.080303    2578 patch_prober.go:28] interesting pod/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:24:46.080551 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.080364    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:24:46.175656 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.175622    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"]
Jul 24 17:24:46.176025 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176010    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy"
Jul 24 17:24:46.176068 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176026    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy"
Jul 24 17:24:46.176068 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176039    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" containerName="main"
Jul 24 17:24:46.176068 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176046    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" containerName="main"
Jul 24 17:24:46.176068 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176059    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy"
Jul 24 17:24:46.176068 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176066    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy"
Jul 24 17:24:46.176224 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176139    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy"
Jul 24 17:24:46.176224 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176148    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b62eeb1-aa33-4b14-ba72-a1eb0c3ba1dc" containerName="main"
Jul 24 17:24:46.176224 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.176154    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6263934-3b9f-4e86-99a0-65918ca82525" containerName="istio-proxy"
Jul 24 17:24:46.179283 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.179262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.181886 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.181864    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c87733-openshift-default-dockercfg-zzs4f\""
Jul 24 17:24:46.190990 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.190964    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"]
Jul 24 17:24:46.343311 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e077b25a-edc9-407c-814f-6c22f4964669-istio-podinfo\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.343311 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-socket\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.343816 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e077b25a-edc9-407c-814f-6c22f4964669-istiod-ca-cert\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.343816 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-credential-socket\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.343816 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-certs\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.343816 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-data\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.343816 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-istio-token\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.343816 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f487\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-kube-api-access-4f487\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.343816 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.343705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-envoy\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444440 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f487\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-kube-api-access-4f487\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444440 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-envoy\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444709 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e077b25a-edc9-407c-814f-6c22f4964669-istio-podinfo\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444709 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-socket\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444709 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e077b25a-edc9-407c-814f-6c22f4964669-istiod-ca-cert\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444709 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-credential-socket\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444709 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-certs\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444709 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-data\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.444709 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-istio-token\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.445125 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.444922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-socket\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.445281 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.445254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-credential-socket\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.445358 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.445292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-certs\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.445358 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.445305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e077b25a-edc9-407c-814f-6c22f4964669-istiod-ca-cert\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.445358 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.445342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-data\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.446963 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.446940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-envoy\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.447134 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.447115    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e077b25a-edc9-407c-814f-6c22f4964669-istio-podinfo\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.453635 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.453607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-istio-token\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.453737 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.453716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f487\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-kube-api-access-4f487\") pod \"e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") " pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.490839 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.490812    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:46.647924 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.647892    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"]
Jul 24 17:24:46.649221 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:24:46.649194    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode077b25a_edc9_407c_814f_6c22f4964669.slice/crio-fc4a04bef7524e2ff11e549eaf64b200e2f1a93c5fc84d47391c455305709233 WatchSource:0}: Error finding container fc4a04bef7524e2ff11e549eaf64b200e2f1a93c5fc84d47391c455305709233: Status 404 returned error can't find the container with id fc4a04bef7524e2ff11e549eaf64b200e2f1a93c5fc84d47391c455305709233
Jul 24 17:24:46.651425 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.651394    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:24:46.651553 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.651461    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:24:46.651553 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:46.651491    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:24:47.496323 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:47.496281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" event={"ID":"e077b25a-edc9-407c-814f-6c22f4964669","Type":"ContainerStarted","Data":"143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967"}
Jul 24 17:24:47.496738 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:47.496349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" event={"ID":"e077b25a-edc9-407c-814f-6c22f4964669","Type":"ContainerStarted","Data":"fc4a04bef7524e2ff11e549eaf64b200e2f1a93c5fc84d47391c455305709233"}
Jul 24 17:24:47.516822 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:47.516766    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" podStartSLOduration=1.516749836 podStartE2EDuration="1.516749836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:24:47.515881317 +0000 UTC m=+2508.746628768" watchObservedRunningTime="2026-07-24 17:24:47.516749836 +0000 UTC m=+2508.747497262"
Jul 24 17:24:48.491540 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:48.491476    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:48.496446 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:48.496416    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:48.504555 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:48.504526    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:48.505367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:48.505347    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:24:50.517865 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.517824    2578 generic.go:356] "Generic (PLEG): container finished" podID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerID="25b82fa2a03f2e2ebac158352b22e3d2de69426147215c36f81b1be198b1ee2f" exitCode=0
Jul 24 17:24:50.518315 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.517894    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" event={"ID":"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc","Type":"ContainerDied","Data":"25b82fa2a03f2e2ebac158352b22e3d2de69426147215c36f81b1be198b1ee2f"}
Jul 24 17:24:50.518315 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.518023    2578 scope.go:117] "RemoveContainer" containerID="c21e8f5319d188fda2b0f6e3aeae6f840efbfa872f2c0f23e60d8d4bb528f702"
Jul 24 17:24:50.573063 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.573003    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:24:50.582365 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582331    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-token\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582534 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-certs\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582534 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582413    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2xh4\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-kube-api-access-w2xh4\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582534 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-envoy\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-data\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582561    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-podinfo\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582593    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-credential-socket\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-socket\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582654    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istiod-ca-cert\") pod \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\" (UID: \"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc\") "
Jul 24 17:24:50.582971 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:50.582971 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582847    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:50.582971 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.582928    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:50.583152 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.583131    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:24:50.583212 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.583194    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:50.583267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.583213    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:50.583267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.583227    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:50.583434 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.583406    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:50.584853 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.584823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-kube-api-access-w2xh4" (OuterVolumeSpecName: "kube-api-access-w2xh4") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "kube-api-access-w2xh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:24:50.584853 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.584835    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:24:50.585332 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.585311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:24:50.585706 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.585677    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" (UID: "a90ad2dc-f7a8-4304-a07f-e4a1e57858bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:24:50.684273 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.684241    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:50.684273 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.684270    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2xh4\" (UniqueName: \"kubernetes.io/projected/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-kube-api-access-w2xh4\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:50.684273 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.684280    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:50.684498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.684288    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:50.684498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.684296    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:50.684498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:50.684303    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:24:51.525186 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:51.525109    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"
Jul 24 17:24:51.525186 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:51.525151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc" event={"ID":"a90ad2dc-f7a8-4304-a07f-e4a1e57858bc","Type":"ContainerDied","Data":"fa01872f5f2030bd0796820584f78d62d0989be39da92a7fb9194e41fd4ad6a8"}
Jul 24 17:24:51.525685 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:51.525214    2578 scope.go:117] "RemoveContainer" containerID="25b82fa2a03f2e2ebac158352b22e3d2de69426147215c36f81b1be198b1ee2f"
Jul 24 17:24:51.545824 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:51.545797    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"]
Jul 24 17:24:51.551225 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:51.551191    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b3a7b4-openshift-default-564b98846-8bplc"]
Jul 24 17:24:53.311886 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:53.311850    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" path="/var/lib/kubelet/pods/a90ad2dc-f7a8-4304-a07f-e4a1e57858bc/volumes"
Jul 24 17:24:54.285138 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.285100    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:24:54.758884 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.758856    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"]
Jul 24 17:24:54.759266 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.759253    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy"
Jul 24 17:24:54.759266 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.759264    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy"
Jul 24 17:24:54.759339 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.759275    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy"
Jul 24 17:24:54.759339 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.759281    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy"
Jul 24 17:24:54.759402 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.759351    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy"
Jul 24 17:24:54.764144 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.764124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.767874 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.767853    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-04ba18-openshift-default-dockercfg-4tw7t\""
Jul 24 17:24:54.786806 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.786774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"]
Jul 24 17:24:54.824661 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b315e0-c46e-4c57-9fe0-47f231036755-istiod-ca-cert\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.824661 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-envoy\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.824893 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b315e0-c46e-4c57-9fe0-47f231036755-istio-podinfo\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.824893 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-istio-token\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.824893 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-credential-socket\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.824893 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-socket\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.824893 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-data\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.825088 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-certs\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.825088 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.824929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cxwr\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-kube-api-access-6cxwr\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.925650 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.925616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b315e0-c46e-4c57-9fe0-47f231036755-istiod-ca-cert\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.925650 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.925656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-envoy\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.925906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.925671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b315e0-c46e-4c57-9fe0-47f231036755-istio-podinfo\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.925906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.925697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-istio-token\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.925906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.925727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-credential-socket\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.925906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.925805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-socket\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.926121 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.925947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-data\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.926121 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.925993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-certs\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.926121 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.926029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxwr\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-kube-api-access-6cxwr\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.926290 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.926132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-socket\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.926290 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.926197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-credential-socket\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.926406 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.926371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-data\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.926451 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.926411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-certs\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.926497 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.926473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b315e0-c46e-4c57-9fe0-47f231036755-istiod-ca-cert\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.928152 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.928120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-envoy\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.928301 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.928286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b315e0-c46e-4c57-9fe0-47f231036755-istio-podinfo\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.933546 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.933501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cxwr\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-kube-api-access-6cxwr\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:54.933906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:54.933888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-istio-token\") pod \"e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") " pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:55.074312 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:55.074210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:55.228939 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:55.228245    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"]
Jul 24 17:24:55.239341 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:55.238066    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:24:55.239341 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:55.238164    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:24:55.239341 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:55.238210    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:24:55.558988 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:55.558934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" event={"ID":"58b315e0-c46e-4c57-9fe0-47f231036755","Type":"ContainerStarted","Data":"f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4"}
Jul 24 17:24:55.559204 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:55.559052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" event={"ID":"58b315e0-c46e-4c57-9fe0-47f231036755","Type":"ContainerStarted","Data":"24ddec8f5a63ec6a21e15631e467ec69f6ff59417cfcdffa7af591890b755ac6"}
Jul 24 17:24:55.580798 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:55.580739    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" podStartSLOduration=1.5807216689999999 podStartE2EDuration="1.580721669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:24:55.579117091 +0000 UTC m=+2516.809864519" watchObservedRunningTime="2026-07-24 17:24:55.580721669 +0000 UTC m=+2516.811469095"
Jul 24 17:24:56.075331 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:56.075290    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:56.080867 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:56.080837    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:56.565247 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:56.565211    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:24:56.566551 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:24:56.566508    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:25:02.603189 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:02.603154    2578 generic.go:356] "Generic (PLEG): container finished" podID="e077b25a-edc9-407c-814f-6c22f4964669" containerID="143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967" exitCode=0
Jul 24 17:25:02.603701 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:02.603234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" event={"ID":"e077b25a-edc9-407c-814f-6c22f4964669","Type":"ContainerDied","Data":"143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967"}
Jul 24 17:25:02.603780 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:02.603715    2578 scope.go:117] "RemoveContainer" containerID="143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967"
Jul 24 17:25:02.604927 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:02.604901    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:25:02.605021 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:02.605006    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:25:02.605057 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:02.605044    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:25:03.505306 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:03.505247    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:25:03.611038 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:03.610998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" event={"ID":"e077b25a-edc9-407c-814f-6c22f4964669","Type":"ContainerStarted","Data":"608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708"}
Jul 24 17:25:04.491485 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:04.491447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:25:04.492785 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:04.492756    2578 patch_prober.go:28] interesting pod/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 24 17:25:04.492895 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:04.492809    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 24 17:25:05.138099 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:05.138057    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:25:05.491690 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:05.491650    2578 patch_prober.go:28] interesting pod/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 24 17:25:05.491867 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:05.491716    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 24 17:25:06.492083 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:06.492032    2578 patch_prober.go:28] interesting pod/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 24 17:25:06.492491 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:06.492113    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 24 17:25:07.491251 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:07.491207    2578 patch_prober.go:28] interesting pod/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 24 17:25:07.491435 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:07.491275    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 24 17:25:08.496183 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:08.496151    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:25:08.496686 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:08.496547    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:25:08.497284 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:08.497264    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:25:12.607734 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:12.607678    2578 patch_prober.go:28] interesting pod/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:25:12.608139 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:12.607755    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:25:13.182766 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:25:13.182719    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b315e0_c46e_4c57_9fe0_47f231036755.slice/crio-conmon-f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b315e0_c46e_4c57_9fe0_47f231036755.slice/crio-f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4.scope\": RecentStats: unable to find data in memory cache]"
Jul 24 17:25:13.688937 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:13.688905    2578 generic.go:356] "Generic (PLEG): container finished" podID="58b315e0-c46e-4c57-9fe0-47f231036755" containerID="f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4" exitCode=0
Jul 24 17:25:13.689348 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:13.688985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" event={"ID":"58b315e0-c46e-4c57-9fe0-47f231036755","Type":"ContainerDied","Data":"f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4"}
Jul 24 17:25:13.689406 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:13.689393    2578 scope.go:117] "RemoveContainer" containerID="f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4"
Jul 24 17:25:13.690476 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:13.690450    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:25:13.690600 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:13.690585    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:25:13.690642 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:13.690622    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:25:14.696980 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:14.696943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" event={"ID":"58b315e0-c46e-4c57-9fe0-47f231036755","Type":"ContainerStarted","Data":"d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5"}
Jul 24 17:25:15.074695 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:15.074656    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:25:15.074933 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:15.074905    2578 patch_prober.go:28] interesting pod/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 24 17:25:15.074985 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:15.074960    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 24 17:25:16.075444 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:16.075402    2578 patch_prober.go:28] interesting pod/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 24 17:25:16.075887 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:16.075493    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 24 17:25:17.075374 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:17.075329    2578 patch_prober.go:28] interesting pod/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 24 17:25:17.075596 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:17.075414    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 24 17:25:18.075445 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:18.075402    2578 patch_prober.go:28] interesting pod/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 24 17:25:18.075658 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:18.075481    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 24 17:25:19.079033 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:19.078997    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:25:19.079426 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:19.079344    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:25:19.079955 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:19.079936    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:25:32.274535 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:32.274479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:25:36.412596 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:36.412553    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"]
Jul 24 17:25:36.413088 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:36.412852    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy" containerID="cri-o://608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708" gracePeriod=30
Jul 24 17:25:38.499191 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:38.499153    2578 patch_prober.go:28] interesting pod/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:25:38.499598 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:38.499221    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:25:41.678388 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.678319    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:25:41.722414 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722376    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-credential-socket\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722633 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722454    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-socket\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722633 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722503    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-istio-token\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722633 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e077b25a-edc9-407c-814f-6c22f4964669-istio-podinfo\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722633 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722591    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-certs\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722849 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722633    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e077b25a-edc9-407c-814f-6c22f4964669-istiod-ca-cert\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722849 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722677    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f487\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-kube-api-access-4f487\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722849 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722709    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-envoy\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722849 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722736    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-data\") pod \"e077b25a-edc9-407c-814f-6c22f4964669\" (UID: \"e077b25a-edc9-407c-814f-6c22f4964669\") "
Jul 24 17:25:41.722849 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722800    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:25:41.723112 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.722867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:25:41.723112 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.723009    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:25:41.723231 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.723126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e077b25a-edc9-407c-814f-6c22f4964669-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:25:41.723231 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.723220    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.723328 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.723240    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.723328 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.723255    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.723762 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.723737    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-data" (OuterVolumeSpecName: "istio-data") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:25:41.725350 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.725321    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-istio-token" (OuterVolumeSpecName: "istio-token") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:25:41.725458 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.725356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-kube-api-access-4f487" (OuterVolumeSpecName: "kube-api-access-4f487") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "kube-api-access-4f487". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:25:41.725458 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.725365    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:25:41.725609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.725549    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e077b25a-edc9-407c-814f-6c22f4964669-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e077b25a-edc9-407c-814f-6c22f4964669" (UID: "e077b25a-edc9-407c-814f-6c22f4964669"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:25:41.824398 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.824366    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.824398 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.824394    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e077b25a-edc9-407c-814f-6c22f4964669-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.824398 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.824404    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e077b25a-edc9-407c-814f-6c22f4964669-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.824650 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.824412    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f487\" (UniqueName: \"kubernetes.io/projected/e077b25a-edc9-407c-814f-6c22f4964669-kube-api-access-4f487\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.824650 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.824422    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.824650 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.824430    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e077b25a-edc9-407c-814f-6c22f4964669-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:25:41.859626 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.859587    2578 generic.go:356] "Generic (PLEG): container finished" podID="e077b25a-edc9-407c-814f-6c22f4964669" containerID="608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708" exitCode=0
Jul 24 17:25:41.859792 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.859660    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"
Jul 24 17:25:41.859792 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.859680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" event={"ID":"e077b25a-edc9-407c-814f-6c22f4964669","Type":"ContainerDied","Data":"608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708"}
Jul 24 17:25:41.859792 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.859767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn" event={"ID":"e077b25a-edc9-407c-814f-6c22f4964669","Type":"ContainerDied","Data":"fc4a04bef7524e2ff11e549eaf64b200e2f1a93c5fc84d47391c455305709233"}
Jul 24 17:25:41.859908 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.859794    2578 scope.go:117] "RemoveContainer" containerID="608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708"
Jul 24 17:25:41.870093 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.870072    2578 scope.go:117] "RemoveContainer" containerID="143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967"
Jul 24 17:25:41.879576 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.879551    2578 scope.go:117] "RemoveContainer" containerID="608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708"
Jul 24 17:25:41.879896 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:25:41.879871    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708\": container with ID starting with 608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708 not found: ID does not exist" containerID="608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708"
Jul 24 17:25:41.880001 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.879903    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708"} err="failed to get container status \"608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708\": rpc error: code = NotFound desc = could not find container \"608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708\": container with ID starting with 608a8766d0a9b1142b3bf0a3130eb6c52afecc80582dbd5fa11678ebdd076708 not found: ID does not exist"
Jul 24 17:25:41.880001 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.879923    2578 scope.go:117] "RemoveContainer" containerID="143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967"
Jul 24 17:25:41.880222 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:25:41.880202    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967\": container with ID starting with 143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967 not found: ID does not exist" containerID="143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967"
Jul 24 17:25:41.880280 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.880232    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967"} err="failed to get container status \"143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967\": rpc error: code = NotFound desc = could not find container \"143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967\": container with ID starting with 143c6e8bb75b19cf1ba7f733800e1f52601d763f68c36c8241a528753c53d967 not found: ID does not exist"
Jul 24 17:25:41.881763 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.881739    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"]
Jul 24 17:25:41.886463 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:41.886439    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c87733-openshift-default-6d98dc895d-g6cpn"]
Jul 24 17:25:43.311289 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:43.311254    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e077b25a-edc9-407c-814f-6c22f4964669" path="/var/lib/kubelet/pods/e077b25a-edc9-407c-814f-6c22f4964669/volumes"
Jul 24 17:25:56.689596 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:25:56.689553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:26:03.178847 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:03.178812    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"]
Jul 24 17:26:03.179339 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:03.179039    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy" containerID="cri-o://d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5" gracePeriod=30
Jul 24 17:26:04.056558 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.056503    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"]
Jul 24 17:26:04.056916 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.056904    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy"
Jul 24 17:26:04.056960 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.056917    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy"
Jul 24 17:26:04.057012 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.057003    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy"
Jul 24 17:26:04.057047 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.057014    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90ad2dc-f7a8-4304-a07f-e4a1e57858bc" containerName="istio-proxy"
Jul 24 17:26:04.057047 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.057021    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy"
Jul 24 17:26:04.061886 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.061864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.064327 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.064304    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-de68c7-openshift-default-dockercfg-qtn56\""
Jul 24 17:26:04.074832 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.074805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"]
Jul 24 17:26:04.081331 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.081301    2578 patch_prober.go:28] interesting pod/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:26:04.081472 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.081353    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:26:04.244312 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-envoy\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.244312 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-podinfo\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.244830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-token\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.244830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-socket\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.244830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-credential-socket\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.244830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j77ds\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-kube-api-access-j77ds\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.244830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-data\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.244830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-certs\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.244830 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.244744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istiod-ca-cert\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.345682 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.345585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-credential-socket\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.345682 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.345636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j77ds\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-kube-api-access-j77ds\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.345682 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.345681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-data\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.345985 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.345708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-certs\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.345985 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.345767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istiod-ca-cert\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.345985 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.345802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-envoy\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.345985 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.345840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-podinfo\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.345985 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.345922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-token\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.346350 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.346325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-socket\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.346418 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.346008    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-credential-socket\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.346418 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.346117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-certs\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.346418 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.346080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-data\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.346598 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.346504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istiod-ca-cert\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.346657 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.346626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-socket\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.348169 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.348145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-envoy\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.348269 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.348246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-podinfo\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.353687 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.353666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-token\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.353797 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.353780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j77ds\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-kube-api-access-j77ds\") pod \"e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") " pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.371690 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.371662    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:04.518425 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.518395    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"]
Jul 24 17:26:04.520294 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:26:04.520267    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f0ab51_4fa3_49a1_ab60_1f7bc9825969.slice/crio-ffd9286030280d6ecaa006ed3ec0846d939012a3c9af698f6e637d28488ba99b WatchSource:0}: Error finding container ffd9286030280d6ecaa006ed3ec0846d939012a3c9af698f6e637d28488ba99b: Status 404 returned error can't find the container with id ffd9286030280d6ecaa006ed3ec0846d939012a3c9af698f6e637d28488ba99b
Jul 24 17:26:04.522854 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.522823    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:04.522928 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.522888    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:04.522928 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.522918    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:04.995992 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.995954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" event={"ID":"02f0ab51-4fa3-49a1-ab60-1f7bc9825969","Type":"ContainerStarted","Data":"cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646"}
Jul 24 17:26:04.996216 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:04.996025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" event={"ID":"02f0ab51-4fa3-49a1-ab60-1f7bc9825969","Type":"ContainerStarted","Data":"ffd9286030280d6ecaa006ed3ec0846d939012a3c9af698f6e637d28488ba99b"}
Jul 24 17:26:05.017313 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:05.017261    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" podStartSLOduration=1.017245679 podStartE2EDuration="1.017245679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:05.016199554 +0000 UTC m=+2586.246947007" watchObservedRunningTime="2026-07-24 17:26:05.017245679 +0000 UTC m=+2586.247993103"
Jul 24 17:26:05.372108 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:05.372026    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:05.377114 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:05.377089    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:06.001921 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:06.001881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:06.002950 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:06.002924    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:08.456126 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.456103    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:26:08.479189 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-envoy\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479306 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479193    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b315e0-c46e-4c57-9fe0-47f231036755-istiod-ca-cert\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479306 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479230    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-certs\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479306 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479258    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-istio-token\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479326    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-data\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479368    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-credential-socket\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479398    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-socket\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479433    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b315e0-c46e-4c57-9fe0-47f231036755-istio-podinfo\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479458    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cxwr\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-kube-api-access-6cxwr\") pod \"58b315e0-c46e-4c57-9fe0-47f231036755\" (UID: \"58b315e0-c46e-4c57-9fe0-47f231036755\") "
Jul 24 17:26:08.479804 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:08.479804 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479648    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b315e0-c46e-4c57-9fe0-47f231036755-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:26:08.479906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479812    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:08.479906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479852    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b315e0-c46e-4c57-9fe0-47f231036755-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:08.479906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479875    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:08.480067 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.479978    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:08.480205 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.480180    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-data" (OuterVolumeSpecName: "istio-data") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:08.481578 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.481554    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:26:08.481693 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.481581    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-istio-token" (OuterVolumeSpecName: "istio-token") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:26:08.481955 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.481928    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-kube-api-access-6cxwr" (OuterVolumeSpecName: "kube-api-access-6cxwr") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "kube-api-access-6cxwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:26:08.481955 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.481944    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58b315e0-c46e-4c57-9fe0-47f231036755-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58b315e0-c46e-4c57-9fe0-47f231036755" (UID: "58b315e0-c46e-4c57-9fe0-47f231036755"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:26:08.580340 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.580298    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:08.580340 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.580331    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:08.580340 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.580345    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:08.580634 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.580356    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b315e0-c46e-4c57-9fe0-47f231036755-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:08.580634 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.580367    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cxwr\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-kube-api-access-6cxwr\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:08.580634 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.580375    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b315e0-c46e-4c57-9fe0-47f231036755-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:08.580634 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:08.580383    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b315e0-c46e-4c57-9fe0-47f231036755-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:26:09.019748 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.019715    2578 generic.go:356] "Generic (PLEG): container finished" podID="58b315e0-c46e-4c57-9fe0-47f231036755" containerID="d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5" exitCode=0
Jul 24 17:26:09.019923 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.019769    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"
Jul 24 17:26:09.019923 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.019801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" event={"ID":"58b315e0-c46e-4c57-9fe0-47f231036755","Type":"ContainerDied","Data":"d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5"}
Jul 24 17:26:09.019923 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.019863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs" event={"ID":"58b315e0-c46e-4c57-9fe0-47f231036755","Type":"ContainerDied","Data":"24ddec8f5a63ec6a21e15631e467ec69f6ff59417cfcdffa7af591890b755ac6"}
Jul 24 17:26:09.019923 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.019896    2578 scope.go:117] "RemoveContainer" containerID="d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5"
Jul 24 17:26:09.029937 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.029866    2578 scope.go:117] "RemoveContainer" containerID="f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4"
Jul 24 17:26:09.038464 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.038445    2578 scope.go:117] "RemoveContainer" containerID="d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5"
Jul 24 17:26:09.038765 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:26:09.038749    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5\": container with ID starting with d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5 not found: ID does not exist" containerID="d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5"
Jul 24 17:26:09.038818 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.038776    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5"} err="failed to get container status \"d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5\": rpc error: code = NotFound desc = could not find container \"d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5\": container with ID starting with d27f5dbc45e3219efe497cfbba76c9834b77df150a637c2de9e3e64e330d8bb5 not found: ID does not exist"
Jul 24 17:26:09.038818 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.038793    2578 scope.go:117] "RemoveContainer" containerID="f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4"
Jul 24 17:26:09.039027 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:26:09.039007    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4\": container with ID starting with f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4 not found: ID does not exist" containerID="f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4"
Jul 24 17:26:09.039070 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.039034    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4"} err="failed to get container status \"f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4\": rpc error: code = NotFound desc = could not find container \"f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4\": container with ID starting with f6541ecf3a0322367d78b069549384ef088f647d0f15670ddea1bb4688724af4 not found: ID does not exist"
Jul 24 17:26:09.043096 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.043071    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"]
Jul 24 17:26:09.048458 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.048432    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-04ba18-openshift-default-b6dd9899d-xmwrs"]
Jul 24 17:26:09.313321 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:09.313224    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" path="/var/lib/kubelet/pods/58b315e0-c46e-4c57-9fe0-47f231036755/volumes"
Jul 24 17:26:11.586660 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:11.586619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:26:12.073159 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.073117    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"]
Jul 24 17:26:12.073838 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.073813    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy"
Jul 24 17:26:12.073838 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.073836    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy"
Jul 24 17:26:12.073993 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.073867    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy"
Jul 24 17:26:12.073993 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.073873    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e077b25a-edc9-407c-814f-6c22f4964669" containerName="istio-proxy"
Jul 24 17:26:12.073993 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.073940    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy"
Jul 24 17:26:12.073993 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.073949    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy"
Jul 24 17:26:12.078925 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.078906    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.081140 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.081118    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d73e95-openshift-default-dockercfg-xbqsl\""
Jul 24 17:26:12.088880 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.088858    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"]
Jul 24 17:26:12.115840 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.115808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-envoy\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.116004 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.115850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-credential-socket\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.116004 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.115876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2t5f\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-kube-api-access-c2t5f\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.116079 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.116014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-certs\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.116079 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.116069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8577f80-367b-46e3-ac24-7f46729981c1-istio-podinfo\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.116143 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.116114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-socket\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.116183 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.116152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-istio-token\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.116218 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.116205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-data\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.116252 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.116233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8577f80-367b-46e3-ac24-7f46729981c1-istiod-ca-cert\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217364 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-certs\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217364 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8577f80-367b-46e3-ac24-7f46729981c1-istio-podinfo\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-socket\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-istio-token\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-data\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8577f80-367b-46e3-ac24-7f46729981c1-istiod-ca-cert\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-envoy\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-credential-socket\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.217674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2t5f\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-kube-api-access-c2t5f\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.218059 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-certs\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.218059 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-data\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.218059 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.217893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-socket\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.218212 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.218130    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-credential-socket\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.218270 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.218248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8577f80-367b-46e3-ac24-7f46729981c1-istiod-ca-cert\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.219771 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.219749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-envoy\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.219953 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.219934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8577f80-367b-46e3-ac24-7f46729981c1-istio-podinfo\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.226013 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.225987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-istio-token\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.226123 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.226105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2t5f\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-kube-api-access-c2t5f\") pod \"e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") " pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.390087 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.390002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:12.535138 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.535103    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"]
Jul 24 17:26:12.535815 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:26:12.535789    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8577f80_367b_46e3_ac24_7f46729981c1.slice/crio-285410a511af69231e1f68021f762f78fb97b87f29105159c698ddb0ec84a4f7 WatchSource:0}: Error finding container 285410a511af69231e1f68021f762f78fb97b87f29105159c698ddb0ec84a4f7: Status 404 returned error can't find the container with id 285410a511af69231e1f68021f762f78fb97b87f29105159c698ddb0ec84a4f7
Jul 24 17:26:12.537962 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.537930    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:12.538051 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.537994    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:12.538051 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:12.538023    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:13.053798 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:13.053730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" event={"ID":"a8577f80-367b-46e3-ac24-7f46729981c1","Type":"ContainerStarted","Data":"c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6"}
Jul 24 17:26:13.054307 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:13.053841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" event={"ID":"a8577f80-367b-46e3-ac24-7f46729981c1","Type":"ContainerStarted","Data":"285410a511af69231e1f68021f762f78fb97b87f29105159c698ddb0ec84a4f7"}
Jul 24 17:26:13.073379 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:13.073312    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" podStartSLOduration=1.073288635 podStartE2EDuration="1.073288635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:13.072741325 +0000 UTC m=+2594.303488772" watchObservedRunningTime="2026-07-24 17:26:13.073288635 +0000 UTC m=+2594.304036062"
Jul 24 17:26:13.390568 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:13.390442    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:13.392083 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:13.392057    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:26:13.392212 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:13.392103    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 17:26:14.394805 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:14.394774    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:15.066230 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:15.066183    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:15.067114 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:15.067096    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:20.098110 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:20.098074    2578 generic.go:356] "Generic (PLEG): container finished" podID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerID="cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646" exitCode=0
Jul 24 17:26:20.098544 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:20.098142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" event={"ID":"02f0ab51-4fa3-49a1-ab60-1f7bc9825969","Type":"ContainerDied","Data":"cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646"}
Jul 24 17:26:20.098666 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:20.098646    2578 scope.go:117] "RemoveContainer" containerID="cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646"
Jul 24 17:26:20.099721 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:20.099691    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:20.099824 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:20.099801    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:20.099891 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:20.099853    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:20.980200 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:20.980148    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:26:21.002690 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:21.002654    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:21.106362 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:21.106301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" event={"ID":"02f0ab51-4fa3-49a1-ab60-1f7bc9825969","Type":"ContainerStarted","Data":"16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74"}
Jul 24 17:26:21.372665 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:21.372578    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:21.373602 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:21.373577    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 24 17:26:21.373663 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:21.373641    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 24 17:26:22.372306 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:22.372264    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 24 17:26:22.372943 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:22.372910    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 24 17:26:23.372581 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:23.372539    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 24 17:26:23.373061 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:23.372622    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 24 17:26:24.373168 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:24.373124    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 24 17:26:24.373797 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:24.373766    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 24 17:26:25.372541 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:25.372494    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 24 17:26:25.372718 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:25.372564    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 24 17:26:26.376564 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:26.376527    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:26.376991 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:26.376894    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:26.377577 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:26.377559    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:26:30.067790 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:30.067752    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:26:30.068214 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:30.067810    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 17:26:30.166213 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:30.166179    2578 generic.go:356] "Generic (PLEG): container finished" podID="a8577f80-367b-46e3-ac24-7f46729981c1" containerID="c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6" exitCode=0
Jul 24 17:26:30.166392 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:30.166251    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" event={"ID":"a8577f80-367b-46e3-ac24-7f46729981c1","Type":"ContainerDied","Data":"c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6"}
Jul 24 17:26:30.166697 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:30.166683    2578 scope.go:117] "RemoveContainer" containerID="c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6"
Jul 24 17:26:30.167727 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:30.167700    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:30.167797 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:30.167771    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:30.167847 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:30.167807    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:26:31.173864 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:31.173833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" event={"ID":"a8577f80-367b-46e3-ac24-7f46729981c1","Type":"ContainerStarted","Data":"7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed"}
Jul 24 17:26:31.390602 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:31.390561    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:31.390837 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:31.390809    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:26:31.390901 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:31.390879    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 17:26:32.390711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:32.390673    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:26:32.391197 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:32.390736    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 17:26:33.391336 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:33.391302    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:26:33.391776 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:33.391363    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 17:26:34.391295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:34.391257    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 17:26:34.391483 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:34.391332    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 17:26:35.394182 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:35.394149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:35.394631 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:35.394554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:35.395207 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:35.395188    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:26:43.175300 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:43.175266    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:26:59.373015 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:26:59.372977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:27:21.289170 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:27:21.289126    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:27:39.572747 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:27:39.572703    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:27:54.609101 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:27:54.609015    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:28:10.514831 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:28:10.514788    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:28:28.780324 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:28:28.780281    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:28:48.074005 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:28:48.073965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:29:07.982406 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:29:07.982365    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:29:33.577004 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:29:33.576924    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:30:18.184831 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:30:18.184797    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:30:42.677653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:30:42.677618    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:31:04.977892 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:04.977810    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:31:11.288232 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.288189    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"]
Jul 24 17:31:11.288714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.288680    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy"
Jul 24 17:31:11.288714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.288696    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b315e0-c46e-4c57-9fe0-47f231036755" containerName="istio-proxy"
Jul 24 17:31:11.291864 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.291842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.294256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.294232    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-de68c7\"/\"kube-root-ca.crt\""
Jul 24 17:31:11.295143 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.295117    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-de68c7\"/\"rate-test-model-de68c7-kserve-self-signed-certs\""
Jul 24 17:31:11.295296 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.295121    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-de68c7\"/\"openshift-service-ca.crt\""
Jul 24 17:31:11.295296 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.295178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-de68c7\"/\"default-dockercfg-sskzd\""
Jul 24 17:31:11.312323 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.312295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"]
Jul 24 17:31:11.378692 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.378652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475c6131-13b4-4593-9ebe-eb75f4df08ba-tls-certs\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.378692 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.378692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-home\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.378949 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.378749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g72v4\" (UniqueName: \"kubernetes.io/projected/475c6131-13b4-4593-9ebe-eb75f4df08ba-kube-api-access-g72v4\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.379009 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.378989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-model-cache\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.379061 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.379019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-dshm\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.379124 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.379099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-tmp-dir\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.479902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.479858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-tmp-dir\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.480110 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.479926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475c6131-13b4-4593-9ebe-eb75f4df08ba-tls-certs\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.480110 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.479951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-home\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.480110 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.479974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g72v4\" (UniqueName: \"kubernetes.io/projected/475c6131-13b4-4593-9ebe-eb75f4df08ba-kube-api-access-g72v4\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.480110 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.480043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-model-cache\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.480110 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.480073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-dshm\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.480391 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.480316    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-tmp-dir\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.480391 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.480364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-home\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.480484 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.480469    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-model-cache\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.482335 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.482305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-dshm\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.482667 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.482645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475c6131-13b4-4593-9ebe-eb75f4df08ba-tls-certs\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.487719 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.487698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g72v4\" (UniqueName: \"kubernetes.io/projected/475c6131-13b4-4593-9ebe-eb75f4df08ba-kube-api-access-g72v4\") pod \"rate-test-model-de68c7-kserve-645fc78fc5-dm8sj\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") " pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.602195 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.602094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:11.744666 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.744642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"]
Jul 24 17:31:11.747570 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:31:11.747541    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod475c6131_13b4_4593_9ebe_eb75f4df08ba.slice/crio-3461b5f19c04a0a8ff008b8cb4ba9946eb44a946a57628c94551f9a02a14046b WatchSource:0}: Error finding container 3461b5f19c04a0a8ff008b8cb4ba9946eb44a946a57628c94551f9a02a14046b: Status 404 returned error can't find the container with id 3461b5f19c04a0a8ff008b8cb4ba9946eb44a946a57628c94551f9a02a14046b
Jul 24 17:31:11.774182 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:11.774156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj" event={"ID":"475c6131-13b4-4593-9ebe-eb75f4df08ba","Type":"ContainerStarted","Data":"3461b5f19c04a0a8ff008b8cb4ba9946eb44a946a57628c94551f9a02a14046b"}
Jul 24 17:31:12.781649 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:12.781614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj" event={"ID":"475c6131-13b4-4593-9ebe-eb75f4df08ba","Type":"ContainerStarted","Data":"9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755"}
Jul 24 17:31:12.800054 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:12.799999    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj" podStartSLOduration=1.799983077 podStartE2EDuration="1.799983077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:12.79813809 +0000 UTC m=+2894.028885519" watchObservedRunningTime="2026-07-24 17:31:12.799983077 +0000 UTC m=+2894.030730504"
Jul 24 17:31:14.183763 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:14.183675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:31:21.603125 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:21.603081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:21.603673 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:21.603170    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:21.615851 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:21.615829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:31:21.846857 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:31:21.846826    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:32:17.331192 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:32:17.331152    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:32:37.798061 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:32:37.797975    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:32:53.006656 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:32:53.006616    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:32:59.004210 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:32:59.004172    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"]
Jul 24 17:33:00.983912 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:00.983871    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7508-139959434344496"]
Jul 24 17:33:00.987480 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:00.987462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434344496"
Jul 24 17:33:00.990885 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:00.990864    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-24fmh\""
Jul 24 17:33:01.013464 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:01.013434    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-139959434344496"]
Jul 24 17:33:01.160771 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:01.160732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbbls\" (UniqueName: \"kubernetes.io/projected/ef406db9-601e-44b7-abab-4553a6e08d02-kube-api-access-cbbls\") pod \"test-curl-7508-139959434344496\" (UID: \"ef406db9-601e-44b7-abab-4553a6e08d02\") " pod="opendatahub/test-curl-7508-139959434344496"
Jul 24 17:33:01.261699 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:01.261603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbbls\" (UniqueName: \"kubernetes.io/projected/ef406db9-601e-44b7-abab-4553a6e08d02-kube-api-access-cbbls\") pod \"test-curl-7508-139959434344496\" (UID: \"ef406db9-601e-44b7-abab-4553a6e08d02\") " pod="opendatahub/test-curl-7508-139959434344496"
Jul 24 17:33:01.276709 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:01.276687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbbls\" (UniqueName: \"kubernetes.io/projected/ef406db9-601e-44b7-abab-4553a6e08d02-kube-api-access-cbbls\") pod \"test-curl-7508-139959434344496\" (UID: \"ef406db9-601e-44b7-abab-4553a6e08d02\") " pod="opendatahub/test-curl-7508-139959434344496"
Jul 24 17:33:01.296193 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:01.296170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434344496"
Jul 24 17:33:01.453714 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:01.453689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-139959434344496"]
Jul 24 17:33:01.456398 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:33:01.456365    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef406db9_601e_44b7_abab_4553a6e08d02.slice/crio-a69d4b4e7545e76c770795c8ae511baa1524f263f6144534f9ec26ea25816838 WatchSource:0}: Error finding container a69d4b4e7545e76c770795c8ae511baa1524f263f6144534f9ec26ea25816838: Status 404 returned error can't find the container with id a69d4b4e7545e76c770795c8ae511baa1524f263f6144534f9ec26ea25816838
Jul 24 17:33:01.457864 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:01.457843    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:33:02.420487 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:02.420392    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef406db9-601e-44b7-abab-4553a6e08d02" containerID="06875e7f7e05c98c1d53bbbf39f7dbd89865190e7c7618646a9e40a8d17ad160" exitCode=0
Jul 24 17:33:02.420487 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:02.420470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-139959434344496" event={"ID":"ef406db9-601e-44b7-abab-4553a6e08d02","Type":"ContainerDied","Data":"06875e7f7e05c98c1d53bbbf39f7dbd89865190e7c7618646a9e40a8d17ad160"}
Jul 24 17:33:02.420906 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:02.420506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-139959434344496" event={"ID":"ef406db9-601e-44b7-abab-4553a6e08d02","Type":"ContainerStarted","Data":"a69d4b4e7545e76c770795c8ae511baa1524f263f6144534f9ec26ea25816838"}
Jul 24 17:33:03.566974 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.566948    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434344496"
Jul 24 17:33:03.582817 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.582790    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbbls\" (UniqueName: \"kubernetes.io/projected/ef406db9-601e-44b7-abab-4553a6e08d02-kube-api-access-cbbls\") pod \"ef406db9-601e-44b7-abab-4553a6e08d02\" (UID: \"ef406db9-601e-44b7-abab-4553a6e08d02\") "
Jul 24 17:33:03.584966 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.584937    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef406db9-601e-44b7-abab-4553a6e08d02-kube-api-access-cbbls" (OuterVolumeSpecName: "kube-api-access-cbbls") pod "ef406db9-601e-44b7-abab-4553a6e08d02" (UID: "ef406db9-601e-44b7-abab-4553a6e08d02"). InnerVolumeSpecName "kube-api-access-cbbls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:33:03.639540 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.639489    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7508-139959434344496_ef406db9-601e-44b7-abab-4553a6e08d02/test-curl-7508-139959434344496/0.log"
Jul 24 17:33:03.676154 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.676120    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7508-139959434344496"]
Jul 24 17:33:03.680603 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.680532    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7508-139959434344496"]
Jul 24 17:33:03.684291 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.684269    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbbls\" (UniqueName: \"kubernetes.io/projected/ef406db9-601e-44b7-abab-4553a6e08d02-kube-api-access-cbbls\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:03.810010 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.809970    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7508-139959434276912"]
Jul 24 17:33:03.810398 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.810385    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef406db9-601e-44b7-abab-4553a6e08d02" containerName="test-curl-7508-139959434344496"
Jul 24 17:33:03.810446 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.810400    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef406db9-601e-44b7-abab-4553a6e08d02" containerName="test-curl-7508-139959434344496"
Jul 24 17:33:03.810485 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.810480    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef406db9-601e-44b7-abab-4553a6e08d02" containerName="test-curl-7508-139959434344496"
Jul 24 17:33:03.813570 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.813552    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434276912"
Jul 24 17:33:03.827238 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.827211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-139959434276912"]
Jul 24 17:33:03.886682 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.886646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtfd4\" (UniqueName: \"kubernetes.io/projected/7d7ce5ce-ac7c-4cff-8242-913f8f814b99-kube-api-access-mtfd4\") pod \"test-curl-7508-139959434276912\" (UID: \"7d7ce5ce-ac7c-4cff-8242-913f8f814b99\") " pod="opendatahub/test-curl-7508-139959434276912"
Jul 24 17:33:03.987274 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.987242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtfd4\" (UniqueName: \"kubernetes.io/projected/7d7ce5ce-ac7c-4cff-8242-913f8f814b99-kube-api-access-mtfd4\") pod \"test-curl-7508-139959434276912\" (UID: \"7d7ce5ce-ac7c-4cff-8242-913f8f814b99\") " pod="opendatahub/test-curl-7508-139959434276912"
Jul 24 17:33:03.997141 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:03.997118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtfd4\" (UniqueName: \"kubernetes.io/projected/7d7ce5ce-ac7c-4cff-8242-913f8f814b99-kube-api-access-mtfd4\") pod \"test-curl-7508-139959434276912\" (UID: \"7d7ce5ce-ac7c-4cff-8242-913f8f814b99\") " pod="opendatahub/test-curl-7508-139959434276912"
Jul 24 17:33:04.122203 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:04.122168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434276912"
Jul 24 17:33:04.281039 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:04.281013    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-139959434276912"]
Jul 24 17:33:04.282626 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:33:04.282603    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d7ce5ce_ac7c_4cff_8242_913f8f814b99.slice/crio-aa45a096ba5b6cd2343bc5b56114ce68303348b61f54f4aaaff0b08ed0b13be5 WatchSource:0}: Error finding container aa45a096ba5b6cd2343bc5b56114ce68303348b61f54f4aaaff0b08ed0b13be5: Status 404 returned error can't find the container with id aa45a096ba5b6cd2343bc5b56114ce68303348b61f54f4aaaff0b08ed0b13be5
Jul 24 17:33:04.434133 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:04.434105    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434344496"
Jul 24 17:33:04.434309 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:04.434151    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a69d4b4e7545e76c770795c8ae511baa1524f263f6144534f9ec26ea25816838"
Jul 24 17:33:04.435293 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:04.435268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-139959434276912" event={"ID":"7d7ce5ce-ac7c-4cff-8242-913f8f814b99","Type":"ContainerStarted","Data":"aa45a096ba5b6cd2343bc5b56114ce68303348b61f54f4aaaff0b08ed0b13be5"}
Jul 24 17:33:04.445423 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:33:04.445395    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-139959434344496\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="ef406db9-601e-44b7-abab-4553a6e08d02" pod="opendatahub/test-curl-7508-139959434344496"
Jul 24 17:33:05.311439 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:05.311405    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef406db9-601e-44b7-abab-4553a6e08d02" path="/var/lib/kubelet/pods/ef406db9-601e-44b7-abab-4553a6e08d02/volumes"
Jul 24 17:33:05.449307 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:05.449273    2578 generic.go:356] "Generic (PLEG): container finished" podID="7d7ce5ce-ac7c-4cff-8242-913f8f814b99" containerID="cafa54486d6099b5b6116b737fff789da576868ee5bc58ac3435f2e48eeb92e1" exitCode=0
Jul 24 17:33:05.449475 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:05.449329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-139959434276912" event={"ID":"7d7ce5ce-ac7c-4cff-8242-913f8f814b99","Type":"ContainerDied","Data":"cafa54486d6099b5b6116b737fff789da576868ee5bc58ac3435f2e48eeb92e1"}
Jul 24 17:33:06.602338 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:06.602313    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434276912"
Jul 24 17:33:06.637935 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:06.637894    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7508-139959434276912_7d7ce5ce-ac7c-4cff-8242-913f8f814b99/test-curl-7508-139959434276912/0.log"
Jul 24 17:33:06.677966 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:06.677930    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7508-139959434276912"]
Jul 24 17:33:06.680364 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:06.680334    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7508-139959434276912"]
Jul 24 17:33:06.716795 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:06.716760    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtfd4\" (UniqueName: \"kubernetes.io/projected/7d7ce5ce-ac7c-4cff-8242-913f8f814b99-kube-api-access-mtfd4\") pod \"7d7ce5ce-ac7c-4cff-8242-913f8f814b99\" (UID: \"7d7ce5ce-ac7c-4cff-8242-913f8f814b99\") "
Jul 24 17:33:06.718969 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:06.718933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7ce5ce-ac7c-4cff-8242-913f8f814b99-kube-api-access-mtfd4" (OuterVolumeSpecName: "kube-api-access-mtfd4") pod "7d7ce5ce-ac7c-4cff-8242-913f8f814b99" (UID: "7d7ce5ce-ac7c-4cff-8242-913f8f814b99"). InnerVolumeSpecName "kube-api-access-mtfd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:33:06.817990 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:06.817953    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtfd4\" (UniqueName: \"kubernetes.io/projected/7d7ce5ce-ac7c-4cff-8242-913f8f814b99-kube-api-access-mtfd4\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:07.312694 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:07.312663    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d7ce5ce-ac7c-4cff-8242-913f8f814b99" path="/var/lib/kubelet/pods/7d7ce5ce-ac7c-4cff-8242-913f8f814b99/volumes"
Jul 24 17:33:07.462057 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:07.462028    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434276912"
Jul 24 17:33:07.462270 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:07.462091    2578 scope.go:117] "RemoveContainer" containerID="cafa54486d6099b5b6116b737fff789da576868ee5bc58ac3435f2e48eeb92e1"
Jul 24 17:33:10.100466 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.100430    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7508-139959428970512"]
Jul 24 17:33:10.100967 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.100897    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7ce5ce-ac7c-4cff-8242-913f8f814b99" containerName="test-curl-7508-139959434276912"
Jul 24 17:33:10.100967 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.100910    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7ce5ce-ac7c-4cff-8242-913f8f814b99" containerName="test-curl-7508-139959434276912"
Jul 24 17:33:10.101052 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.100977    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d7ce5ce-ac7c-4cff-8242-913f8f814b99" containerName="test-curl-7508-139959434276912"
Jul 24 17:33:10.103930 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.103912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959428970512"
Jul 24 17:33:10.106118 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.106096    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-24fmh\""
Jul 24 17:33:10.110712 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.110687    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-139959428970512"]
Jul 24 17:33:10.150770 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.150738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssdh5\" (UniqueName: \"kubernetes.io/projected/898f3b0c-2873-45d9-a74a-e48535653568-kube-api-access-ssdh5\") pod \"test-curl-7508-139959428970512\" (UID: \"898f3b0c-2873-45d9-a74a-e48535653568\") " pod="opendatahub/test-curl-7508-139959428970512"
Jul 24 17:33:10.251890 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.251848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssdh5\" (UniqueName: \"kubernetes.io/projected/898f3b0c-2873-45d9-a74a-e48535653568-kube-api-access-ssdh5\") pod \"test-curl-7508-139959428970512\" (UID: \"898f3b0c-2873-45d9-a74a-e48535653568\") " pod="opendatahub/test-curl-7508-139959428970512"
Jul 24 17:33:10.260954 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.260928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssdh5\" (UniqueName: \"kubernetes.io/projected/898f3b0c-2873-45d9-a74a-e48535653568-kube-api-access-ssdh5\") pod \"test-curl-7508-139959428970512\" (UID: \"898f3b0c-2873-45d9-a74a-e48535653568\") " pod="opendatahub/test-curl-7508-139959428970512"
Jul 24 17:33:10.383485 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.383399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:33:10.414115 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.414077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959428970512"
Jul 24 17:33:10.556986 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:10.555982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-139959428970512"]
Jul 24 17:33:10.557370 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:33:10.557339    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod898f3b0c_2873_45d9_a74a_e48535653568.slice/crio-6942767410f623f4a858b6e39f84fca9628b30a81fc0599582f61ce47c86d49a WatchSource:0}: Error finding container 6942767410f623f4a858b6e39f84fca9628b30a81fc0599582f61ce47c86d49a: Status 404 returned error can't find the container with id 6942767410f623f4a858b6e39f84fca9628b30a81fc0599582f61ce47c86d49a
Jul 24 17:33:11.489479 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:11.489443    2578 generic.go:356] "Generic (PLEG): container finished" podID="898f3b0c-2873-45d9-a74a-e48535653568" containerID="49477fa848a51cd8d31d141d9ada981bbf824af691891d7c6526ea66cfcb9f9c" exitCode=0
Jul 24 17:33:11.489888 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:11.489544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-139959428970512" event={"ID":"898f3b0c-2873-45d9-a74a-e48535653568","Type":"ContainerDied","Data":"49477fa848a51cd8d31d141d9ada981bbf824af691891d7c6526ea66cfcb9f9c"}
Jul 24 17:33:11.489888 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:11.489592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-139959428970512" event={"ID":"898f3b0c-2873-45d9-a74a-e48535653568","Type":"ContainerStarted","Data":"6942767410f623f4a858b6e39f84fca9628b30a81fc0599582f61ce47c86d49a"}
Jul 24 17:33:12.638623 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.638599    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959428970512"
Jul 24 17:33:12.662555 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.662532    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7508-139959428970512_898f3b0c-2873-45d9-a74a-e48535653568/test-curl-7508-139959428970512/0.log"
Jul 24 17:33:12.679898 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.679871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssdh5\" (UniqueName: \"kubernetes.io/projected/898f3b0c-2873-45d9-a74a-e48535653568-kube-api-access-ssdh5\") pod \"898f3b0c-2873-45d9-a74a-e48535653568\" (UID: \"898f3b0c-2873-45d9-a74a-e48535653568\") "
Jul 24 17:33:12.681937 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.681907    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898f3b0c-2873-45d9-a74a-e48535653568-kube-api-access-ssdh5" (OuterVolumeSpecName: "kube-api-access-ssdh5") pod "898f3b0c-2873-45d9-a74a-e48535653568" (UID: "898f3b0c-2873-45d9-a74a-e48535653568"). InnerVolumeSpecName "kube-api-access-ssdh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:33:12.691274 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.691249    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7508-139959428970512"]
Jul 24 17:33:12.696504 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.696481    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7508-139959428970512"]
Jul 24 17:33:12.781117 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.781027    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssdh5\" (UniqueName: \"kubernetes.io/projected/898f3b0c-2873-45d9-a74a-e48535653568-kube-api-access-ssdh5\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:12.825060 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.825030    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7508-139959434282448"]
Jul 24 17:33:12.825433 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.825420    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898f3b0c-2873-45d9-a74a-e48535653568" containerName="test-curl-7508-139959428970512"
Jul 24 17:33:12.825477 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.825434    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="898f3b0c-2873-45d9-a74a-e48535653568" containerName="test-curl-7508-139959428970512"
Jul 24 17:33:12.825543 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.825502    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="898f3b0c-2873-45d9-a74a-e48535653568" containerName="test-curl-7508-139959428970512"
Jul 24 17:33:12.828499 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.828483    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434282448"
Jul 24 17:33:12.836440 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.835376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-139959434282448"]
Jul 24 17:33:12.881708 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.881675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqpcp\" (UniqueName: \"kubernetes.io/projected/c9db1ed6-b91a-4bed-a011-dd5729033563-kube-api-access-sqpcp\") pod \"test-curl-7508-139959434282448\" (UID: \"c9db1ed6-b91a-4bed-a011-dd5729033563\") " pod="opendatahub/test-curl-7508-139959434282448"
Jul 24 17:33:12.982570 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.982501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqpcp\" (UniqueName: \"kubernetes.io/projected/c9db1ed6-b91a-4bed-a011-dd5729033563-kube-api-access-sqpcp\") pod \"test-curl-7508-139959434282448\" (UID: \"c9db1ed6-b91a-4bed-a011-dd5729033563\") " pod="opendatahub/test-curl-7508-139959434282448"
Jul 24 17:33:12.991828 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:12.991802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqpcp\" (UniqueName: \"kubernetes.io/projected/c9db1ed6-b91a-4bed-a011-dd5729033563-kube-api-access-sqpcp\") pod \"test-curl-7508-139959434282448\" (UID: \"c9db1ed6-b91a-4bed-a011-dd5729033563\") " pod="opendatahub/test-curl-7508-139959434282448"
Jul 24 17:33:13.138775 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:13.138689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434282448"
Jul 24 17:33:13.276137 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:13.276112    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-139959434282448"]
Jul 24 17:33:13.277910 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:33:13.277869    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9db1ed6_b91a_4bed_a011_dd5729033563.slice/crio-45f69e2f9a164720475fd57b20040b446e4fc8a06674df3fa1cf8ffc2bcca05b WatchSource:0}: Error finding container 45f69e2f9a164720475fd57b20040b446e4fc8a06674df3fa1cf8ffc2bcca05b: Status 404 returned error can't find the container with id 45f69e2f9a164720475fd57b20040b446e4fc8a06674df3fa1cf8ffc2bcca05b
Jul 24 17:33:13.312247 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:13.312223    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="898f3b0c-2873-45d9-a74a-e48535653568" path="/var/lib/kubelet/pods/898f3b0c-2873-45d9-a74a-e48535653568/volumes"
Jul 24 17:33:13.502663 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:13.502625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-139959434282448" event={"ID":"c9db1ed6-b91a-4bed-a011-dd5729033563","Type":"ContainerStarted","Data":"45f69e2f9a164720475fd57b20040b446e4fc8a06674df3fa1cf8ffc2bcca05b"}
Jul 24 17:33:13.503953 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:13.503933    2578 scope.go:117] "RemoveContainer" containerID="49477fa848a51cd8d31d141d9ada981bbf824af691891d7c6526ea66cfcb9f9c"
Jul 24 17:33:13.504095 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:13.503934    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959428970512"
Jul 24 17:33:14.023430 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.023381    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj" podUID="475c6131-13b4-4593-9ebe-eb75f4df08ba" containerName="main" containerID="cri-o://9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755" gracePeriod=45
Jul 24 17:33:14.278240 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.278213    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:33:14.396765 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.396725    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-dshm\") pod \"475c6131-13b4-4593-9ebe-eb75f4df08ba\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") "
Jul 24 17:33:14.396920 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.396824    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g72v4\" (UniqueName: \"kubernetes.io/projected/475c6131-13b4-4593-9ebe-eb75f4df08ba-kube-api-access-g72v4\") pod \"475c6131-13b4-4593-9ebe-eb75f4df08ba\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") "
Jul 24 17:33:14.396920 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.396855    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-tmp-dir\") pod \"475c6131-13b4-4593-9ebe-eb75f4df08ba\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") "
Jul 24 17:33:14.396920 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.396904    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-home\") pod \"475c6131-13b4-4593-9ebe-eb75f4df08ba\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") "
Jul 24 17:33:14.397107 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.396933    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475c6131-13b4-4593-9ebe-eb75f4df08ba-tls-certs\") pod \"475c6131-13b4-4593-9ebe-eb75f4df08ba\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") "
Jul 24 17:33:14.397107 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.396960    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-model-cache\") pod \"475c6131-13b4-4593-9ebe-eb75f4df08ba\" (UID: \"475c6131-13b4-4593-9ebe-eb75f4df08ba\") "
Jul 24 17:33:14.397213 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.397175    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "475c6131-13b4-4593-9ebe-eb75f4df08ba" (UID: "475c6131-13b4-4593-9ebe-eb75f4df08ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:33:14.397268 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.397206    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-home" (OuterVolumeSpecName: "home") pod "475c6131-13b4-4593-9ebe-eb75f4df08ba" (UID: "475c6131-13b4-4593-9ebe-eb75f4df08ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:33:14.397864 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.397840    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-tmp-dir\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:14.397864 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.397845    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "475c6131-13b4-4593-9ebe-eb75f4df08ba" (UID: "475c6131-13b4-4593-9ebe-eb75f4df08ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:33:14.398055 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.397975    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-home\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:14.399192 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.399165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-dshm" (OuterVolumeSpecName: "dshm") pod "475c6131-13b4-4593-9ebe-eb75f4df08ba" (UID: "475c6131-13b4-4593-9ebe-eb75f4df08ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:33:14.399465 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.399442    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/475c6131-13b4-4593-9ebe-eb75f4df08ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "475c6131-13b4-4593-9ebe-eb75f4df08ba" (UID: "475c6131-13b4-4593-9ebe-eb75f4df08ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:33:14.399465 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.399459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/475c6131-13b4-4593-9ebe-eb75f4df08ba-kube-api-access-g72v4" (OuterVolumeSpecName: "kube-api-access-g72v4") pod "475c6131-13b4-4593-9ebe-eb75f4df08ba" (UID: "475c6131-13b4-4593-9ebe-eb75f4df08ba"). InnerVolumeSpecName "kube-api-access-g72v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:33:14.499218 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.499187    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g72v4\" (UniqueName: \"kubernetes.io/projected/475c6131-13b4-4593-9ebe-eb75f4df08ba-kube-api-access-g72v4\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:14.499218 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.499214    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475c6131-13b4-4593-9ebe-eb75f4df08ba-tls-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:14.499218 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.499225    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-model-cache\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:14.499443 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.499233    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/475c6131-13b4-4593-9ebe-eb75f4df08ba-dshm\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:14.515653 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.515614    2578 generic.go:356] "Generic (PLEG): container finished" podID="475c6131-13b4-4593-9ebe-eb75f4df08ba" containerID="9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755" exitCode=0
Jul 24 17:33:14.515782 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.515676    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"
Jul 24 17:33:14.515782 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.515699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj" event={"ID":"475c6131-13b4-4593-9ebe-eb75f4df08ba","Type":"ContainerDied","Data":"9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755"}
Jul 24 17:33:14.515782 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.515742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj" event={"ID":"475c6131-13b4-4593-9ebe-eb75f4df08ba","Type":"ContainerDied","Data":"3461b5f19c04a0a8ff008b8cb4ba9946eb44a946a57628c94551f9a02a14046b"}
Jul 24 17:33:14.515782 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.515759    2578 scope.go:117] "RemoveContainer" containerID="9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755"
Jul 24 17:33:14.518533 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.518488    2578 generic.go:356] "Generic (PLEG): container finished" podID="c9db1ed6-b91a-4bed-a011-dd5729033563" containerID="dad552a0c87045df59dbd9f4941c466f2f6b776dc0caf530c3b5cd8dfe3c548a" exitCode=0
Jul 24 17:33:14.518635 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.518540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-139959434282448" event={"ID":"c9db1ed6-b91a-4bed-a011-dd5729033563","Type":"ContainerDied","Data":"dad552a0c87045df59dbd9f4941c466f2f6b776dc0caf530c3b5cd8dfe3c548a"}
Jul 24 17:33:14.526423 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.526412    2578 scope.go:117] "RemoveContainer" containerID="9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755"
Jul 24 17:33:14.526710 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:33:14.526689    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755\": container with ID starting with 9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755 not found: ID does not exist" containerID="9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755"
Jul 24 17:33:14.526788 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.526720    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755"} err="failed to get container status \"9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755\": rpc error: code = NotFound desc = could not find container \"9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755\": container with ID starting with 9b0e2d508da8e6c6f234bbcac6a157d4329e0474d5b8aa846ca2398045ca4755 not found: ID does not exist"
Jul 24 17:33:14.552208 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.552178    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"]
Jul 24 17:33:14.555844 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:14.555823    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-de68c7/rate-test-model-de68c7-kserve-645fc78fc5-dm8sj"]
Jul 24 17:33:15.311545 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:15.311498    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="475c6131-13b4-4593-9ebe-eb75f4df08ba" path="/var/lib/kubelet/pods/475c6131-13b4-4593-9ebe-eb75f4df08ba/volumes"
Jul 24 17:33:15.672135 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:15.672108    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434282448"
Jul 24 17:33:15.693031 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:15.693002    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7508-139959434282448_c9db1ed6-b91a-4bed-a011-dd5729033563/test-curl-7508-139959434282448/0.log"
Jul 24 17:33:15.723112 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:15.723077    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7508-139959434282448"]
Jul 24 17:33:15.731730 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:15.731699    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7508-139959434282448"]
Jul 24 17:33:15.811917 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:15.811878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqpcp\" (UniqueName: \"kubernetes.io/projected/c9db1ed6-b91a-4bed-a011-dd5729033563-kube-api-access-sqpcp\") pod \"c9db1ed6-b91a-4bed-a011-dd5729033563\" (UID: \"c9db1ed6-b91a-4bed-a011-dd5729033563\") "
Jul 24 17:33:15.814002 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:15.813974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9db1ed6-b91a-4bed-a011-dd5729033563-kube-api-access-sqpcp" (OuterVolumeSpecName: "kube-api-access-sqpcp") pod "c9db1ed6-b91a-4bed-a011-dd5729033563" (UID: "c9db1ed6-b91a-4bed-a011-dd5729033563"). InnerVolumeSpecName "kube-api-access-sqpcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:33:15.912708 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:15.912626    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqpcp\" (UniqueName: \"kubernetes.io/projected/c9db1ed6-b91a-4bed-a011-dd5729033563-kube-api-access-sqpcp\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:33:16.532948 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:16.532920    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-139959434282448"
Jul 24 17:33:16.533361 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:16.532961    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45f69e2f9a164720475fd57b20040b446e4fc8a06674df3fa1cf8ffc2bcca05b"
Jul 24 17:33:16.543007 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:33:16.542977    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-139959434282448\" is forbidden: User \"system:node:ip-10-0-140-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-49.ec2.internal' and this object" podUID="c9db1ed6-b91a-4bed-a011-dd5729033563" pod="opendatahub/test-curl-7508-139959434282448"
Jul 24 17:33:17.310997 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:17.310964    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9db1ed6-b91a-4bed-a011-dd5729033563" path="/var/lib/kubelet/pods/c9db1ed6-b91a-4bed-a011-dd5729033563/volumes"
Jul 24 17:33:19.910329 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.910291    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"]
Jul 24 17:33:19.910729 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.910716    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475c6131-13b4-4593-9ebe-eb75f4df08ba" containerName="main"
Jul 24 17:33:19.910729 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.910730    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="475c6131-13b4-4593-9ebe-eb75f4df08ba" containerName="main"
Jul 24 17:33:19.910804 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.910743    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9db1ed6-b91a-4bed-a011-dd5729033563" containerName="test-curl-7508-139959434282448"
Jul 24 17:33:19.910804 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.910749    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9db1ed6-b91a-4bed-a011-dd5729033563" containerName="test-curl-7508-139959434282448"
Jul 24 17:33:19.910871 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.910809    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="475c6131-13b4-4593-9ebe-eb75f4df08ba" containerName="main"
Jul 24 17:33:19.910871 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.910817    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9db1ed6-b91a-4bed-a011-dd5729033563" containerName="test-curl-7508-139959434282448"
Jul 24 17:33:19.913994 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.913977    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:19.917925 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.917907    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-6a1c15-openshift-default-dockercfg-w6xnn\""
Jul 24 17:33:19.944004 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:19.943971    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"]
Jul 24 17:33:20.054378 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istiod-ca-cert\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.054378 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-credential-socket\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.054613 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-certs\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.054613 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-podinfo\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.054613 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-data\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.054717 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-token\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.054717 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-socket\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.054779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054722    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkp7\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-kube-api-access-fpkp7\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.054779 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.054744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-envoy\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-certs\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-podinfo\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155590 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-data\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155590 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-token\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155590 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-socket\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155590 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkp7\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-kube-api-access-fpkp7\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155827 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-envoy\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155827 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155806    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-data\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155948 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-socket\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.155948 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.155931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-certs\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.156091 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.156071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istiod-ca-cert\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.156160 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.156128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-credential-socket\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.156527 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.156490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-credential-socket\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.156605 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.156589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istiod-ca-cert\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.157875 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.157857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-envoy\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.158030 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.158013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-podinfo\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.167649 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.167590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-token\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.167796 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.167776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkp7\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-kube-api-access-fpkp7\") pod \"e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") " pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.224711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.224662    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:20.386889 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.386858    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"]
Jul 24 17:33:20.388405 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:33:20.388380    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ee55cf_1409_4865_ae82_aa4a8eb1a6a2.slice/crio-15429f8cbdda85de6f74d9290af86ac9ab2ef03f069722a3e390dac127a3682e WatchSource:0}: Error finding container 15429f8cbdda85de6f74d9290af86ac9ab2ef03f069722a3e390dac127a3682e: Status 404 returned error can't find the container with id 15429f8cbdda85de6f74d9290af86ac9ab2ef03f069722a3e390dac127a3682e
Jul 24 17:33:20.390601 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.390566    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:20.390680 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.390645    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:20.390680 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.390676    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:20.559692 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.559638    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" event={"ID":"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2","Type":"ContainerStarted","Data":"02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336"}
Jul 24 17:33:20.559889 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.559716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" event={"ID":"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2","Type":"ContainerStarted","Data":"15429f8cbdda85de6f74d9290af86ac9ab2ef03f069722a3e390dac127a3682e"}
Jul 24 17:33:20.588910 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:20.588852    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" podStartSLOduration=1.5888358980000001 podStartE2EDuration="1.588835898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:33:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:33:20.585904565 +0000 UTC m=+3021.816651995" watchObservedRunningTime="2026-07-24 17:33:20.588835898 +0000 UTC m=+3021.819583325"
Jul 24 17:33:21.225017 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:21.224981    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:21.230436 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:21.230409    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:21.565705 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:21.565624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:21.566728 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:21.566710    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:30.885149 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:30.885109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:33:37.606713 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:37.606670    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:33:37.607099 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:37.606747    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:33:38.400154 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.400106    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"]
Jul 24 17:33:38.407669 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.407632    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.412818 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.412789    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a2f844-openshift-default-dockercfg-snxp7\""
Jul 24 17:33:38.422771 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.422743    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"]
Jul 24 17:33:38.444092 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-certs\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.444228 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-data\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.444228 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-socket\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.444347 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3716943-f5ca-43b3-8278-26c67cbdc822-istiod-ca-cert\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.444347 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444257    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-credential-socket\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.444347 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-token\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.444476 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5ld\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-kube-api-access-mn5ld\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.444476 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-envoy\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.444476 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.444409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-podinfo\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.545593 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-certs\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.545752 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-data\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.545752 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-socket\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.545752 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3716943-f5ca-43b3-8278-26c67cbdc822-istiod-ca-cert\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.545752 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-credential-socket\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.545752 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-token\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.545752 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5ld\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-kube-api-access-mn5ld\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.546109 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-envoy\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.546109 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-podinfo\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.546109 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.545926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-certs\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.546109 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.546028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-data\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.546109 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.546097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-socket\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.546380 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.546323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-credential-socket\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.546496 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.546476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3716943-f5ca-43b3-8278-26c67cbdc822-istiod-ca-cert\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.548270 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.548247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-envoy\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.548369 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.548338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-podinfo\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.559587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.559562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5ld\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-kube-api-access-mn5ld\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.566630 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.566610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-token\") pod \"e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") " pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.719788 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.719750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:38.873839 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.873777    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"]
Jul 24 17:33:38.876818 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:33:38.876791    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3716943_f5ca_43b3_8278_26c67cbdc822.slice/crio-a4dbca20b2fbe18d090a318fd2dd4dc47e26ef0a40eaa5486c806d6849989c08 WatchSource:0}: Error finding container a4dbca20b2fbe18d090a318fd2dd4dc47e26ef0a40eaa5486c806d6849989c08: Status 404 returned error can't find the container with id a4dbca20b2fbe18d090a318fd2dd4dc47e26ef0a40eaa5486c806d6849989c08
Jul 24 17:33:38.878986 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.878953    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:38.879054 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.879023    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:38.879092 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:38.879050    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:39.689383 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.689332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" event={"ID":"c3716943-f5ca-43b3-8278-26c67cbdc822","Type":"ContainerStarted","Data":"1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af"}
Jul 24 17:33:39.689623 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.689404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" event={"ID":"c3716943-f5ca-43b3-8278-26c67cbdc822","Type":"ContainerStarted","Data":"a4dbca20b2fbe18d090a318fd2dd4dc47e26ef0a40eaa5486c806d6849989c08"}
Jul 24 17:33:39.691039 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.691015    2578 generic.go:356] "Generic (PLEG): container finished" podID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerID="02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336" exitCode=0
Jul 24 17:33:39.691137 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.691050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" event={"ID":"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2","Type":"ContainerDied","Data":"02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336"}
Jul 24 17:33:39.691408 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.691394    2578 scope.go:117] "RemoveContainer" containerID="02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336"
Jul 24 17:33:39.692736 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.692702    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:39.692810 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.692790    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:39.692850 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.692833    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:39.717728 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.717680    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" podStartSLOduration=1.7176636950000002 podStartE2EDuration="1.717663695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:33:39.714394922 +0000 UTC m=+3040.945142349" watchObservedRunningTime="2026-07-24 17:33:39.717663695 +0000 UTC m=+3040.948411122"
Jul 24 17:33:39.720587 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.720561    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:39.721886 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.721866    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 24 17:33:39.721950 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:39.721920    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 24 17:33:40.699040 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:40.699002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" event={"ID":"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2","Type":"ContainerStarted","Data":"6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6"}
Jul 24 17:33:40.724532 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:40.724480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:41.225441 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:41.225391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:41.225776 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:41.225752    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 24 17:33:41.225831 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:41.225808    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 24 17:33:41.705956 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:41.705859    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:41.706851 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:41.706829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:42.225300 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:42.225263    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 24 17:33:42.225675 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:42.225333    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 24 17:33:43.226046 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:43.226007    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 24 17:33:43.226456 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:43.226080    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 24 17:33:44.225171 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:44.225127    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 24 17:33:44.225385 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:44.225182    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 24 17:33:45.229223 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:45.229188    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:45.229610 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:45.229480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:45.230261 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:45.230241    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:33:48.973664 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:48.973615    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:33:57.121117 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:57.120891    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:53502->10.133.0.67:15021: read: connection reset by peer" start-of-body=
Jul 24 17:33:57.121117 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:57.120979    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:53502->10.133.0.67:15021: read: connection reset by peer"
Jul 24 17:33:57.804660 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:57.804625    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerID="1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af" exitCode=0
Jul 24 17:33:57.804836 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:57.804697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" event={"ID":"c3716943-f5ca-43b3-8278-26c67cbdc822","Type":"ContainerDied","Data":"1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af"}
Jul 24 17:33:57.805127 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:57.805113    2578 scope.go:117] "RemoveContainer" containerID="1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af"
Jul 24 17:33:57.806327 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:57.806301    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:57.806397 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:57.806370    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:57.806434 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:57.806400    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:33:58.812362 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:58.812327    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" event={"ID":"c3716943-f5ca-43b3-8278-26c67cbdc822","Type":"ContainerStarted","Data":"40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9"}
Jul 24 17:33:59.720401 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:59.720361    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:33:59.720642 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:59.720618    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 24 17:33:59.720688 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:33:59.720671    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 24 17:34:00.720139 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:00.720101    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 24 17:34:00.720537 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:00.720163    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 24 17:34:01.720480 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:01.720440    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 24 17:34:01.720940 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:01.720498    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 24 17:34:02.724074 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:02.724042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:34:02.724569 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:02.724315    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:34:02.725214 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:02.725196    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:34:16.083341 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:16.083299    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:34:31.999078 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:31.999033    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:34:45.070691 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.070656    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"]
Jul 24 17:34:45.074261 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.074243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.077042 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.077018    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-600cad-openshift-default-dockercfg-zlfxc\""
Jul 24 17:34:45.086813 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.086787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"]
Jul 24 17:34:45.134141 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bks6\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-kube-api-access-4bks6\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.134295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-certs\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.134295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-podinfo\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.134295 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istiod-ca-cert\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.134404 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-socket\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.134404 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-credential-socket\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.134472 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-envoy\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.134472 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-data\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.134572 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.134507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-token\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235424 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-credential-socket\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235424 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-envoy\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235754 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-data\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235754 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-token\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235754 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bks6\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-kube-api-access-4bks6\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235754 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-certs\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235973 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-podinfo\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235973 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istiod-ca-cert\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235973 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-credential-socket\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235973 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-data\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.235973 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.235958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-socket\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.236206 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.236093    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-certs\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.236283 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.236261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-socket\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.236506 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.236486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istiod-ca-cert\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.238377 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.238347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-envoy\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.238499 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.238487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-podinfo\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.243609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.243587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-token\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.243820 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.243802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bks6\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-kube-api-access-4bks6\") pod \"e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") " pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.386134 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.386042    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:45.538005 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.537951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"]
Jul 24 17:34:45.540990 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:34:45.540959    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80268cdc_3d1d_4e4d_bd71_8d61ff620f75.slice/crio-53e8af1c935268a68de548eb398e867fdc3971f4bf39ef13d4bbbd194604238f WatchSource:0}: Error finding container 53e8af1c935268a68de548eb398e867fdc3971f4bf39ef13d4bbbd194604238f: Status 404 returned error can't find the container with id 53e8af1c935268a68de548eb398e867fdc3971f4bf39ef13d4bbbd194604238f
Jul 24 17:34:45.543300 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.543265    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:45.543392 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.543350    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:45.543455 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:45.543396    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:34:46.096944 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:46.096908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" event={"ID":"80268cdc-3d1d-4e4d-bd71-8d61ff620f75","Type":"ContainerStarted","Data":"6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093"}
Jul 24 17:34:46.097319 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:46.096964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" event={"ID":"80268cdc-3d1d-4e4d-bd71-8d61ff620f75","Type":"ContainerStarted","Data":"53e8af1c935268a68de548eb398e867fdc3971f4bf39ef13d4bbbd194604238f"}
Jul 24 17:34:46.117972 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:46.117915    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" podStartSLOduration=1.117886891 podStartE2EDuration="1.117886891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:46.115992945 +0000 UTC m=+3107.346740392" watchObservedRunningTime="2026-07-24 17:34:46.117886891 +0000 UTC m=+3107.348634318"
Jul 24 17:34:46.387031 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:46.386949    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:46.392399 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:46.392370    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:47.104318 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:47.104292    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:47.105391 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:47.105369    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:34:58.296946 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:34:58.296907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:35:07.226253 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:07.226214    2578 generic.go:356] "Generic (PLEG): container finished" podID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerID="6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093" exitCode=0
Jul 24 17:35:07.226702 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:07.226273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" event={"ID":"80268cdc-3d1d-4e4d-bd71-8d61ff620f75","Type":"ContainerDied","Data":"6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093"}
Jul 24 17:35:07.226754 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:07.226706    2578 scope.go:117] "RemoveContainer" containerID="6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093"
Jul 24 17:35:07.227829 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:07.227798    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:07.227941 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:07.227880    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:07.227941 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:07.227928    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:35:08.237307 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:08.237265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" event={"ID":"80268cdc-3d1d-4e4d-bd71-8d61ff620f75","Type":"ContainerStarted","Data":"b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549"}
Jul 24 17:35:08.386291 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:08.386257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:35:08.386526 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:08.386490    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 24 17:35:08.386594 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:08.386574    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 24 17:35:09.386873 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:09.386822    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 24 17:35:09.387294 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:09.386885    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 24 17:35:10.386954 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:10.386911    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 24 17:35:10.387358 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:10.386980    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 24 17:35:11.386442 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:11.386408    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 24 17:35:11.386627 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:11.386460    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 24 17:35:12.391291 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:12.391260    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:35:12.391741 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:12.391623    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:35:12.392364 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:12.392347    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:35:20.085354 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:20.085314    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:35:25.511819 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:25.511729    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"]
Jul 24 17:35:25.512280 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:25.512028    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy" containerID="cri-o://b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549" gracePeriod=30
Jul 24 17:35:27.394129 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:27.394093    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:35:27.394499 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:27.394148    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:35:30.771323 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.771297    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:35:30.911960 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.911867    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bks6\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-kube-api-access-4bks6\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912139 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.911977    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istiod-ca-cert\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912139 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912004    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-envoy\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912139 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912033    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-data\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912139 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912055    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-podinfo\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912139 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912108    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-credential-socket\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912416 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-socket\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912416 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912196    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-certs\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912416 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912227    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-token\") pod \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\" (UID: \"80268cdc-3d1d-4e4d-bd71-8d61ff620f75\") "
Jul 24 17:35:30.912605 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912558    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:30.912661 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912583    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:30.912661 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912563    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:35:30.912772 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912696    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:30.912839 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.912819    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:30.913174 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.913140    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-data" (OuterVolumeSpecName: "istio-data") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:30.914356 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.914331    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:30.914451 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.914355    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-kube-api-access-4bks6" (OuterVolumeSpecName: "kube-api-access-4bks6") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "kube-api-access-4bks6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:35:30.914451 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.914431    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:35:30.914607 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:30.914584    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-token" (OuterVolumeSpecName: "istio-token") pod "80268cdc-3d1d-4e4d-bd71-8d61ff620f75" (UID: "80268cdc-3d1d-4e4d-bd71-8d61ff620f75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:35:31.014164 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.014127    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:31.014164 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.014158    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:31.014164 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.014167    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bks6\" (UniqueName: \"kubernetes.io/projected/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-kube-api-access-4bks6\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:31.014164 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.014177    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:31.014427 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.014185    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:31.014427 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.014193    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:31.014427 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.014200    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:31.014427 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.014208    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80268cdc-3d1d-4e4d-bd71-8d61ff620f75-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:35:31.382865 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.382830    2578 generic.go:356] "Generic (PLEG): container finished" podID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerID="b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549" exitCode=0
Jul 24 17:35:31.383059 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.382880    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"
Jul 24 17:35:31.383059 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.382888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" event={"ID":"80268cdc-3d1d-4e4d-bd71-8d61ff620f75","Type":"ContainerDied","Data":"b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549"}
Jul 24 17:35:31.383059 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.382943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz" event={"ID":"80268cdc-3d1d-4e4d-bd71-8d61ff620f75","Type":"ContainerDied","Data":"53e8af1c935268a68de548eb398e867fdc3971f4bf39ef13d4bbbd194604238f"}
Jul 24 17:35:31.383059 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.382971    2578 scope.go:117] "RemoveContainer" containerID="b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549"
Jul 24 17:35:31.392833 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.392815    2578 scope.go:117] "RemoveContainer" containerID="6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093"
Jul 24 17:35:31.401783 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.401696    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"]
Jul 24 17:35:31.401852 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.401794    2578 scope.go:117] "RemoveContainer" containerID="b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549"
Jul 24 17:35:31.402128 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:35:31.402100    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549\": container with ID starting with b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549 not found: ID does not exist" containerID="b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549"
Jul 24 17:35:31.402251 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.402137    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549"} err="failed to get container status \"b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549\": rpc error: code = NotFound desc = could not find container \"b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549\": container with ID starting with b5733ed0299212b457e990ae105154f3fe7b96452857e7b92e032018cea84549 not found: ID does not exist"
Jul 24 17:35:31.402251 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.402161    2578 scope.go:117] "RemoveContainer" containerID="6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093"
Jul 24 17:35:31.402562 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:35:31.402538    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093\": container with ID starting with 6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093 not found: ID does not exist" containerID="6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093"
Jul 24 17:35:31.402664 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.402572    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093"} err="failed to get container status \"6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093\": rpc error: code = NotFound desc = could not find container \"6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093\": container with ID starting with 6c860d889ed401999db684fcd9a4db2ce3666df7ce2a587cea370cddc28a5093 not found: ID does not exist"
Jul 24 17:35:31.405820 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:31.405797    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-600cad-openshift-default-6c586b5b8-qs7lz"]
Jul 24 17:35:33.312754 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:33.312719    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" path="/var/lib/kubelet/pods/80268cdc-3d1d-4e4d-bd71-8d61ff620f75/volumes"
Jul 24 17:35:44.787167 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:44.787128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:35:55.579227 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:35:55.579192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:36:37.820052 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:37.820018    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"]
Jul 24 17:36:37.820581 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:37.820248    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy" containerID="cri-o://6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6" gracePeriod=30
Jul 24 17:36:43.085530 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.085451    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:36:43.250895 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.250856    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-token\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251072 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.250902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istiod-ca-cert\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251072 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.250954    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-envoy\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251072 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.250987    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-socket\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251072 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-credential-socket\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251121    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-podinfo\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251188    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-certs\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251209    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-data\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251237    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpkp7\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-kube-api-access-fpkp7\") pod \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\" (UID: \"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2\") "
Jul 24 17:36:43.251463 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251292    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:43.251463 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251436    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:43.251606 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251454    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:36:43.251606 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251449    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:43.251740 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251718    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.251802 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251747    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.251802 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251762    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.251802 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.251776    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.252138 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.252112    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:43.253463 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.253424    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:36:43.253463 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.253451    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:36:43.253710 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.253688    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:36:43.253804 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.253733    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-kube-api-access-fpkp7" (OuterVolumeSpecName: "kube-api-access-fpkp7") pod "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" (UID: "75ee55cf-1409-4865-ae82-aa4a8eb1a6a2"). InnerVolumeSpecName "kube-api-access-fpkp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:36:43.352337 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.352258    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.352337 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.352285    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.352337 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.352294    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpkp7\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-kube-api-access-fpkp7\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.352337 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.352303    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.352337 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.352311    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:36:43.818708 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.818670    2578 generic.go:356] "Generic (PLEG): container finished" podID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerID="6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6" exitCode=0
Jul 24 17:36:43.818902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.818722    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"
Jul 24 17:36:43.818902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.818753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" event={"ID":"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2","Type":"ContainerDied","Data":"6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6"}
Jul 24 17:36:43.818902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.818812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv" event={"ID":"75ee55cf-1409-4865-ae82-aa4a8eb1a6a2","Type":"ContainerDied","Data":"15429f8cbdda85de6f74d9290af86ac9ab2ef03f069722a3e390dac127a3682e"}
Jul 24 17:36:43.818902 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.818834    2578 scope.go:117] "RemoveContainer" containerID="6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6"
Jul 24 17:36:43.828889 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.828873    2578 scope.go:117] "RemoveContainer" containerID="02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336"
Jul 24 17:36:43.836447 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.836423    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"]
Jul 24 17:36:43.839050 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.839029    2578 scope.go:117] "RemoveContainer" containerID="6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6"
Jul 24 17:36:43.839332 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:36:43.839313    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6\": container with ID starting with 6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6 not found: ID does not exist" containerID="6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6"
Jul 24 17:36:43.839403 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.839343    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6"} err="failed to get container status \"6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6\": rpc error: code = NotFound desc = could not find container \"6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6\": container with ID starting with 6865e8d156759c5df23244c0eaa27a8d8472d65e211ba8e5acf1fb1d3116dcc6 not found: ID does not exist"
Jul 24 17:36:43.839403 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.839361    2578 scope.go:117] "RemoveContainer" containerID="02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336"
Jul 24 17:36:43.839668 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:36:43.839652    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336\": container with ID starting with 02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336 not found: ID does not exist" containerID="02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336"
Jul 24 17:36:43.839717 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.839672    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336"} err="failed to get container status \"02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336\": rpc error: code = NotFound desc = could not find container \"02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336\": container with ID starting with 02e2719eb84e3e0ee2de6a35322618cd761c1d66f624221f2bc8d25960537336 not found: ID does not exist"
Jul 24 17:36:43.840377 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:43.840358    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-6a1c15-openshift-default-5f9f6d8cdd-lrwdv"]
Jul 24 17:36:45.312425 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:45.312386    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" path="/var/lib/kubelet/pods/75ee55cf-1409-4865-ae82-aa4a8eb1a6a2/volumes"
Jul 24 17:36:51.688909 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:51.688479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:36:59.977964 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:59.977926    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"]
Jul 24 17:36:59.978410 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:36:59.978163    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy" containerID="cri-o://40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9" gracePeriod=30
Jul 24 17:37:02.726706 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:02.726662    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:37:02.727082 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:02.726742    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:37:05.236344 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.236317    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:37:05.366136 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-data\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366136 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-podinfo\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-socket\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366205    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-token\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366236    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3716943-f5ca-43b3-8278-26c67cbdc822-istiod-ca-cert\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-certs\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366294    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-envoy\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366367 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn5ld\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-kube-api-access-mn5ld\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366701 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-credential-socket\") pod \"c3716943-f5ca-43b3-8278-26c67cbdc822\" (UID: \"c3716943-f5ca-43b3-8278-26c67cbdc822\") "
Jul 24 17:37:05.366701 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366596    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:05.366818 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366699    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3716943-f5ca-43b3-8278-26c67cbdc822-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:37:05.366903 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:05.366967 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366919    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:05.366967 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366950    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:05.367062 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366845    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.367062 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.366995    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3716943-f5ca-43b3-8278-26c67cbdc822-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.368647 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.368619    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:05.368777 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.368758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-kube-api-access-mn5ld" (OuterVolumeSpecName: "kube-api-access-mn5ld") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "kube-api-access-mn5ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:37:05.368881 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.368865    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:37:05.368938 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.368896    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3716943-f5ca-43b3-8278-26c67cbdc822" (UID: "c3716943-f5ca-43b3-8278-26c67cbdc822"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:37:05.468330 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.468291    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.468330 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.468323    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.468330 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.468333    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.468330 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.468341    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.468640 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.468349    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn5ld\" (UniqueName: \"kubernetes.io/projected/c3716943-f5ca-43b3-8278-26c67cbdc822-kube-api-access-mn5ld\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.468640 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.468360    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.468640 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.468368    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3716943-f5ca-43b3-8278-26c67cbdc822-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:05.954502 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.954460    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerID="40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9" exitCode=0
Jul 24 17:37:05.954706 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.954508    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"
Jul 24 17:37:05.954706 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.954499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" event={"ID":"c3716943-f5ca-43b3-8278-26c67cbdc822","Type":"ContainerDied","Data":"40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9"}
Jul 24 17:37:05.954706 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.954630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq" event={"ID":"c3716943-f5ca-43b3-8278-26c67cbdc822","Type":"ContainerDied","Data":"a4dbca20b2fbe18d090a318fd2dd4dc47e26ef0a40eaa5486c806d6849989c08"}
Jul 24 17:37:05.954706 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.954656    2578 scope.go:117] "RemoveContainer" containerID="40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9"
Jul 24 17:37:05.965609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.965592    2578 scope.go:117] "RemoveContainer" containerID="1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af"
Jul 24 17:37:05.974923 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.974895    2578 scope.go:117] "RemoveContainer" containerID="40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9"
Jul 24 17:37:05.975194 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:37:05.975173    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9\": container with ID starting with 40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9 not found: ID does not exist" containerID="40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9"
Jul 24 17:37:05.975240 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.975204    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9"} err="failed to get container status \"40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9\": rpc error: code = NotFound desc = could not find container \"40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9\": container with ID starting with 40777375a278f0931835192105053505598e426ed687a3889439db95f8c59dd9 not found: ID does not exist"
Jul 24 17:37:05.975240 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.975224    2578 scope.go:117] "RemoveContainer" containerID="1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af"
Jul 24 17:37:05.975441 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:37:05.975426    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af\": container with ID starting with 1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af not found: ID does not exist" containerID="1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af"
Jul 24 17:37:05.975486 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.975445    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af"} err="failed to get container status \"1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af\": rpc error: code = NotFound desc = could not find container \"1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af\": container with ID starting with 1fcf129c81be3cf25919675b18c7d0ed9f28fcd8b8a4b99dd0346e46d1c662af not found: ID does not exist"
Jul 24 17:37:05.980119 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.980091    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"]
Jul 24 17:37:05.984639 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:05.984618    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a2f844-openshift-default-7d9588689d-zwwbq"]
Jul 24 17:37:07.311237 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:07.311206    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" path="/var/lib/kubelet/pods/c3716943-f5ca-43b3-8278-26c67cbdc822/volumes"
Jul 24 17:37:14.389396 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:14.389345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:37:22.477502 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:22.477469    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"]
Jul 24 17:37:22.477955 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:22.477704    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy" containerID="cri-o://16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74" gracePeriod=30
Jul 24 17:37:26.379250 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:26.379204    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:37:26.379665 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:26.379279    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:37:27.740000 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.739943    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:37:27.887258 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887218    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istiod-ca-cert\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887444 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887280    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-token\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887444 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887312    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-podinfo\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887444 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-certs\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887444 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887376    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-envoy\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887444 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887408    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-credential-socket\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887737 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887474    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-data\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887737 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887500    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-socket\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887737 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887557    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j77ds\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-kube-api-access-j77ds\") pod \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\" (UID: \"02f0ab51-4fa3-49a1-ab60-1f7bc9825969\") "
Jul 24 17:37:27.887737 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887721    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:37:27.887941 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887776    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:27.887941 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887898    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:27.888069 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887955    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:27.888069 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.887976    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:27.888177 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.888063    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:27.888318 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.888296    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-data" (OuterVolumeSpecName: "istio-data") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:27.889680 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.889649    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-token" (OuterVolumeSpecName: "istio-token") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:37:27.889792 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.889679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-kube-api-access-j77ds" (OuterVolumeSpecName: "kube-api-access-j77ds") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "kube-api-access-j77ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:37:27.890030 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.890014    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:27.890077 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.890040    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02f0ab51-4fa3-49a1-ab60-1f7bc9825969" (UID: "02f0ab51-4fa3-49a1-ab60-1f7bc9825969"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:37:27.988978 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.988938    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:27.988978 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.988970    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:27.988978 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.988981    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:27.988978 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.988990    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:27.989256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.988998    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j77ds\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-kube-api-access-j77ds\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:27.989256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.989007    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:27.989256 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:27.989015    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02f0ab51-4fa3-49a1-ab60-1f7bc9825969-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:28.086531 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.086426    2578 generic.go:356] "Generic (PLEG): container finished" podID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerID="16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74" exitCode=0
Jul 24 17:37:28.086531 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.086484    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"
Jul 24 17:37:28.086711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.086531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" event={"ID":"02f0ab51-4fa3-49a1-ab60-1f7bc9825969","Type":"ContainerDied","Data":"16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74"}
Jul 24 17:37:28.086711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.086594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j" event={"ID":"02f0ab51-4fa3-49a1-ab60-1f7bc9825969","Type":"ContainerDied","Data":"ffd9286030280d6ecaa006ed3ec0846d939012a3c9af698f6e637d28488ba99b"}
Jul 24 17:37:28.086711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.086618    2578 scope.go:117] "RemoveContainer" containerID="16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74"
Jul 24 17:37:28.099327 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.099306    2578 scope.go:117] "RemoveContainer" containerID="cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646"
Jul 24 17:37:28.108591 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.108479    2578 scope.go:117] "RemoveContainer" containerID="16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74"
Jul 24 17:37:28.108903 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:37:28.108879    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74\": container with ID starting with 16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74 not found: ID does not exist" containerID="16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74"
Jul 24 17:37:28.108964 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.108911    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74"} err="failed to get container status \"16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74\": rpc error: code = NotFound desc = could not find container \"16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74\": container with ID starting with 16c744f9064032afd6f85aff07aff03a7ea0b88cd915a7837221d88023579f74 not found: ID does not exist"
Jul 24 17:37:28.108964 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.108932    2578 scope.go:117] "RemoveContainer" containerID="cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646"
Jul 24 17:37:28.109186 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:37:28.109166    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646\": container with ID starting with cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646 not found: ID does not exist" containerID="cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646"
Jul 24 17:37:28.109230 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.109193    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646"} err="failed to get container status \"cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646\": rpc error: code = NotFound desc = could not find container \"cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646\": container with ID starting with cb3c1d6f2b17065a8c3434629c6b2aaf76045ad282537049b0b29c5035a3a646 not found: ID does not exist"
Jul 24 17:37:28.111493 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.111474    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"]
Jul 24 17:37:28.115255 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:28.115233    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-de68c7-openshift-default-6fdcd5b99b-6xp2j"]
Jul 24 17:37:29.311610 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:29.311577    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" path="/var/lib/kubelet/pods/02f0ab51-4fa3-49a1-ab60-1f7bc9825969/volumes"
Jul 24 17:37:36.399341 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:36.399308    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j7wdw"]
Jul 24 17:37:44.777064 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:44.777031    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"]
Jul 24 17:37:44.777499 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:44.777269    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy" containerID="cri-o://7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed" gracePeriod=30
Jul 24 17:37:50.025119 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.025090    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:37:50.097078 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.096988    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-istio-token\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097078 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097051    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-envoy\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097096    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8577f80-367b-46e3-ac24-7f46729981c1-istiod-ca-cert\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097114    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-socket\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097145    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2t5f\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-kube-api-access-c2t5f\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097184    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-data\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-credential-socket\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097557 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097283    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-certs\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097557 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8577f80-367b-46e3-ac24-7f46729981c1-istio-podinfo\") pod \"a8577f80-367b-46e3-ac24-7f46729981c1\" (UID: \"a8577f80-367b-46e3-ac24-7f46729981c1\") "
Jul 24 17:37:50.097557 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097414    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:50.097557 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097481    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8577f80-367b-46e3-ac24-7f46729981c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:37:50.097774 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097695    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:50.097774 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097728    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:50.097882 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097813    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8577f80-367b-46e3-ac24-7f46729981c1-istiod-ca-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.097882 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097830    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.097882 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097839    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-credential-socket\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.097882 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.097849    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-workload-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.098282 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.098248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:50.099272 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.099252    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:37:50.099713 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.099692    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:37:50.099776 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.099692    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8577f80-367b-46e3-ac24-7f46729981c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:37:50.100105 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.100086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-kube-api-access-c2t5f" (OuterVolumeSpecName: "kube-api-access-c2t5f") pod "a8577f80-367b-46e3-ac24-7f46729981c1" (UID: "a8577f80-367b-46e3-ac24-7f46729981c1"). InnerVolumeSpecName "kube-api-access-c2t5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:37:50.198692 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.198653    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8577f80-367b-46e3-ac24-7f46729981c1-istio-podinfo\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.198692 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.198686    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-istio-token\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.198692 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.198694    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-envoy\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.198927 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.198703    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2t5f\" (UniqueName: \"kubernetes.io/projected/a8577f80-367b-46e3-ac24-7f46729981c1-kube-api-access-c2t5f\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.198927 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.198714    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8577f80-367b-46e3-ac24-7f46729981c1-istio-data\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\""
Jul 24 17:37:50.219644 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.219609    2578 generic.go:356] "Generic (PLEG): container finished" podID="a8577f80-367b-46e3-ac24-7f46729981c1" containerID="7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed" exitCode=0
Jul 24 17:37:50.219791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.219650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" event={"ID":"a8577f80-367b-46e3-ac24-7f46729981c1","Type":"ContainerDied","Data":"7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed"}
Jul 24 17:37:50.219791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.219691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5" event={"ID":"a8577f80-367b-46e3-ac24-7f46729981c1","Type":"ContainerDied","Data":"285410a511af69231e1f68021f762f78fb97b87f29105159c698ddb0ec84a4f7"}
Jul 24 17:37:50.219791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.219714    2578 scope.go:117] "RemoveContainer" containerID="7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed"
Jul 24 17:37:50.219791 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.219655    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"
Jul 24 17:37:50.229706 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.229688    2578 scope.go:117] "RemoveContainer" containerID="c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6"
Jul 24 17:37:50.239225 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.239090    2578 scope.go:117] "RemoveContainer" containerID="7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed"
Jul 24 17:37:50.239315 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:37:50.239293    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed\": container with ID starting with 7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed not found: ID does not exist" containerID="7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed"
Jul 24 17:37:50.239385 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.239322    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed"} err="failed to get container status \"7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed\": rpc error: code = NotFound desc = could not find container \"7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed\": container with ID starting with 7830f783227986d5b17ed7f19eedf653b5924e5a47a5fab5cbfff12d10f517ed not found: ID does not exist"
Jul 24 17:37:50.239385 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.239340    2578 scope.go:117] "RemoveContainer" containerID="c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6"
Jul 24 17:37:50.239561 ip-10-0-140-49 kubenswrapper[2578]: E0724 17:37:50.239544    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6\": container with ID starting with c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6 not found: ID does not exist" containerID="c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6"
Jul 24 17:37:50.239643 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.239564    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6"} err="failed to get container status \"c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6\": rpc error: code = NotFound desc = could not find container \"c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6\": container with ID starting with c6a09e473d89519057e62e425a9b7728fbc6fe6c966e4d2583371e533543eac6 not found: ID does not exist"
Jul 24 17:37:50.243600 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.243579    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"]
Jul 24 17:37:50.252553 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.250223    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d73e95-openshift-default-7988cd6b56-wvxh5"]
Jul 24 17:37:50.874120 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.874092    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mxzdh_b5cf345d-1af3-4bbd-ba71-1734fe57be5e/manager/0.log"
Jul 24 17:37:50.996129 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:50.996077    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zthkv_b3f403b1-8bc4-4f79-9f9a-f833c7a7e935/manager/0.log"
Jul 24 17:37:51.242602 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:51.242570    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wk2gn_33c1aa64-4544-4eac-8c8a-719dfd10f516/server/0.log"
Jul 24 17:37:51.311504 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:51.311471    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" path="/var/lib/kubelet/pods/a8577f80-367b-46e3-ac24-7f46729981c1/volumes"
Jul 24 17:37:51.363769 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:51.363735    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tfl6s_c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20/manager/0.log"
Jul 24 17:37:51.612827 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:51.612752    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-769b58b787-drghp_8c01803c-2d9b-4815-831b-8988789e570c/copy-manifests/0.log"
Jul 24 17:37:51.623044 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:51.623020    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-769b58b787-drghp_8c01803c-2d9b-4815-831b-8988789e570c/manager/0.log"
Jul 24 17:37:53.343169 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.343137    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm_a16abe7a-13b6-45d6-9ab6-d49ba3ab4765/util/0.log"
Jul 24 17:37:53.353371 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.353344    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm_a16abe7a-13b6-45d6-9ab6-d49ba3ab4765/pull/0.log"
Jul 24 17:37:53.361580 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.361543    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm_a16abe7a-13b6-45d6-9ab6-d49ba3ab4765/extract/0.log"
Jul 24 17:37:53.475707 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.475674    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9_fa0f578e-d331-4eb3-bf13-e6c3b1b80684/util/0.log"
Jul 24 17:37:53.487087 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.487042    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9_fa0f578e-d331-4eb3-bf13-e6c3b1b80684/pull/0.log"
Jul 24 17:37:53.498986 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.498961    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9_fa0f578e-d331-4eb3-bf13-e6c3b1b80684/extract/0.log"
Jul 24 17:37:53.616931 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.616854    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz_ecb9afe7-78a3-49d7-8b97-7d27b001836f/util/0.log"
Jul 24 17:37:53.624505 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.624477    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz_ecb9afe7-78a3-49d7-8b97-7d27b001836f/pull/0.log"
Jul 24 17:37:53.631770 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.631742    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz_ecb9afe7-78a3-49d7-8b97-7d27b001836f/extract/0.log"
Jul 24 17:37:53.746586 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.746556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr_75c8814c-6856-4055-bc56-721005f4da95/util/0.log"
Jul 24 17:37:53.754421 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.754395    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr_75c8814c-6856-4055-bc56-721005f4da95/pull/0.log"
Jul 24 17:37:53.761411 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:53.761387    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr_75c8814c-6856-4055-bc56-721005f4da95/extract/0.log"
Jul 24 17:37:54.017042 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:54.017009    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-87hrf_7c3531d2-1874-4bb5-9cfb-80e0caa1bc95/manager/0.log"
Jul 24 17:37:54.132213 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:54.132181    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7qh7v_afcc0bd2-fba7-4114-a67e-9c514efad67e/manager/0.log"
Jul 24 17:37:54.244327 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:54.244277    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6kgs9_8d80ccd9-c030-4057-99c5-b5e6067f9bb4/kuadrant-console-plugin/0.log"
Jul 24 17:37:54.383789 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:54.383702    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-f7hp4_dc07539b-9acc-43e2-b6ac-39382ba89c5d/registry-server/0.log"
Jul 24 17:37:54.620759 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:54.620727    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-j7wdw_7f4c1212-c2f2-4141-88b9-64d713846f1a/limitador/0.log"
Jul 24 17:37:54.743800 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:54.743760    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nxq9z_27efba3e-79ac-44ab-a567-4788babec4a6/manager/0.log"
Jul 24 17:37:55.093300 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:55.093199    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f_c87bbd3e-7be2-419c-bd53-c7c040e79897/istio-proxy/0.log"
Jul 24 17:37:55.330772 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:55.330740    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cb5df4894-7xdl8_463eac62-9a2d-43e5-86b3-979072b24091/kube-auth-proxy/0.log"
Jul 24 17:37:55.589674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:55.589648    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gzmhb_dfe780d3-c0b9-42b0-ab2d-c9749f9b0171/istio-proxy/1.log"
Jul 24 17:37:56.732940 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:37:56.732898    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-w8276_23672859-211f-4aad-ac57-b125735ab15f/main/0.log"
Jul 24 17:38:01.983267 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983224    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ffwf8/must-gather-8fmvs"]
Jul 24 17:38:01.983811 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983788    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy"
Jul 24 17:38:01.983891 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983813    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy"
Jul 24 17:38:01.983891 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983829    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy"
Jul 24 17:38:01.983891 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983837    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy"
Jul 24 17:38:01.983891 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983863    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy"
Jul 24 17:38:01.983891 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983872    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy"
Jul 24 17:38:01.983891 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983886    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983895    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983909    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983917    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983929    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983937    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983949    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983958    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983971    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983981    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983989    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.983997    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984116    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984129    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984139    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="02f0ab51-4fa3-49a1-ab60-1f7bc9825969" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984148    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984158    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ee55cf-1409-4865-ae82-aa4a8eb1a6a2" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984167    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984177    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984187    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy"
Jul 24 17:38:01.984202 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984197    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3716943-f5ca-43b3-8278-26c67cbdc822" containerName="istio-proxy"
Jul 24 17:38:01.985171 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984311    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy"
Jul 24 17:38:01.985171 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984322    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="80268cdc-3d1d-4e4d-bd71-8d61ff620f75" containerName="istio-proxy"
Jul 24 17:38:01.985171 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.984407    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8577f80-367b-46e3-ac24-7f46729981c1" containerName="istio-proxy"
Jul 24 17:38:01.989576 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.989555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwf8/must-gather-8fmvs"
Jul 24 17:38:01.992666 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.992640    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffwf8\"/\"openshift-service-ca.crt\""
Jul 24 17:38:01.992831 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.992816    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ffwf8\"/\"default-dockercfg-5cl2f\""
Jul 24 17:38:01.993523 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:01.993494    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffwf8\"/\"kube-root-ca.crt\""
Jul 24 17:38:02.006239 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.006211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffwf8/must-gather-8fmvs"]
Jul 24 17:38:02.113955 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.113908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae789c4f-3a9f-4260-9906-82a5730ae61d-must-gather-output\") pod \"must-gather-8fmvs\" (UID: \"ae789c4f-3a9f-4260-9906-82a5730ae61d\") " pod="openshift-must-gather-ffwf8/must-gather-8fmvs"
Jul 24 17:38:02.114141 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.114041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r5bc\" (UniqueName: \"kubernetes.io/projected/ae789c4f-3a9f-4260-9906-82a5730ae61d-kube-api-access-4r5bc\") pod \"must-gather-8fmvs\" (UID: \"ae789c4f-3a9f-4260-9906-82a5730ae61d\") " pod="openshift-must-gather-ffwf8/must-gather-8fmvs"
Jul 24 17:38:02.214945 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.214897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r5bc\" (UniqueName: \"kubernetes.io/projected/ae789c4f-3a9f-4260-9906-82a5730ae61d-kube-api-access-4r5bc\") pod \"must-gather-8fmvs\" (UID: \"ae789c4f-3a9f-4260-9906-82a5730ae61d\") " pod="openshift-must-gather-ffwf8/must-gather-8fmvs"
Jul 24 17:38:02.215127 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.214987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae789c4f-3a9f-4260-9906-82a5730ae61d-must-gather-output\") pod \"must-gather-8fmvs\" (UID: \"ae789c4f-3a9f-4260-9906-82a5730ae61d\") " pod="openshift-must-gather-ffwf8/must-gather-8fmvs"
Jul 24 17:38:02.215301 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.215269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae789c4f-3a9f-4260-9906-82a5730ae61d-must-gather-output\") pod \"must-gather-8fmvs\" (UID: \"ae789c4f-3a9f-4260-9906-82a5730ae61d\") " pod="openshift-must-gather-ffwf8/must-gather-8fmvs"
Jul 24 17:38:02.223363 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.223329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r5bc\" (UniqueName: \"kubernetes.io/projected/ae789c4f-3a9f-4260-9906-82a5730ae61d-kube-api-access-4r5bc\") pod \"must-gather-8fmvs\" (UID: \"ae789c4f-3a9f-4260-9906-82a5730ae61d\") " pod="openshift-must-gather-ffwf8/must-gather-8fmvs"
Jul 24 17:38:02.298870 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.298789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwf8/must-gather-8fmvs"
Jul 24 17:38:02.438570 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.438544    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffwf8/must-gather-8fmvs"]
Jul 24 17:38:02.440642 ip-10-0-140-49 kubenswrapper[2578]: W0724 17:38:02.440614    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae789c4f_3a9f_4260_9906_82a5730ae61d.slice/crio-482e7bd760c85e4ca0d04cb0f9fbe33f82d465dbb92827a385230f8ef3bac78f WatchSource:0}: Error finding container 482e7bd760c85e4ca0d04cb0f9fbe33f82d465dbb92827a385230f8ef3bac78f: Status 404 returned error can't find the container with id 482e7bd760c85e4ca0d04cb0f9fbe33f82d465dbb92827a385230f8ef3bac78f
Jul 24 17:38:02.442525 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:02.442501    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:38:03.299043 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:03.299010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwf8/must-gather-8fmvs" event={"ID":"ae789c4f-3a9f-4260-9906-82a5730ae61d","Type":"ContainerStarted","Data":"482e7bd760c85e4ca0d04cb0f9fbe33f82d465dbb92827a385230f8ef3bac78f"}
Jul 24 17:38:04.310325 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:04.310268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwf8/must-gather-8fmvs" event={"ID":"ae789c4f-3a9f-4260-9906-82a5730ae61d","Type":"ContainerStarted","Data":"42d78becee7c5d5c819c1375f16941fe88d8c9fcfb6645d70f4af54b19025880"}
Jul 24 17:38:04.310765 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:04.310340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwf8/must-gather-8fmvs" event={"ID":"ae789c4f-3a9f-4260-9906-82a5730ae61d","Type":"ContainerStarted","Data":"139b9cd6817f27d46cc5340a34a8bc3536b9833dd75e4eb1a882cd598e7e0fbc"}
Jul 24 17:38:04.327498 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:04.327448    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ffwf8/must-gather-8fmvs" podStartSLOduration=2.498309211 podStartE2EDuration="3.327429498s" totalImagesPullingTime="829.120287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:04.325687371 +0000 UTC m=+3305.556434798" watchObservedRunningTime="2026-07-24 17:38:04.327429498 +0000 UTC m=+3305.558176919"
Jul 24 17:38:04.882365 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:04.882335    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w89jr_f0358d9b-a9df-4167-9e29-ee86088fde7f/global-pull-secret-syncer/0.log"
Jul 24 17:38:04.973886 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:04.973847    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f2p82_15c1cac3-bcf8-425d-ab0f-73f44a36a086/konnectivity-agent/0.log"
Jul 24 17:38:05.088671 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:05.088643    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-49.ec2.internal_8b004fc47afd78b18f63d790c34fead7/haproxy/0.log"
Jul 24 17:38:09.748730 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.748690    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm_a16abe7a-13b6-45d6-9ab6-d49ba3ab4765/extract/0.log"
Jul 24 17:38:09.770711 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.770677    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm_a16abe7a-13b6-45d6-9ab6-d49ba3ab4765/util/0.log"
Jul 24 17:38:09.794618 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.794587    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wthcm_a16abe7a-13b6-45d6-9ab6-d49ba3ab4765/pull/0.log"
Jul 24 17:38:09.823120 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.823086    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9_fa0f578e-d331-4eb3-bf13-e6c3b1b80684/extract/0.log"
Jul 24 17:38:09.847630 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.847588    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9_fa0f578e-d331-4eb3-bf13-e6c3b1b80684/util/0.log"
Jul 24 17:38:09.873232 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.873182    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09tzd9_fa0f578e-d331-4eb3-bf13-e6c3b1b80684/pull/0.log"
Jul 24 17:38:09.903234 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.903181    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz_ecb9afe7-78a3-49d7-8b97-7d27b001836f/extract/0.log"
Jul 24 17:38:09.926040 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.926007    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz_ecb9afe7-78a3-49d7-8b97-7d27b001836f/util/0.log"
Jul 24 17:38:09.949833 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.949790    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7349pnz_ecb9afe7-78a3-49d7-8b97-7d27b001836f/pull/0.log"
Jul 24 17:38:09.982182 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:09.982148    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr_75c8814c-6856-4055-bc56-721005f4da95/extract/0.log"
Jul 24 17:38:10.009095 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:10.009019    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr_75c8814c-6856-4055-bc56-721005f4da95/util/0.log"
Jul 24 17:38:10.032299 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:10.032261    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st2kr_75c8814c-6856-4055-bc56-721005f4da95/pull/0.log"
Jul 24 17:38:10.728388 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:10.728354    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-87hrf_7c3531d2-1874-4bb5-9cfb-80e0caa1bc95/manager/0.log"
Jul 24 17:38:10.763045 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:10.763013    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7qh7v_afcc0bd2-fba7-4114-a67e-9c514efad67e/manager/0.log"
Jul 24 17:38:10.790531 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:10.790480    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6kgs9_8d80ccd9-c030-4057-99c5-b5e6067f9bb4/kuadrant-console-plugin/0.log"
Jul 24 17:38:10.855774 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:10.855701    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-f7hp4_dc07539b-9acc-43e2-b6ac-39382ba89c5d/registry-server/0.log"
Jul 24 17:38:11.059933 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:11.059830    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-j7wdw_7f4c1212-c2f2-4141-88b9-64d713846f1a/limitador/0.log"
Jul 24 17:38:11.160768 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:11.160737    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nxq9z_27efba3e-79ac-44ab-a567-4788babec4a6/manager/0.log"
Jul 24 17:38:12.704092 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:12.704057    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a14f8fd9-e5ef-4628-a884-9d0fcc9f132e/alertmanager/0.log"
Jul 24 17:38:12.745392 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:12.745364    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a14f8fd9-e5ef-4628-a884-9d0fcc9f132e/config-reloader/0.log"
Jul 24 17:38:12.769717 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:12.769682    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a14f8fd9-e5ef-4628-a884-9d0fcc9f132e/kube-rbac-proxy-web/0.log"
Jul 24 17:38:12.791721 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:12.791691    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a14f8fd9-e5ef-4628-a884-9d0fcc9f132e/kube-rbac-proxy/0.log"
Jul 24 17:38:12.812661 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:12.812634    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a14f8fd9-e5ef-4628-a884-9d0fcc9f132e/kube-rbac-proxy-metric/0.log"
Jul 24 17:38:12.833539 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:12.833488    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a14f8fd9-e5ef-4628-a884-9d0fcc9f132e/prom-label-proxy/0.log"
Jul 24 17:38:12.857059 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:12.857032    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a14f8fd9-e5ef-4628-a884-9d0fcc9f132e/init-config-reloader/0.log"
Jul 24 17:38:13.033733 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:13.033698    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-696948f58-pk28v_eb1d10e2-8059-413c-b007-d84ac4a5a3d4/metrics-server/0.log"
Jul 24 17:38:13.163993 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:13.163957    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n8mqw_c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c/node-exporter/0.log"
Jul 24 17:38:13.192730 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:13.192701    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n8mqw_c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c/kube-rbac-proxy/0.log"
Jul 24 17:38:13.221464 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:13.221439    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n8mqw_c6350df8-9f54-4ad0-aa24-72c1cb1d2f9c/init-textfile/0.log"
Jul 24 17:38:13.674939 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:13.674893    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fc9f96ff9-wbxtl_94bb3e7a-ac49-4df0-b5f4-b6db6e649168/telemeter-client/0.log"
Jul 24 17:38:13.696342 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:13.696309    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fc9f96ff9-wbxtl_94bb3e7a-ac49-4df0-b5f4-b6db6e649168/reload/0.log"
Jul 24 17:38:13.718482 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:13.718452    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fc9f96ff9-wbxtl_94bb3e7a-ac49-4df0-b5f4-b6db6e649168/kube-rbac-proxy/0.log"
Jul 24 17:38:15.275003 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.274952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"]
Jul 24 17:38:15.281403 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.281369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.289426 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.289376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"]
Jul 24 17:38:15.350065 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.349058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-sys\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.350065 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.349242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-podres\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.350320 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.350107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-proc\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.350320 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.350182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqgdm\" (UniqueName: \"kubernetes.io/projected/1a05603b-9027-4c2e-9b6f-56c639497bc5-kube-api-access-cqgdm\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.350320 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.350215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-lib-modules\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.451721 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.451682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-proc\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.451979 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.451947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-proc\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.452109 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.452086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqgdm\" (UniqueName: \"kubernetes.io/projected/1a05603b-9027-4c2e-9b6f-56c639497bc5-kube-api-access-cqgdm\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.452253 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.452232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-lib-modules\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.452583 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.452561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-sys\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.452794 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.452779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-podres\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.453041 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.453022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-podres\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.453154 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.452482    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-lib-modules\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.453288 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.453274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a05603b-9027-4c2e-9b6f-56c639497bc5-sys\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.461947 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.461911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqgdm\" (UniqueName: \"kubernetes.io/projected/1a05603b-9027-4c2e-9b6f-56c639497bc5-kube-api-access-cqgdm\") pod \"perf-node-gather-daemonset-9bgc7\" (UID: \"1a05603b-9027-4c2e-9b6f-56c639497bc5\") " pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.595583 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.595264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:15.791309 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:15.786651    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"]
Jul 24 17:38:16.217393 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:16.217366    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69f69f4957-r54g4_31b8c5f3-a359-4ad7-a819-b1e98b736f35/console/0.log"
Jul 24 17:38:16.254794 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:16.254747    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-6mltl_710a05c1-943f-4c3d-9e0d-f558f8a5d6b5/download-server/0.log"
Jul 24 17:38:16.413598 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:16.413564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7" event={"ID":"1a05603b-9027-4c2e-9b6f-56c639497bc5","Type":"ContainerStarted","Data":"881c533b290062484d840c3bfbf0dc96a09b0147c2117c31d37d47e445958f58"}
Jul 24 17:38:16.413991 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:16.413622    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7" event={"ID":"1a05603b-9027-4c2e-9b6f-56c639497bc5","Type":"ContainerStarted","Data":"a0311eb0fdaf81c53aa6019bea0fbd961e8bd013524741e4bfc911ad7c34568f"}
Jul 24 17:38:16.413991 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:16.413769    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:16.430748 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:16.430680    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7" podStartSLOduration=1.4306557500000001 podStartE2EDuration="1.43065575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:16.429324039 +0000 UTC m=+3317.660071467" watchObservedRunningTime="2026-07-24 17:38:16.43065575 +0000 UTC m=+3317.661403178"
Jul 24 17:38:17.855863 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:17.855821    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s4xzf_d86ce818-35e6-4488-b011-30a6fea70fbf/dns/0.log"
Jul 24 17:38:17.875797 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:17.875766    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s4xzf_d86ce818-35e6-4488-b011-30a6fea70fbf/kube-rbac-proxy/0.log"
Jul 24 17:38:17.986576 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:17.986546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tggvf_75731df3-1454-4bf7-9d07-c723e254ab2a/dns-node-resolver/0.log"
Jul 24 17:38:18.594740 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:18.594693    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhnfd_11d172de-f697-437c-bde7-fe358237ca92/node-ca/0.log"
Jul 24 17:38:19.572208 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:19.572131    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f_c87bbd3e-7be2-419c-bd53-c7c040e79897/istio-proxy/0.log"
Jul 24 17:38:19.742796 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:19.742753    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cb5df4894-7xdl8_463eac62-9a2d-43e5-86b3-979072b24091/kube-auth-proxy/0.log"
Jul 24 17:38:19.804217 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:19.804188    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gzmhb_dfe780d3-c0b9-42b0-ab2d-c9749f9b0171/istio-proxy/0.log"
Jul 24 17:38:19.860526 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:19.860419    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gzmhb_dfe780d3-c0b9-42b0-ab2d-c9749f9b0171/istio-proxy/1.log"
Jul 24 17:38:20.903236 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:20.903207    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s487s_384c97d3-e478-4a95-b865-70989b216cbe/serve-healthcheck-canary/0.log"
Jul 24 17:38:21.409232 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:21.409200    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-696lt_569ac2dd-e38a-46d7-9f43-da07b6291446/kube-rbac-proxy/0.log"
Jul 24 17:38:21.430227 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:21.430190    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-696lt_569ac2dd-e38a-46d7-9f43-da07b6291446/exporter/0.log"
Jul 24 17:38:21.454072 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:21.453983    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-696lt_569ac2dd-e38a-46d7-9f43-da07b6291446/extractor/0.log"
Jul 24 17:38:22.430609 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:22.430583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ffwf8/perf-node-gather-daemonset-9bgc7"
Jul 24 17:38:23.834756 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:23.834727    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mxzdh_b5cf345d-1af3-4bbd-ba71-1734fe57be5e/manager/0.log"
Jul 24 17:38:24.210015 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:24.209985    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zthkv_b3f403b1-8bc4-4f79-9f9a-f833c7a7e935/manager/0.log"
Jul 24 17:38:24.398222 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:24.398196    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wk2gn_33c1aa64-4544-4eac-8c8a-719dfd10f516/server/0.log"
Jul 24 17:38:24.548761 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:24.548670    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tfl6s_c7af6b9f-fa28-4f7f-9e1d-10c71f27cc20/manager/0.log"
Jul 24 17:38:24.702447 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:24.702410    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-769b58b787-drghp_8c01803c-2d9b-4815-831b-8988789e570c/manager/0.log"
Jul 24 17:38:24.749010 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:24.748980    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-769b58b787-drghp_8c01803c-2d9b-4815-831b-8988789e570c/copy-manifests/0.log"
Jul 24 17:38:25.413588 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:25.413465    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f_c87bbd3e-7be2-419c-bd53-c7c040e79897/istio-proxy/0.log"
Jul 24 17:38:25.581727 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:25.581691    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cb5df4894-7xdl8_463eac62-9a2d-43e5-86b3-979072b24091/kube-auth-proxy/0.log"
Jul 24 17:38:25.664449 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:25.664367    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gzmhb_dfe780d3-c0b9-42b0-ab2d-c9749f9b0171/istio-proxy/0.log"
Jul 24 17:38:25.720464 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:25.720418    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gzmhb_dfe780d3-c0b9-42b0-ab2d-c9749f9b0171/istio-proxy/1.log"
Jul 24 17:38:26.213912 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:26.213877    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-f4sqk_899c5672-95d5-4a45-b5dd-d74edd65cf16/openshift-lws-operator/0.log"
Jul 24 17:38:27.199307 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:27.199227    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-f6r2f_c87bbd3e-7be2-419c-bd53-c7c040e79897/istio-proxy/0.log"
Jul 24 17:38:27.363704 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:27.363672    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cb5df4894-7xdl8_463eac62-9a2d-43e5-86b3-979072b24091/kube-auth-proxy/0.log"
Jul 24 17:38:27.413932 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:27.413886    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gzmhb_dfe780d3-c0b9-42b0-ab2d-c9749f9b0171/istio-proxy/0.log"
Jul 24 17:38:27.466563 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:27.466503    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gzmhb_dfe780d3-c0b9-42b0-ab2d-c9749f9b0171/istio-proxy/1.log"
Jul 24 17:38:32.480866 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:32.480829    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9xgkp_6eb17e8b-69ba-457f-b91d-d4167f7833e4/kube-multus/0.log"
Jul 24 17:38:32.664674 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:32.664592    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2b7k_adf8e722-11a5-401d-903d-7e96260a2dc3/kube-multus-additional-cni-plugins/0.log"
Jul 24 17:38:32.683158 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:32.683119    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2b7k_adf8e722-11a5-401d-903d-7e96260a2dc3/egress-router-binary-copy/0.log"
Jul 24 17:38:32.701993 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:32.701956    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2b7k_adf8e722-11a5-401d-903d-7e96260a2dc3/cni-plugins/0.log"
Jul 24 17:38:32.719804 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:32.719772    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2b7k_adf8e722-11a5-401d-903d-7e96260a2dc3/bond-cni-plugin/0.log"
Jul 24 17:38:32.739816 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:32.739788    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2b7k_adf8e722-11a5-401d-903d-7e96260a2dc3/routeoverride-cni/0.log"
Jul 24 17:38:32.760825 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:32.760794    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2b7k_adf8e722-11a5-401d-903d-7e96260a2dc3/whereabouts-cni-bincopy/0.log"
Jul 24 17:38:32.780582 ip-10-0-140-49 kubenswrapper[2578]: I0724 17:38:32.780552    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2b7k_adf8e722-11a5-401d-903d-7e96260a2dc3/whereabouts-cni/0.log"